-- Logs begin at Tue 2022-10-04 17:02:06 UTC, end at Tue 2022-10-04 19:33:57 UTC. -- Oct 04 17:38:51.741295 n-d-831194-21 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:38:51.750524 n-d-831194-21 devstack@n-api.service[112940]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:38:51 2022] *** Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: nodename: n-d-831194-21 Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: machine: x86_64 Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: clock source: unix Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: pcre jit disabled Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: detected number of CPU cores: 4 Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: current working directory: / Oct 04 17:38:51.752438 n-d-831194-21 devstack@n-api.service[112940]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: your processes number limit is 47680 Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: your memory page size is 4096 bytes Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: detected max file descriptor number: 2048 Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: lock engine: pthread robust mutexes Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: thunder lock: enabled Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:38:51.753140 n-d-831194-21 devstack@n-api.service[112940]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:38:51.792387 n-d-831194-21 devstack@n-api.service[112940]: Python main interpreter initialized at 0x5587f3eb79c0 Oct 04 17:38:51.792387 n-d-831194-21 devstack@n-api.service[112940]: python threads support enabled Oct 04 17:38:51.792387 n-d-831194-21 devstack@n-api.service[112940]: your server socket listen backlog is limited to 100 connections Oct 04 17:38:51.792387 n-d-831194-21 devstack@n-api.service[112940]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:38:51.792747 n-d-831194-21 devstack@n-api.service[112940]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:38:51.792825 n-d-831194-21 devstack@n-api.service[112940]: *** Operational MODE: preforking *** Oct 04 17:38:51.793058 n-d-831194-21 devstack@n-api.service[112940]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:38:51.793058 n-d-831194-21 devstack@n-api.service[112940]: spawned uWSGI master process (pid: 112940) Oct 04 17:38:51.793248 n-d-831194-21 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:38:51.795549 n-d-831194-21 devstack@n-api.service[112940]: spawned uWSGI worker 1 (pid: 112941, cores: 1) Oct 04 17:38:51.795549 n-d-831194-21 devstack@n-api.service[112940]: spawned uWSGI worker 2 (pid: 112942, cores: 1) Oct 04 17:38:51.795549 n-d-831194-21 devstack@n-api.service[112940]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:38:52.460318 n-d-831194-21 devstack@n-api.service[112942]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:38:52.469616 n-d-831194-21 devstack@n-api.service[112941]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:38:53.558261 n-d-831194-21 devstack@n-api.service[112942]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:38:53.558261 n-d-831194-21 devstack@n-api.service[112942]: from cryptography.utils import int_from_bytes Oct 04 17:38:53.558862 n-d-831194-21 devstack@n-api.service[112942]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:38:53.558862 n-d-831194-21 devstack@n-api.service[112942]: from cryptography.utils import int_from_bytes Oct 04 17:38:53.561248 n-d-831194-21 devstack@n-api.service[112941]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:38:53.561248 n-d-831194-21 devstack@n-api.service[112941]: from cryptography.utils import int_from_bytes Oct 04 17:38:53.561677 n-d-831194-21 devstack@n-api.service[112941]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:38:53.561677 n-d-831194-21 devstack@n-api.service[112941]: from cryptography.utils import int_from_bytes Oct 04 17:38:56.080315 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:38:56.080808 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:38:56.081151 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:38:56.081237 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:38:56.081327 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:38:56.081427 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:38:56.081515 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:38:56.081603 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:38:56.081696 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:38:56.082307 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:38:56.082864 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.082956 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083038 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083117 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083240 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083365 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083563 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083664 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083896 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.083983 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084211 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084324 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084534 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084621 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084857 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.084958 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085184 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085280 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085446 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085532 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085764 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.085863 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086122 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831194-21 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086210 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831194-21 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086449 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086533 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086756 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.086851 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087065 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087151 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087379 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087472 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087684 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.087769 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088009 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088102 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088313 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088403 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088817 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.088936 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.089250 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.089337 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.089556 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.089641 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.089883 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090014 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090224 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090312 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090538 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090626 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090845 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.090937 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091164 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091248 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091470 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091552 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091796 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.091934 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092110 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092205 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092512 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831194-21 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092602 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831194-21 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092834 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.092920 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.093152 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.093242 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.093469 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.093567 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.093911 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094063 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094234 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094368 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094551 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094662 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.094875 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095070 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095201 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095301 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095509 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095614 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095838 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.095931 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096154 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096246 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096472 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096596 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096792 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.096892 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.097093 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.097185 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.097488 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.098625 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.098721 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.098797 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.098866 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.098933 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099010 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099208 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099307 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099474 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099628 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099770 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.099948 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100093 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100233 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100385 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100536 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100679 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100829 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.100983 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101125 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101269 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101700 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.101896 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102067 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102211 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102365 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102515 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102657 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102805 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.102946 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.103093 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.103255 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.103821 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.103970 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104134 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104288 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104429 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104579 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104722 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.104871 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105056 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105242 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105402 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105633 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105779 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.105945 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106088 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106228 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106392 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106535 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106675 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106822 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.106822 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107091 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107323 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107467 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107467 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107733 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.107883 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108026 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108026 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108313 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108454 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108594 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108744 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.108893 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109036 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109175 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109314 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109454 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109594 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109746 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.109917 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110073 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110214 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110353 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110504 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110653 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110794 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.110941 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111089 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111229 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111369 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111521 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111661 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111807 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.111966 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112108 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112249 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112401 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112541 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112693 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.112833 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113003 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113251 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113450 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113597 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113738 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.113908 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114067 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114067 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114345 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114485 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114624 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114764 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.114903 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115061 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115246 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115388 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115529 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115755 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.115911 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116078 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116227 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116369 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116509 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116657 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116805 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.116954 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117095 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117235 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117376 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117530 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117688 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.117875 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118025 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118166 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118314 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118463 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118607 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118768 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.118910 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.119059 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.119200 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.119602 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.119757 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.119907 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120059 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120200 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120348 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120500 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120651 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120793 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.120939 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121080 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121220 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121367 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121521 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121669 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.121818 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122010 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122161 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122303 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122457 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122598 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122747 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.122887 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123027 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123184 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123333 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123474 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123623 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123773 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.123931 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124081 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124231 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124372 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124512 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124665 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124813 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.124962 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.125115 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.125310 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.125465 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.125607 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.125765 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126046 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126195 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126337 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126477 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126625 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126767 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.126918 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:38:56.127067 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127221 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127362 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127508 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127658 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127816 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.127967 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.128109 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.128250 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.128410 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.128562 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.129654 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.129813 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.129995 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130150 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130292 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130445 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130593 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130746 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.130887 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131029 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131185 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131336 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131477 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131625 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131773 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.131914 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132084 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132243 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132392 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132551 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132693 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132833 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.132974 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133123 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133265 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133406 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133552 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133695 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.133897 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134048 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134192 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134333 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134488 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134629 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134786 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.134929 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135070 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135212 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135394 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135542 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135692 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135834 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.135974 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136201 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136350 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136502 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136652 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136801 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.136942 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137082 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137223 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137377 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137519 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137660 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137809 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.137975 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138117 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138289 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138441 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138593 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138742 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.138884 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139024 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139173 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139315 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139463 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139605 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139754 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.139902 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140053 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140204 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140345 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140497 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140640 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140794 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.140949 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141099 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141240 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141386 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141529 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141678 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141819 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.141819 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142140 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142282 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142433 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142584 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142726 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.142866 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143005 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143145 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143286 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143435 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143577 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143724 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.143864 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.144029 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.144171 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.144401 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.145460 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.145622 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.145766 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.145939 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146095 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146095 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146476 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146619 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146762 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.146912 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147079 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147223 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147373 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147591 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147736 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.147878 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148028 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148169 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148317 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148505 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148660 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148813 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148976 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.148976 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.149276 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.149417 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.149558 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.149707 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.149897 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150058 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150200 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150348 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150498 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150648 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150790 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.150949 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151101 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151244 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151384 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151538 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151680 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151827 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.151968 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152116 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152264 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152415 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152557 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152697 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152849 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.152998 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153150 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153291 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153438 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153580 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153760 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.153945 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154101 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154251 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154392 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154545 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154697 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154838 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.154991 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155133 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155273 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155425 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155617 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155764 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.155913 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156055 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156196 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156353 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156567 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156733 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.156875 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157026 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157175 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157318 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157457 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157687 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.157892 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158042 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158183 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158325 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158465 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158618 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158772 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.158913 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159064 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159213 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159356 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159505 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159646 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159786 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.159927 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.160508 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.160663 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.160806 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.160948 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.160948 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161243 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161386 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161386 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161670 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161812 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.161997 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162148 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162297 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162447 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162590 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162738 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.162879 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163030 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163171 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163329 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163471 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163614 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163761 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.163903 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164052 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164202 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164343 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164484 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164625 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164776 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.164926 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165075 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165225 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165366 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165506 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165697 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.165902 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166053 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166205 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166347 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166503 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166736 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.166911 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167055 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167196 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167337 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167485 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167635 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167786 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.167983 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168129 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168271 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168411 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168561 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168710 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.168865 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169006 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169155 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169307 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169463 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169613 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169762 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.169941 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170084 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170231 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170390 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170539 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170686 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.170855 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171004 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171159 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171315 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171470 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171617 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171771 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.171920 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172075 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172223 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172377 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172525 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172679 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.172838 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173000 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173149 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173295 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173442 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173595 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173743 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.173941 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174096 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174251 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174407 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174561 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174720 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.174876 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.175023 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.175179 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.175328 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.175539 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.176161 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.176334 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.176484 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.176631 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.176631 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177018 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177180 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177340 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177487 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177634 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177780 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.177933 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178048 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178135 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178214 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178293 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178371 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178456 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178545 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178632 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178718 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178796 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178872 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.178959 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179045 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179123 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179199 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179282 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179359 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179444 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179578 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179744 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.179906 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180070 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180229 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180388 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180612 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180776 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.180926 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181073 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181219 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181376 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181524 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181670 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.181817 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182015 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182186 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182344 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182493 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182658 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182806 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.182953 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183108 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183256 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183403 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183551 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183697 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.183844 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184004 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184167 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184324 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184472 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184627 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184782 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.184938 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185085 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185232 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185378 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185532 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185680 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.185973 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186144 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186292 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186438 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186586 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186747 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.186980 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187144 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187293 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187440 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187587 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187745 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.187891 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188045 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188211 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188360 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188514 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188671 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188819 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.188967 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189113 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189260 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189414 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189570 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189718 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.189934 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190090 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190090 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190395 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190543 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190690 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190690 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.190969 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.191720 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.192229 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.192229 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.192537 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.192537 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.192827 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193000 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193148 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193148 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193435 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193592 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193740 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.193908 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194073 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194222 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194379 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194527 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194675 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194830 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.194991 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195138 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195294 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195442 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195598 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195755 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.195946 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196108 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196265 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196413 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196560 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196707 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.196854 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197102 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197268 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197424 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197573 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197728 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.197923 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198091 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198249 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198396 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198576 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198732 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.198880 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199041 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199210 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199358 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199513 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199660 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199822 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.199988 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200144 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200304 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200452 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200599 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200746 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.200903 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201076 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201236 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201386 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201541 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201698 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.201698 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202004 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202162 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202310 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202310 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202601 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202601 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.202890 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203049 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203207 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203355 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203511 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203659 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203806 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.203960 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204108 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204266 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204415 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204562 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204709 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.204855 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205025 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205182 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205367 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205520 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205682 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.205853 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.206057 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.206220 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.206369 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.206517 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.206665 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.207818 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208003 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208164 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208313 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208468 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208616 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208763 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.208924 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209086 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209234 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209381 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209527 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209675 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.209882 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210051 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210200 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210357 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210518 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210665 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210829 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.210981 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211136 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211284 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211431 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211578 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211806 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.211958 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212117 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212265 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212558 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212714 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.212863 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213010 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213156 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213302 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213457 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213612 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213760 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.213939 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214110 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214259 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214420 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214568 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214722 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.214870 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215018 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215164 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215319 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215476 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215632 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215780 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.215935 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216144 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216299 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216446 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216605 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216754 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216900 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.216900 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.217188 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.217343 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.217490 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.217644 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.217793 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218003 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218156 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218303 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218449 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218595 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218743 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.218899 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219047 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219203 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219351 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219497 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219643 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219798 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.219958 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220112 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220261 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220415 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220571 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220729 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.220878 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221025 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221172 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221327 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221487 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221643 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221799 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.221985 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.222136 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.222283 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.222551 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223136 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223292 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223456 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223606 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223754 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.223910 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224058 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224254 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224407 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224568 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224725 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.224881 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225035 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225191 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225371 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225525 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225682 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.225891 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226048 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226238 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226434 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226590 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226762 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.226921 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227069 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227224 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227373 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227530 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227687 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227842 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.227990 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228138 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228292 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228448 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228607 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228754 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.228910 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229057 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229204 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229365 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229521 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229670 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.229817 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230006 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230156 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230318 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230475 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230636 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230783 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.230955 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231105 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231261 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231409 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231563 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231712 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.231859 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232015 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232172 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232319 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232473 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232633 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232781 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.232940 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233089 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233235 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233382 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233529 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233683 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.233903 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234059 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234207 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234354 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234501 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234659 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234819 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.234982 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235130 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235283 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235438 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235594 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235742 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.235904 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236053 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236200 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236390 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236607 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236758 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.236905 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237061 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237210 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237357 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237513 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237661 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.237808 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238055 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238286 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238482 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238642 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238807 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.238956 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239111 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239267 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239429 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239577 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239724 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.239871 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240017 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240166 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240320 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240475 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240629 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240792 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.240940 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241094 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241321 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241472 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241619 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241766 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.241956 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242105 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242105 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242401 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242548 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242702 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.242702 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243002 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243002 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243282 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243429 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243575 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243575 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.243862 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.244010 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.244177 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.244177 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.244746 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.244905 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245053 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245053 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245346 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245494 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245640 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245787 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.245941 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246038 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246141 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246141 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246293 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246293 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246422 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246488 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246562 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246630 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246694 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246758 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246822 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246905 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.246974 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247047 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247114 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247178 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247242 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247242 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247368 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247434 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247498 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247498 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247613 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247686 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247753 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247817 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247881 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.247946 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248010 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248083 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248158 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248258 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248328 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248727 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.248952 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249098 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249245 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249386 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249527 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249666 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249822 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.249965 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250047 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250129 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250208 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250288 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250387 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250547 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250695 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250858 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.250991 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251183 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251325 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251492 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251627 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251817 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.251951 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252125 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252258 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252444 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252584 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252760 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.252895 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.253073 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.253206 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.253396 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.253528 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.254590 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.254745 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.254888 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255020 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255156 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255286 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255414 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255555 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255694 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255826 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.255954 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256097 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256265 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256454 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256594 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256723 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256860 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.256990 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257117 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257260 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257390 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257520 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257700 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.257896 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258050 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258197 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258347 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258476 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258667 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258800 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.258986 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259128 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259288 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259420 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259593 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259727 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.259905 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260040 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260211 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260344 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260576 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260720 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260858 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.260987 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261116 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261243 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261400 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261531 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261707 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.261864 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262038 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262170 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262345 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262476 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262656 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262790 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.262974 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263114 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263280 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263422 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263589 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263720 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.263896 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264028 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264201 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264342 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264512 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264653 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264819 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.264951 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265149 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265292 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265460 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265599 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265782 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.265941 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266121 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266265 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266436 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266601 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266755 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.266887 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267072 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267204 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267383 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267514 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267701 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.267831 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268024 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268161 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268319 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268454 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268634 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268765 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.268948 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.269089 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.269311 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.270411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.270411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.270674 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.270674 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271012 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271141 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271270 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271406 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271547 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271677 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271805 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.271933 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272107 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272240 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272426 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272561 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272746 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.272878 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273055 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273195 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273369 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273510 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273686 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.273820 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274029 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274176 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274347 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274484 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274680 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274811 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.274999 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275141 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275318 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275450 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275635 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275769 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.275949 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276091 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276267 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276407 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276625 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276764 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.276902 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277030 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277191 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277323 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277509 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277651 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277844 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.277993 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278158 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278291 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278471 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278672 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278804 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.278933 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279084 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279217 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279395 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279540 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279701 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.279840 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280017 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280159 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280328 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280468 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280689 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280819 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.280974 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281111 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281251 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281390 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281579 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281712 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.281916 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282051 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282239 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282381 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282558 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282757 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.282898 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.283073 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.283221 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.283413 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.283696 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.283828 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284015 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284159 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284349 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284480 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284666 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.284798 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.285022 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.285564 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.285764 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.285764 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286033 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286177 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286309 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286447 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286584 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286753 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.286884 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287012 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287140 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287278 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287408 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287537 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287711 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.287843 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288025 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288168 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288356 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288656 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288790 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.288971 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289111 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289299 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289433 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289614 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289757 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.289993 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.290190 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.290325 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.290550 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.290683 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.290876 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291010 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291231 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291355 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291515 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291647 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291836 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.291979 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292151 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292284 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292460 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292594 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292767 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.292909 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293075 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293206 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293388 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293519 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293702 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.293864 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294040 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294173 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294355 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294499 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294673 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294815 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.294989 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295122 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295299 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295432 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295603 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295743 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.295909 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296040 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296213 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296344 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296519 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296656 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296827 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.296958 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297116 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297257 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297428 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297568 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297733 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.297893 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298062 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298194 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298367 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298500 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298663 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298796 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.298973 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299120 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299284 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299425 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299598 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299732 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.299914 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.300055 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.300217 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.300348 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.300593 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301113 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301256 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301397 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301397 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301641 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301761 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.301923 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302057 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302195 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302325 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302454 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302583 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302710 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302848 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.302979 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.303159 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.303468 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.303603 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.303782 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.303921 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304114 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304246 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304439 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304570 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304769 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.304978 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305122 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305319 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305481 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305647 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305780 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.305995 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306128 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306310 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306444 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306627 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306770 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.306950 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307080 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307209 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307337 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307531 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307675 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307843 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.307976 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308154 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308288 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308465 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308674 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308806 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.308930 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309057 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309186 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309363 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309504 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309673 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.309813 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310009 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310142 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310321 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310456 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310631 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310763 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.310948 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311083 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311262 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311397 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311575 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311716 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.311887 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312028 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312203 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312335 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312510 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312642 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312823 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.312968 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313133 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313270 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313448 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313582 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313762 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.313964 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314096 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314222 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314403 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314546 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314690 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.314819 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315014 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315332 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315463 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315661 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315802 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.315973 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.316655 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317206 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317339 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317468 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317468 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317739 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.317902 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318044 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318174 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318312 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318442 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318581 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318713 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.318880 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319021 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319210 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319344 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319541 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319675 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.319859 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320001 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320192 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320327 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320508 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320642 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320831 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.320964 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321142 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321270 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321461 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321594 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321774 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.321959 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322091 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322219 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322394 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322528 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322705 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.322847 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323009 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323142 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323313 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323448 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323619 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323762 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.323925 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324057 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324229 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324361 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324533 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324668 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324836 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.324968 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325134 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325265 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325438 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325580 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325739 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.325895 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326070 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326203 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326355 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326485 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326663 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326796 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.326963 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327095 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327272 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327409 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327538 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327663 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327837 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.327977 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328145 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328277 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328451 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328582 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328759 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.328899 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329065 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329197 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329371 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329511 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329724 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.329900 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330032 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330158 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330345 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330477 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330670 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330809 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.330982 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.331112 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.331292 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.331424 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.331613 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.331827 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.332365 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.332504 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.332634 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.332771 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.332915 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333046 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333175 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333317 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333449 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333578 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333715 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.333902 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334034 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334192 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334339 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334511 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334652 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334827 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.334967 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335141 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335281 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335451 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335585 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335763 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.335895 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336075 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336209 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336403 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336538 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336710 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.336848 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337015 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337154 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337343 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337475 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337606 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337735 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.337938 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338150 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338283 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338411 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338553 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338684 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338842 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.338985 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339159 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339291 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339472 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339605 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339797 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.339939 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340109 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340240 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340416 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340547 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340734 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.340867 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.341052 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.341185 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.341376 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.341507 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.341697 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342053 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342185 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342387 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342520 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342702 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.342849 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343018 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343151 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343331 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343465 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343636 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343771 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.343908 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112942) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:38:56.344038 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.344315 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.344646 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.344966 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.345279 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.345588 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:38:56.345851 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112941) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:38:56.504859 n-d-831194-21 devstack@n-api.service[112942]: INFO dbcounter [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Registered counter for database nova_api Oct 04 17:38:56.505124 n-d-831194-21 devstack@n-api.service[112941]: INFO dbcounter [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Registered counter for database nova_api Oct 04 17:38:56.524991 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_db.sqlalchemy.engines [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.526402 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_db.sqlalchemy.engines [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.531566 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writer thread running {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.532950 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writer thread running {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.588930 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.context [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=112942) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:38:56.590617 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.context [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=112941) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:38:56.592715 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:38:56.593198 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:38:56.594459 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:38:56.594806 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:38:56.594948 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:38:56.595536 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:38:56.595981 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:38:56.596526 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:38:56.597273 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:38:56.598490 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:38:56.598727 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_concurrency.lockutils [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=112942) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:38:56.600455 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:38:56.600709 n-d-831194-21 devstack@n-api.service[112942]: INFO dbcounter [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Registered counter for database nova_cell0 Oct 04 17:38:56.602462 n-d-831194-21 devstack@n-api.service[112941]: INFO dbcounter [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Registered counter for database nova_cell0 Oct 04 17:38:56.604864 n-d-831194-21 devstack@n-api.service[112942]: INFO dbcounter [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Registered counter for database nova_cell1 Oct 04 17:38:56.606459 n-d-831194-21 devstack@n-api.service[112941]: INFO dbcounter [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Registered counter for database nova_cell1 Oct 04 17:38:56.611842 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_db.sqlalchemy.engines [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.613593 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_db.sqlalchemy.engines [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.615129 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_db.sqlalchemy.engines [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.616039 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_db.sqlalchemy.engines [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.619923 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writer thread running {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.622227 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writer thread running {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.623226 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writer thread running {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.625522 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writer thread running {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.781479 n-d-831194-21 devstack@n-api.service[112942]: INFO dbcounter [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Registered counter for database nova_cell0 Oct 04 17:38:56.789317 n-d-831194-21 devstack@n-api.service[112942]: DEBUG oslo_db.sqlalchemy.engines [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112942) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.794010 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writer thread running {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:56.805647 n-d-831194-21 devstack@n-api.service[112941]: INFO dbcounter [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Registered counter for database nova_cell0 Oct 04 17:38:56.812716 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_db.sqlalchemy.engines [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112941) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:38:56.817602 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writer thread running {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:38:57.145350 n-d-831194-21 devstack@n-api.service[112941]: WARNING keystonemiddleware.auth_token [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:38:57.147311 n-d-831194-21 devstack@n-api.service[112942]: WARNING keystonemiddleware.auth_token [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:38:57.152804 n-d-831194-21 devstack@n-api.service[112941]: WARNING keystonemiddleware.auth_token [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:38:57.154869 n-d-831194-21 devstack@n-api.service[112942]: WARNING keystonemiddleware.auth_token [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:38:57.498776 n-d-831194-21 devstack@n-api.service[112941]: WARNING keystonemiddleware.auth_token [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:38:57.505439 n-d-831194-21 devstack@n-api.service[112941]: WARNING keystonemiddleware.auth_token [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:38:57.508652 n-d-831194-21 devstack@n-api.service[112942]: WARNING keystonemiddleware.auth_token [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:38:57.510764 n-d-831194-21 devstack@n-api.service[112941]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587f3eb79c0 pid: 112941 (default app) Oct 04 17:38:57.512817 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:38:57.514015 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001710 Oct 04 17:38:57.514441 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Tue Oct 4 17:38:57 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:38:57.514664 n-d-831194-21 devstack@n-api.service[112942]: WARNING keystonemiddleware.auth_token [None req-ba023bf5-1be6-495e-8b7e-deaa4c69d516 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:38:57.520732 n-d-831194-21 devstack@n-api.service[112942]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5587f3eb79c0 pid: 112942 (default app) Oct 04 17:40:20.779035 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:20.780826 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002126 Oct 04 17:40:20.781657 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:20.794968 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_api:SELECT=3 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:20.795897 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_cell0:SELECT=3 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:20.797636 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_cell1:SELECT=3 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:20.798434 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:21.699292 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-7d632bfd-fbd9-40c3-b512-81344946fab4 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:21.733021 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-7d632bfd-fbd9-40c3-b512-81344946fab4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.944740 Oct 04 17:40:21.733742 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 17:40:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:24.338641 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:24.339653 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-1499bf11-5cf2-43ab-945d-e1e6f9b6814a None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 04 17:40:24.340259 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:24.856704 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-2cd833e5-d67a-4070-a073-ffa6fcaeec62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:24.927590 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-2cd833e5-d67a-4070-a073-ffa6fcaeec62 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.580591 Oct 04 17:40:24.928019 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:40:25.231194 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-5849969f-fe73-4a3d-b933-2b5c39fa33e9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:25.238542 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_api:SELECT=3 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:25.239561 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_cell0:SELECT=3 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:25.240513 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_cell1:SELECT=3 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:25.241170 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_cell0:SELECT=3 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:25.308315 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-5849969f-fe73-4a3d-b933-2b5c39fa33e9 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.371306 Oct 04 17:40:25.308849 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 17:40:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:28.003622 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-2cd833e5-d67a-4070-a073-ffa6fcaeec62 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:28.005269 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-2cd833e5-d67a-4070-a073-ffa6fcaeec62 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Oct 04 17:40:28.006150 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:28.864657 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-bcee58ff-0bad-4002-b4f0-08500c366f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:28.915624 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-bcee58ff-0bad-4002-b4f0-08500c366f28 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.902470 Oct 04 17:40:28.921852 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:28.935177 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-9672ecc8-20ab-4cd3-af4b-08a5e781de5b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:29.003102 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-9672ecc8-20ab-4cd3-af4b-08a5e781de5b admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076429 Oct 04 17:40:29.004468 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 17:40:28 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:31.827031 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-bcee58ff-0bad-4002-b4f0-08500c366f28 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:31.828642 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-bcee58ff-0bad-4002-b4f0-08500c366f28 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 04 17:40:31.836452 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:31 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:32.391781 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-2b381bf8-c845-4818-b9f7-96fb42dad511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:32.417013 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-2b381bf8-c845-4818-b9f7-96fb42dad511 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.580845 Oct 04 17:40:32.417575 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:40:32.435801 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-2c8f4682-f96b-4fff-8075-2b4c0f750501 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:32.466792 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-2c8f4682-f96b-4fff-8075-2b4c0f750501 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037005 Oct 04 17:40:32.477859 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 17:40:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:35.174793 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-2b381bf8-c845-4818-b9f7-96fb42dad511 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:35.176168 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-2b381bf8-c845-4818-b9f7-96fb42dad511 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001767 Oct 04 17:40:35.176644 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:35.638307 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-458684c6-0f34-485c-9e61-ea110a048033 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "vcpus": 2, "id": "d3", "os-flavor-access:is_public": true, "disk": 10, "ram": 2048, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:35.667584 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-458684c6-0f34-485c-9e61-ea110a048033 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483248 Oct 04 17:40:35.668828 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:35.685734 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-a6ed1aa6-4bf5-4b99-a349-64a710aee5eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:35.745949 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-a6ed1aa6-4bf5-4b99-a349-64a710aee5eb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063136 Oct 04 17:40:35.746812 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 17:40:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:38.540622 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-458684c6-0f34-485c-9e61-ea110a048033 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:38.542449 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-458684c6-0f34-485c-9e61-ea110a048033 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Oct 04 17:40:38.546150 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:38 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:38.979928 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:39.007517 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.457942 Oct 04 17:40:39.018224 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:39.022024 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b6fa4d35-ad18-4b67-9f2a-a8e998ab5923 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:39.053291 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b6fa4d35-ad18-4b67-9f2a-a8e998ab5923 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034859 Oct 04 17:40:39.068231 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Tue Oct 4 17:40:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:41.740857 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:41.741935 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 04 17:40:41.742509 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:42.248424 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-64666707-c16f-4091-bcf2-e226aaffa0e0 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:42.285119 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-64666707-c16f-4091-bcf2-e226aaffa0e0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.536253 Oct 04 17:40:42.285913 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 17:40:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:40:44.919235 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:44.920208 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-0fcfbad6-b04e-4e76-a9f3-322324dfefdf admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 04 17:40:44.920753 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:45.377121 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-d737569e-a2b9-4fed-96ea-54573f8cfe63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.tiny", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 1, "id": "1"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:45.397220 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-d737569e-a2b9-4fed-96ea-54573f8cfe63 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.467680 Oct 04 17:40:45.397873 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:45.411551 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-30f08cd9-6c90-4663-9f6b-c15ebde1639e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:45.440837 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-30f08cd9-6c90-4663-9f6b-c15ebde1639e admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033395 Oct 04 17:40:45.441444 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 17:40:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:48.279266 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-d737569e-a2b9-4fed-96ea-54573f8cfe63 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:48.280332 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-d737569e-a2b9-4fed-96ea-54573f8cfe63 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001656 Oct 04 17:40:48.280741 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:48.684176 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-708bd9a9-c34c-4c94-b273-0044bd54eb8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:48.703831 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-708bd9a9-c34c-4c94-b273-0044bd54eb8f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416391 Oct 04 17:40:48.704430 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:48.716818 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-07a33e1f-046d-4aac-a077-9a580fcd52f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:48.747294 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-07a33e1f-046d-4aac-a077-9a580fcd52f4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034126 Oct 04 17:40:48.748256 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 17:40:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:40:51.385342 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-708bd9a9-c34c-4c94-b273-0044bd54eb8f admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:51.386434 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-708bd9a9-c34c-4c94-b273-0044bd54eb8f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Oct 04 17:40:51.386854 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:51.820634 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-8b3812d0-26c0-446b-b7f7-c92ac5f973e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:51.839422 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-8b3812d0-26c0-446b-b7f7-c92ac5f973e0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.444894 Oct 04 17:40:51.839973 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:40:51.853782 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-5d08c684-9b98-4ea6-9973-66f2f03b07f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:51.860562 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:51.884255 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-5d08c684-9b98-4ea6-9973-66f2f03b07f2 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035087 Oct 04 17:40:51.884940 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 17:40:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:54.592732 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-8b3812d0-26c0-446b-b7f7-c92ac5f973e0 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:54.593766 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-8b3812d0-26c0-446b-b7f7-c92ac5f973e0 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Oct 04 17:40:54.598416 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:54 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:40:55.044965 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-6af4a92e-d5d0-4d0d-bd03-365124de1c25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "disk": 80, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "id": "4", "rxtx_factor": 1.0}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:55.065858 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-6af4a92e-d5d0-4d0d-bd03-365124de1c25 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460904 Oct 04 17:40:55.066639 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:40:55.082476 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-bb646f83-dadf-479b-85b2-54918b9d66a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:55.112464 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-bb646f83-dadf-479b-85b2-54918b9d66a0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037717 Oct 04 17:40:55.113650 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 17:40:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:40:57.736021 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-6af4a92e-d5d0-4d0d-bd03-365124de1c25 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:40:57.737236 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-6af4a92e-d5d0-4d0d-bd03-365124de1c25 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Oct 04 17:40:57.737665 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:40:58.189777 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:58.195539 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:40:58.210698 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.466684 Oct 04 17:40:58.211258 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Tue Oct 4 17:40:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:40:58.224274 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-6e85f940-138b-44f4-b76c-b3284091404a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:40:58.251982 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-6e85f940-138b-44f4-b76c-b3284091404a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031473 Oct 04 17:40:58.252685 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Tue Oct 4 17:40:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:41:19.939954 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:19.940921 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 04 17:41:19.941329 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:19.952004 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:41:20.349278 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-7a61f1e6-8c34-4e4d-b4d3-9ad4ab347da1 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:20.368531 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-7a61f1e6-8c34-4e4d-b4d3-9ad4ab347da1 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.420882 Oct 04 17:41:20.369085 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 17:41:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:21.713882 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:21.714894 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-56a3d20d-d5fd-4acb-8816-40b1694ac07d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 04 17:41:21.715301 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:22.249897 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-e369a54b-39cc-40df-a4f5-016d8e91dc7e admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:22.255372 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.wsgi [None req-e369a54b-39cc-40df-a4f5-016d8e91dc7e admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-e369a54b-39cc-40df-a4f5-016d8e91dc7e admin admin] Request method failure captured: Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Accept: application/json Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Accept-Encoding: gzip, deflate Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Connection: keep-alive Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Content-Length: 0 Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Host: 10.222.0.42 Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: Openstack-System-Scope: None Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: User-Agent: python-novaclient Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Auth-Token: gAAAAABjPHBBHlCHb1yyICnPMVm_GM6sUVd9MlnLdhioJtlp8n0f6w98DUBEqEg4uqSbrT_4X19jrQ-jGmiQlep8BHJcUmfxlu-HiQAs0_8UCiHoeTTaQt3Djb1MbkHtHkgi7E7pm7pukxmJTydmy9kMaSJoXlYyRn-l7g-dKsQstqQyCIa8Mhk Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Id: None Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Name: None Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Identity-Status: Confirmed Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Is-Admin-Project: True Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Id: default Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Name: Default Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Name: admin Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Role: member,reader,admin Oct 04 17:41:22.258587 n-d-831194-21 devstack@n-api.service[112942]: X-Roles: member,reader,admin Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant: admin Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Name: admin Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-User: admin Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Id: default Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Name: Default Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: X-User-Name: admin Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: method: > Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: exception: Flavor 42 could not be found. Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: action_args: {'id': '42'} Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:22.260130 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:22.261143 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.263297 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-e369a54b-39cc-40df-a4f5-016d8e91dc7e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:22.264990 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-e369a54b-39cc-40df-a4f5-016d8e91dc7e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.394490 Oct 04 17:41:22.264990 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:41:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:41:22.271306 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-28081c03-1c9a-4acf-b7dd-cad35412a351 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:22.294829 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-28081c03-1c9a-4acf-b7dd-cad35412a351 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027708 Oct 04 17:41:22.295373 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:22.309469 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-912b4c41-678a-4663-a7d7-ba1292ed415c admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:22.331990 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-912b4c41-678a-4663-a7d7-ba1292ed415c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026943 Oct 04 17:41:22.332543 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:22.341814 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-273ad933-6816-48f6-8ce4-2aa1fe4bbcf9 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:22.347977 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.wsgi [None req-273ad933-6816-48f6-8ce4-2aa1fe4bbcf9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-273ad933-6816-48f6-8ce4-2aa1fe4bbcf9 admin admin] Request method failure captured: Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Accept: application/json Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Accept-Encoding: gzip, deflate Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Connection: keep-alive Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Content-Length: 0 Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Host: 10.222.0.42 Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: Openstack-System-Scope: None Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: User-Agent: python-novaclient Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Auth-Token: gAAAAABjPHBBHlCHb1yyICnPMVm_GM6sUVd9MlnLdhioJtlp8n0f6w98DUBEqEg4uqSbrT_4X19jrQ-jGmiQlep8BHJcUmfxlu-HiQAs0_8UCiHoeTTaQt3Djb1MbkHtHkgi7E7pm7pukxmJTydmy9kMaSJoXlYyRn-l7g-dKsQstqQyCIa8Mhk Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Id: None Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Name: None Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Identity-Status: Confirmed Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Is-Admin-Project: True Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Id: default Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Name: Default Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Name: admin Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Role: member,reader,admin Oct 04 17:41:22.351215 n-d-831194-21 devstack@n-api.service[112941]: X-Roles: member,reader,admin Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant: admin Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Name: admin Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-User: admin Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Id: default Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Name: Default Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: X-User-Name: admin Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: method: > Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: exception: Flavor 42 could not be found. Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: action_args: {'id': '42'} Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:22.352816 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:22.354034 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:22.355362 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-273ad933-6816-48f6-8ce4-2aa1fe4bbcf9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:22.356624 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-273ad933-6816-48f6-8ce4-2aa1fe4bbcf9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014354 Oct 04 17:41:22.356624 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:41:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:41:23.570978 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-912b4c41-678a-4663-a7d7-ba1292ed415c admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:23.571990 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-912b4c41-678a-4663-a7d7-ba1292ed415c admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 04 17:41:23.572417 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:24.086659 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b53eb2ca-420b-47ee-864b-fee93f7438d5 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:24.091823 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.wsgi [None req-b53eb2ca-420b-47ee-864b-fee93f7438d5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b53eb2ca-420b-47ee-864b-fee93f7438d5 admin admin] Request method failure captured: Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Accept: application/json Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Accept-Encoding: gzip, deflate Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Connection: keep-alive Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Content-Length: 0 Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Host: 10.222.0.42 Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: Openstack-System-Scope: None Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: User-Agent: python-novaclient Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Auth-Token: gAAAAABjPHBDQjM_P98dNU-WnmtzNTltqftcRD6hP44odzSwy1vbC1CY7mBv95pDqB8hIkIyZ4Xh6MCdhc6mEMXBVZX6fZ6s6iUxufY8xmocivpiCFqDcAsQziWIk_TxdbBDg1o6-Lnux1jTZW3x0vvbAR3hjWgFWfPkJCI-_4LLrdSHrRM09MY Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Id: None Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Name: None Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Identity-Status: Confirmed Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Is-Admin-Project: True Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Id: default Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Name: Default Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Name: admin Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Role: member,reader,admin Oct 04 17:41:24.093340 n-d-831194-21 devstack@n-api.service[112941]: X-Roles: member,reader,admin Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant: admin Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Name: admin Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-User: admin Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Id: default Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Name: Default Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: X-User-Name: admin Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: method: > Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: exception: Flavor 84 could not be found. Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: action_args: {'id': '84'} Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:24.095769 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:24.096746 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.098068 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b53eb2ca-420b-47ee-864b-fee93f7438d5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:24.099339 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b53eb2ca-420b-47ee-864b-fee93f7438d5 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388229 Oct 04 17:41:24.099339 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:41:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:41:24.105548 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-a05d681b-0156-4d62-8f27-0fa49f1bd4e6 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:24.121951 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-a05d681b-0156-4d62-8f27-0fa49f1bd4e6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019719 Oct 04 17:41:24.122523 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:24.132199 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b12dab9e-13ed-481b-8a76-febb40c6b57f admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:24.147580 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b12dab9e-13ed-481b-8a76-febb40c6b57f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019033 Oct 04 17:41:24.148095 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:24.158237 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-017d3278-bedb-4b7a-ba65-d6d1c54dcb5e admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:24.163337 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.wsgi [None req-017d3278-bedb-4b7a-ba65-d6d1c54dcb5e admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-017d3278-bedb-4b7a-ba65-d6d1c54dcb5e admin admin] Request method failure captured: Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Accept: application/json Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Accept-Encoding: gzip, deflate Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Connection: keep-alive Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Content-Length: 0 Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Host: 10.222.0.42 Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: Openstack-System-Scope: None Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: User-Agent: python-novaclient Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Auth-Token: gAAAAABjPHBDQjM_P98dNU-WnmtzNTltqftcRD6hP44odzSwy1vbC1CY7mBv95pDqB8hIkIyZ4Xh6MCdhc6mEMXBVZX6fZ6s6iUxufY8xmocivpiCFqDcAsQziWIk_TxdbBDg1o6-Lnux1jTZW3x0vvbAR3hjWgFWfPkJCI-_4LLrdSHrRM09MY Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Id: None Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Name: None Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Identity-Status: Confirmed Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Is-Admin-Project: True Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Id: default Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Name: Default Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Name: admin Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Role: member,reader,admin Oct 04 17:41:24.164843 n-d-831194-21 devstack@n-api.service[112942]: X-Roles: member,reader,admin Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant: admin Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Name: admin Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-User: admin Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Id: default Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Name: Default Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: X-User-Name: admin Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: method: > Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: exception: Flavor 84 could not be found. Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: action_args: {'id': '84'} Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:24.166395 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:24.167352 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:24.168639 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-017d3278-bedb-4b7a-ba65-d6d1c54dcb5e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:24.169887 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-017d3278-bedb-4b7a-ba65-d6d1c54dcb5e admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012540 Oct 04 17:41:24.169887 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:41:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:41:25.381628 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b12dab9e-13ed-481b-8a76-febb40c6b57f admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:25.382676 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b12dab9e-13ed-481b-8a76-febb40c6b57f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 04 17:41:25.383080 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:25.919686 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-bb5b9e05-e88c-4ac4-a332-d1a6ee144a10 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:25.925786 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.wsgi [None req-bb5b9e05-e88c-4ac4-a332-d1a6ee144a10 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-bb5b9e05-e88c-4ac4-a332-d1a6ee144a10 admin admin] Request method failure captured: Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Accept: application/json Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Accept-Encoding: gzip, deflate Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Connection: keep-alive Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Content-Length: 0 Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Host: 10.222.0.42 Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: Openstack-System-Scope: None Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: User-Agent: python-novaclient Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Auth-Token: gAAAAABjPHBFagWkpA9otbOrRAtPWPsAVYBP6TsECiLzZLXf0hlJeYYhIdZwhQZiX7BORocZSTryFin2irz3wTN8EULtH2F0PFCMY-dHWECHAgVFt9wKroAhyix38To1Fy_Y4YEcA5-tk96zYD-XsLf7SQqoEieKN0atzrUXMt7rTQoUxUSM7UQ Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Id: None Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Domain-Name: None Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Identity-Status: Confirmed Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Is-Admin-Project: True Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Id: default Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Domain-Name: Default Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Project-Name: admin Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Role: member,reader,admin Oct 04 17:41:25.927309 n-d-831194-21 devstack@n-api.service[112942]: X-Roles: member,reader,admin Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant: admin Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-Tenant-Name: admin Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-User: admin Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Id: default Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-User-Domain-Name: Default Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: X-User-Name: admin Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: method: > Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: exception: Flavor 451 could not be found. Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: action_args: {'id': '451'} Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:25.928713 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:25.929487 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: ERROR nova.api.openstack.wsgi Oct 04 17:41:25.930557 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-bb5b9e05-e88c-4ac4-a332-d1a6ee144a10 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112942) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:25.931569 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-bb5b9e05-e88c-4ac4-a332-d1a6ee144a10 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.408292 Oct 04 17:41:25.931569 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:41:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 409 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:41:25.941370 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-60f58a76-879d-4495-b17b-4e9a426ab3b3 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:25.956721 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-60f58a76-879d-4495-b17b-4e9a426ab3b3 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018944 Oct 04 17:41:25.957260 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:25.966674 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:25.982202 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019001 Oct 04 17:41:25.982729 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Tue Oct 4 17:41:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:41:25.992089 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b44720e5-6e51-400f-8a6e-d8352abc326c admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:25.997422 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.wsgi [None req-b44720e5-6e51-400f-8a6e-d8352abc326c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b44720e5-6e51-400f-8a6e-d8352abc326c admin admin] Request method failure captured: Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Accept: application/json Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Accept-Encoding: gzip, deflate Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Connection: keep-alive Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Content-Length: 0 Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Host: 10.222.0.42 Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Openstack-Api-Version: compute 2.92 Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: Openstack-System-Scope: None Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: User-Agent: python-novaclient Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Auth-Token: gAAAAABjPHBFagWkpA9otbOrRAtPWPsAVYBP6TsECiLzZLXf0hlJeYYhIdZwhQZiX7BORocZSTryFin2irz3wTN8EULtH2F0PFCMY-dHWECHAgVFt9wKroAhyix38To1Fy_Y4YEcA5-tk96zYD-XsLf7SQqoEieKN0atzrUXMt7rTQoUxUSM7UQ Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Id: None Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Domain-Name: None Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Identity-Status: Confirmed Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Is-Admin-Project: True Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Openstack-Nova-Api-Version: 2.92 Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Id: default Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Domain-Name: Default Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Project-Name: admin Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Role: member,reader,admin Oct 04 17:41:25.998955 n-d-831194-21 devstack@n-api.service[112941]: X-Roles: member,reader,admin Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b37dd9dc7aa94d4fa86a2ff47484415d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant: admin Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Id: b37dd9dc7aa94d4fa86a2ff47484415d Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-Tenant-Name: admin Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-User: admin Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Id: default Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-User-Domain-Name: Default Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-User-Id: 78af6d153f4a48049abb05fe72baf28b Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: X-User-Name: admin Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: method: > Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: exception: Flavor 451 could not be found. Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: action_args: {'id': '451'} Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:41:26.000505 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:26.001514 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: ERROR nova.api.openstack.wsgi Oct 04 17:41:26.002872 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b44720e5-6e51-400f-8a6e-d8352abc326c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112941) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:41:26.004133 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b44720e5-6e51-400f-8a6e-d8352abc326c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011780 Oct 04 17:41:26.004133 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:41:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:41:27.218544 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:27.220116 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002033 Oct 04 17:41:27.220518 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:27.755897 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-07985969-2034-40ed-a8ef-26a9c92c78e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:41:27.775384 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-07985969-2034-40ed-a8ef-26a9c92c78e3 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.416871 Oct 04 17:41:27.775934 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 17:41:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:41:28.975910 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:28.976915 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Oct 04 17:41:28.977306 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:29.506259 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-02d19665-20b2-4593-b333-27a509bf2886 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:41:29.524962 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-02d19665-20b2-4593-b333-27a509bf2886 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.407080 Oct 04 17:41:29.526008 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 17:41:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:41:30.756081 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:30.757085 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Oct 04 17:41:30.757486 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:31.291601 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-7e461eae-9138-4a98-a98f-38aaf8aa4d79 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:41:31.310642 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-7e461eae-9138-4a98-a98f-38aaf8aa4d79 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.412176 Oct 04 17:41:31.311252 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 17:41:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:41:32.542069 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:32.543107 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 04 17:41:32.543520 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:33.068552 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-cc813941-6388-4edc-9005-bba1bb92e630 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:41:33.088319 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-cc813941-6388-4edc-9005-bba1bb92e630 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.405470 Oct 04 17:41:33.088872 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Tue Oct 4 17:41:32 2022] POST /compute/v2.1/flavors => generated 409 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:41:34.315485 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:34.316493 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Oct 04 17:41:34.316890 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:41:34.839657 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-409f5f69-825b-4eb5-a316-630f17c44cc9 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:41:34.860257 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-409f5f69-825b-4eb5-a316-630f17c44cc9 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401593 Oct 04 17:41:34.860793 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Oct 4 17:41:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:42:32.336135 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.337147 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-4a13ad80-c3bc-4984-8278-1ed12cbd6655 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 04 17:42:32.337544 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:42:32.348421 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:42:32.733430 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-158bcf42-67c4-427f-ba97-6b1937f2d23f admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.756015 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-158bcf42-67c4-427f-ba97-6b1937f2d23f admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.412585 Oct 04 17:42:32.756561 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:42:32.777627 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_api:SELECT=14 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:42:32.781637 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-d296d111-9431-46ae-896c-23d564468201 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.789170 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-d296d111-9431-46ae-896c-23d564468201 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012925 Oct 04 17:42:32.789699 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:42:32.802135 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-e7551cf9-c74a-4720-8a2e-0e36fc44a28a admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.809478 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-e7551cf9-c74a-4720-8a2e-0e36fc44a28a admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011060 Oct 04 17:42:32.810035 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:42:32.822260 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.830040 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011206 Oct 04 17:42:32.830564 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:42:32.841654 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-b6a52afb-d163-41f1-9456-b252b4a04d59 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:42:32.848832 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-b6a52afb-d163-41f1-9456-b252b4a04d59 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010672 Oct 04 17:42:32.849343 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Tue Oct 4 17:42:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:47:49.110160 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:47:49.111247 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 04 17:47:49.111652 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:47:49.251855 n-d-831194-21 devstack@n-api.service[112941]: DEBUG dbcounter [-] [112941] Writing DB stats nova_api:SELECT=6 {{(pid=112941) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:47:49.398826 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:47:49.403631 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:49.404114 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:49.404545 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:49.405269 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:49.405722 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:49.406173 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:49.445456 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-ac981ac8-1329-4467-8341-75f37b379877 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.194846 Oct 04 17:47:49.446051 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:47:49 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:47:50.531321 n-d-831194-21 devstack@n-api.service[112942]: DEBUG nova.api.openstack.wsgi [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] Calling method '>' {{(pid=112942) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:47:50.532326 n-d-831194-21 devstack@n-api.service[112942]: INFO nova.api.openstack.requestlog [None req-ad6e35fd-ab5b-4839-aec7-568dd3a61095 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 04 17:47:50.532723 n-d-831194-21 devstack@n-api.service[112942]: [pid: 112942|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Tue Oct 4 17:47:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:47:50.727377 n-d-831194-21 devstack@n-api.service[112941]: DEBUG nova.api.openstack.wsgi [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Calling method '>' {{(pid=112941) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:47:50.730892 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:50.731367 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:50.731793 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:50.732499 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:47:50.732943 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:47:50.733353 n-d-831194-21 devstack@n-api.service[112941]: DEBUG oslo_concurrency.lockutils [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112941) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:47:50.756799 n-d-831194-21 devstack@n-api.service[112941]: INFO nova.api.openstack.requestlog [None req-d08732fb-7bae-478d-baa5-c229827e872c admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.082731 Oct 04 17:47:50.757375 n-d-831194-21 devstack@n-api.service[112941]: [pid: 112941|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:47:50 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:48:38.369446 n-d-831194-21 devstack@n-api.service[112940]: Tue Oct 4 17:48:38 2022 - graceful shutdown triggered... Oct 04 17:48:38.370011 n-d-831194-21 devstack@n-api.service[112941]: Gracefully killing worker 1 (pid: 112941)... Oct 04 17:48:38.370380 n-d-831194-21 devstack@n-api.service[112942]: Gracefully killing worker 2 (pid: 112942)... Oct 04 17:48:38.371321 n-d-831194-21 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 04 17:48:38.496243 n-d-831194-21 devstack@n-api.service[112942]: DEBUG dbcounter [-] [112942] Writing DB stats nova_api:SELECT=4 {{(pid=112942) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:48:39.370466 n-d-831194-21 devstack@n-api.service[112940]: worker 1 buried after 1 seconds Oct 04 17:48:39.370466 n-d-831194-21 devstack@n-api.service[112940]: worker 2 buried after 1 seconds Oct 04 17:48:39.371122 n-d-831194-21 devstack@n-api.service[112940]: goodbye to uWSGI. Oct 04 17:48:39.372147 n-d-831194-21 systemd[1]: devstack@n-api.service: Succeeded. Oct 04 17:48:39.372753 n-d-831194-21 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 04 17:48:39.375936 n-d-831194-21 systemd[1]: Starting Devstack devstack@n-api.service... Oct 04 17:48:39.390640 n-d-831194-21 devstack@n-api.service[128831]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 17:48:39 2022] *** Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: nodename: n-d-831194-21 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: machine: x86_64 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: clock source: unix Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: pcre jit disabled Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: detected number of CPU cores: 4 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: current working directory: / Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: detected binary path: /usr/bin/uwsgi-core Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: your processes number limit is 47680 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: your memory page size is 4096 bytes Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: detected max file descriptor number: 2048 Oct 04 17:48:39.412154 n-d-831194-21 devstack@n-api.service[128831]: lock engine: pthread robust mutexes Oct 04 17:48:39.413270 n-d-831194-21 devstack@n-api.service[128831]: thunder lock: enabled Oct 04 17:48:39.413270 n-d-831194-21 devstack@n-api.service[128831]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 04 17:48:39.413270 n-d-831194-21 devstack@n-api.service[128831]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 17:48:39.453028 n-d-831194-21 devstack@n-api.service[128831]: Python main interpreter initialized at 0x55db3287c9c0 Oct 04 17:48:39.453028 n-d-831194-21 devstack@n-api.service[128831]: python threads support enabled Oct 04 17:48:39.453028 n-d-831194-21 devstack@n-api.service[128831]: your server socket listen backlog is limited to 100 connections Oct 04 17:48:39.453028 n-d-831194-21 devstack@n-api.service[128831]: your mercy for graceful operations on workers is 90 seconds Oct 04 17:48:39.453494 n-d-831194-21 devstack@n-api.service[128831]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 17:48:39.453494 n-d-831194-21 devstack@n-api.service[128831]: *** Operational MODE: preforking *** Oct 04 17:48:39.453732 n-d-831194-21 devstack@n-api.service[128831]: *** uWSGI is running in multiple interpreter mode *** Oct 04 17:48:39.453732 n-d-831194-21 devstack@n-api.service[128831]: spawned uWSGI master process (pid: 128831) Oct 04 17:48:39.453963 n-d-831194-21 systemd[1]: Started Devstack devstack@n-api.service. Oct 04 17:48:39.456230 n-d-831194-21 devstack@n-api.service[128831]: spawned uWSGI worker 1 (pid: 128849, cores: 1) Oct 04 17:48:39.456230 n-d-831194-21 devstack@n-api.service[128831]: spawned uWSGI worker 2 (pid: 128850, cores: 1) Oct 04 17:48:39.456230 n-d-831194-21 devstack@n-api.service[128831]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 17:48:40.117296 n-d-831194-21 devstack@n-api.service[128850]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:48:40.126332 n-d-831194-21 devstack@n-api.service[128849]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 04 17:48:41.326407 n-d-831194-21 devstack@n-api.service[128850]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:48:41.326407 n-d-831194-21 devstack@n-api.service[128850]: from cryptography.utils import int_from_bytes Oct 04 17:48:41.327047 n-d-831194-21 devstack@n-api.service[128850]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:48:41.327047 n-d-831194-21 devstack@n-api.service[128850]: from cryptography.utils import int_from_bytes Oct 04 17:48:41.338834 n-d-831194-21 devstack@n-api.service[128849]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:48:41.338834 n-d-831194-21 devstack@n-api.service[128849]: from cryptography.utils import int_from_bytes Oct 04 17:48:41.339354 n-d-831194-21 devstack@n-api.service[128849]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 17:48:41.339354 n-d-831194-21 devstack@n-api.service[128849]: from cryptography.utils import int_from_bytes Oct 04 17:48:43.850100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:48:43.850748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:48:43.850748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:48:43.851155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:48:43.851389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:48:43.851779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.852105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.852427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.852881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.853216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.853531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.853876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.854209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.854538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.854801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.855119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.855446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831194-21 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.855772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.856083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.856395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.856717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.857022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.857349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.857682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.858191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.858861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.859181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.859496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.859844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.860169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.860469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.860785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.861659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.862042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.862417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.862826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831194-21 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.863150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.863469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.863788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.864205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.864515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.864827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.865154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.865477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.865787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.866139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.866461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.866782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.867104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.867414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.867729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.868043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.868366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.868686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.868983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.869241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.869552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.869900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.870229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.870558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.870810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.871062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.871383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.871708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.872017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.872328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.872638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.872947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.873254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.873563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.874155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.874468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.874788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.875107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.875432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.875741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.876062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.876465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.876813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.877128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.878014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.878338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.878651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.878974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.879305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.879616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.879927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.880237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.880560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.880895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.881205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.881460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.881765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.882098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.882423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.882731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.883041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.883350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.883653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.883961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.884268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.884579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.884885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.885194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.885501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.885810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.886142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.886449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.886755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.887076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.887400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.887708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.888026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.888329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.888637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.888961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.889273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.889581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.889926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.890238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.890577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.890858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.891172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.891482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.891803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.892124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.892445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.892767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.893074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.893383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.893690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.894027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.894335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.894648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.894954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.895259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.895562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.895881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.896204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.896516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.896823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.897131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.897453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:43.897793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.898153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.898504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.898820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.899164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.899499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.899820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.900136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.900453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.900781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.901096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.901415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.901729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.902074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.902396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.902727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.903047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.903365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.903687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.904005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.904325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.904658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.904981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.905295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.905640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.906086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.906333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.906659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.906985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.907301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.907614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.907983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.908336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.908632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.908957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.909280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.909593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.909947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.910267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.910582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.910895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.911210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.911523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.911862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.912180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.912508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.912827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.913140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.913460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.913774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.914111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.914421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.914728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.915033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.915339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.915651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.915960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.916282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.916609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.916920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.917256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.917563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.917897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.918212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.918526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.918833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.919149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.919461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.919769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.920097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.920408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.920714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.921036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.921343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.921717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.921989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.922305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.922624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.923053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.924022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.924484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.924851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.925180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.925525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.925981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.926350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.926736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.927072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.927399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.927712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.928031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.928359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.928678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.928990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.929305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.929618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.929954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.930267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.930574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.930881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.931209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.931522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.931828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.932134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.932442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.932789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.933100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.933447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.933789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.934135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.934463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.934778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.935096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.935412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.935725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.936037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.936351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.936671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.936983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.937302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.937615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.937961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.938276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.938597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.938909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.939788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.940136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.940473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.940790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.941115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.941428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.941746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.942084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.942399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.942713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.943025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.943348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.943662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.943983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.944297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.944626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.944941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.945265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.945574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.945912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.946245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.946581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.946895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.947212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.947538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.947853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.948166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.948481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.948803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.949102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.949422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.949738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.950076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.950392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.950701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.951019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.951331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.951639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.951944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.952259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.952584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.952898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.953221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.953547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.953874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.954184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.954512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.954857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.955165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.955679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.955996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.956349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.956666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.956979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.957302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.957630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.957969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.958295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.958615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.958933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.959261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.959580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.959899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.960217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.960532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.960848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.961165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.961494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.961810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.962146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.962463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.962774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.963089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.963413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.964005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.964340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.964661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.964982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.965330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.965652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.966021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.966356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.966672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.966984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.967301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.967609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.967987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.968236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.968545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.968854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.969162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.969477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.969783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.970119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.970513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.970993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.971387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.971761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.972085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.972399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.972742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.973061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.973373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.973685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.974023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.974380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.974837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.975043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.975381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.975731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.976041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.976350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.976680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.976988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.977299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.977607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.977966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.978282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.978589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.978903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.979221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.979640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.979847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.980159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.980472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.980778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.981099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.981412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.981717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.982048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.982364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.982676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.982982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.983296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.983601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.983919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.984225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.984531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.984836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.985173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.985444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.985751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.986775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.987086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.987395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.987763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.988082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.988389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.988697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.992787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.993193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.994502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.994882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.995240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.995694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.996209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.996209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.996546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.996865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.997186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.997506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.997837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.998170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.998517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.999098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.999555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:43.999741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.000025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.000388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.000706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.001079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.001476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.002372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.002922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.003431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.003759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.004088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.004404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.004736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.005063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.005390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.005706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.006046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.006386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.006710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.007217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.007351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.007748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.008016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.008330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.008651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.008972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.009293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.009614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.010145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.010398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.010631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.010992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.011228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.011529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.011995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.012233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.012460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.012737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.013066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.013383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.013698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.014043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.014358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.017468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.017468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.018475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.018819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.019155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.020115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.020466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.020801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.021203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.021546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.021922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.022977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.023321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.023658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.023989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.024315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.024636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.024965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.025309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.025625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.025967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.026285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.026620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.026951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.027273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.027719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.028044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.028359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.028788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.029119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.029440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.029777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.030137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.030475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.030790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.031116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.031540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.031998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.032210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.033322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.034181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.034181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.034474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.034713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.034994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.036041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.036041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.036041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.036643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.036809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.037062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.037381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.037630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.037987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.038304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.038620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.039074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.039273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.039581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.039909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.040243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.040607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.040881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.041145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.041460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.041796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.042148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.042481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.042813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.043126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.043459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.043777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.044088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.044400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.044712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.045063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.045375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.045703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.046064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.046400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.046716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.047058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.047387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.047714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.048031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.048892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.049243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.049557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.049898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.050220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.050535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.050950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.051153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.051467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.051776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.052086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.052374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.052708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.053020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.053348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.053663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.053999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.054313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.054626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.054980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.055290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.055626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.055964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.056293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.056618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.056935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.057257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.057577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.057920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.058242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.058561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.058873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.059191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.059515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.059861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.060432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.060764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.061080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.061397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.061714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.062134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.062456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.062769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.063086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.063398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.063710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.064101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.064428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.064757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.065605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.066121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.066278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.066579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.066897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.067261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.067579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.067891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.068209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.068531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.068680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 17:48:44.069188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.069382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 17:48:44.069546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.069546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.069733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 17:48:44.069855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.070081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 17:48:44.070362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 17:48:44.070535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.070814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.070983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.071162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.071424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.071588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.071749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.071907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.072063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.072236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.072401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.072656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.072858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.073002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.073146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.073452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.073575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.073779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.073939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.074077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.074216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.074216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.074479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.074479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.074771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-831194-21 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.074771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.075244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.075385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.075541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.075697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.075697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.076114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.076248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.076379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.076499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.076631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.076763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.076886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.077047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.077205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.077336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.077459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.077581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.077735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.077898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.078079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.078231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.078381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.078531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.078708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.078833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.079030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.079177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.079340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.079744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.079962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.080138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.080330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.080576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.080576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-831194-21 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.081077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.081217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.081402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.081617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.081762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.081955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.081955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.082241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.082241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.082766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.082924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.083074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.083218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.083369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.083512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.083647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.083787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.083942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.083942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.084237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.084373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.084516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.084658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.084806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.084953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.085106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.085241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.085396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.085534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.085689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.085868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.086029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.086184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.086328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.086464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.086611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.086747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.086888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.086888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.087159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.087304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.087455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.087600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.087735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.087877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.088020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.088155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.088317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.088461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.088618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.088768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.088907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.089067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.089211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.089354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.089507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.089749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.090018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.090179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.090326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.090469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.090698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.090862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.091004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.091244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.091385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.091520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.091914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.092075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.092227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.092375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.092512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.092727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.092945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.093092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.093250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.093405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.093549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.093694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.093858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.094011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.094170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.094315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.094469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.094606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.094753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.094891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.095046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.095198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.095544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.095969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.096106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.096250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.096250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.096524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.096659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.096799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.096933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.097076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.097219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.097353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.097486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.097627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.097761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.097925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.098081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.098228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.098370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.098504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.098637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.098815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.098961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.099105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.099238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.099372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.099516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.099650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.099865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.100017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.100278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.100414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.100546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.100689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.100877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.100998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.101124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.101262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.101465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.101586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.101700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.101821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.102096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.102269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.102401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.102526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.102650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.102765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.102880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.103100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.103232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.103232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.103447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.103561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.103682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.103832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.103982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.104135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.104272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.104416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.104539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.104690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.104848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.104993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.105224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.105364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.105498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.105639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.105780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.105953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.106106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.106265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.106414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.106548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.106702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.106867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.107012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.107165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.107300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.107435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.107568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.107746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.107987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.108151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.108296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.108452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.108612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.108766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.108922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.109067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.109201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.109352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.109503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.109643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.109810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.109989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.110133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.110281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.110584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.110746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.112129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.112381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.112381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.112843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.113166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.113336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.113336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.113629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.113795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.113967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.114154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.114321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.114550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.114718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.114882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.115048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.115211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.115373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.115534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.115688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.115841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.116022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 17:48:44.116199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.116355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.116508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.116670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.116824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.117896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.118912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.119998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.120198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.120321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.120471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.120739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.120894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.121039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.121212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.121340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.121485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.121641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.122952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.123087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.123235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.123439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.123588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.123738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.124968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.125795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.126069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.126221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.126412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.126412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.127837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.127988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.128992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.129265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.129408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.129634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.129634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.130986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.131134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.131281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.131454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.131609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.131746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.132942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.133821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.134899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.135819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.136876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.137877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128849) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.138739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.139773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.139773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.139773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.140164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.140164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.140474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.140791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.141133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.141473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.141785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.142198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.142898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.143072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.143269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.143586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.143897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.144211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.144521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.144836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.145147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.145458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.145770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.146106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.146416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.146743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.147055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.147367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.147672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.147984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.148333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.148645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.148993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.149335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.149658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.150014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.150333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.150656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.150971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.151288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.151606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.151921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.152288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.152555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.152880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.153199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.153525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.153866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.154185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.154498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.154820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.155167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.155505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.155824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.156151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.156912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.156912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.157204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.157383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.158255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.158636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.159145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.159263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.160178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.160178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.160178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.160533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.160787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.161100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.161426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.161760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.162131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.162520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.162749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.163159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.163398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.163713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.164036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.164341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.164652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.164968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.165288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.165605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.167063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.167331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.167668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.167995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.168321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.168626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.168967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.169306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.169625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.169984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.170322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.170636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.170950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.171283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.171602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.171917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.172230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.172584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.172895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.173269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.173695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.174269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.174423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.174606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.174934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.175258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.175577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.175909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.176233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.176552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.176870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.177191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.177512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.177868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.178183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.178501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.178819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.179137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.179450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.179769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.180094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.180682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.181019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.181340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.181687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.182051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.182375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.182717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.183049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.183379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.183674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.183991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.184303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.184608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.184923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.185234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.185544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.185922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.186245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.186555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.186865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.187176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.187488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.216389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.217200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.218816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.219838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.221233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222232 n-d-831194-21 devstack@n-api.service[128849]: INFO dbcounter [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Registered counter for database nova_api Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.222336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.223515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.224559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.225611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.226800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.227873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.229702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writer thread running {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.231810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.231969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.232168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.234218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.235213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.235213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.235381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.237938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.237938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.238769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.239246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.239603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.240055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.240303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.241122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.241122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.241290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.241639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.242302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.242422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.242682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.243042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.243361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.243672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.244065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.244461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.244768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.245110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.245425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.245760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.246126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.246450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.246767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.247092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.247410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.247728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.248063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.248378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.248701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.249280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.249601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.250122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.250265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.250590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.250906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.251242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.252092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.252494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.252820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.253160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.253499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.253821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.254281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.254604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.254901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.255258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.255573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.255904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.256244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.256586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.256906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.257248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.257584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.257953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.258279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.258609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.258943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.259260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.259573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.259895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.260213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.260525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.260837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.261155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.261466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.261777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.262116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.262453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.262767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.263101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.263420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.263735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.264048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.264362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.264717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.265030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.265366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.265686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.266056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.266384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.266706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.267032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.268150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.268487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.268965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.269141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.269475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.269800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.270149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.270552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.271040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.271377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.271700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.272025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.272348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.272670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.272993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.273312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.273632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.273975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.274320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.274708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.274949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.275277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.275777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.275958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.276281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.276604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.276928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.277296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.277618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.277964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.278290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.278616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.278940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.279261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.279580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.279903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.280225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.280546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.280864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.281190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.281515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.281873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.282243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.282553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.282957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.283251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.283578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.284112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.284429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.284818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.285106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.285437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.285913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.286114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.286543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.286855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.287168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.287485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.287801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.288114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.288448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.288767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.289082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.289408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.289724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.290301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.291011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.291011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.291304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.291639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.291968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.292388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.292685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.293065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.293222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.293543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.293885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.294207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.294445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.context [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128849) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:48:44.294686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.294953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.295234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.295446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.295764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.296081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.296407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.296720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.297036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.297348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.297668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.298006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.298347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.298624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.298766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.299030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.299165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.299354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.299669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.299988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.300303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.300624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.300987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.301306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.301621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.301980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.302296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.302608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.303098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.303244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.303585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.303906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.304254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.304480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.304728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.305211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.305672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.305897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.306037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.306409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.306409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.306670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.306863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.307224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.307545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.307874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.308192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.308513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.308833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.309019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.309176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.309468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.309772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.310118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.310435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.310754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.310958 n-d-831194-21 devstack@n-api.service[128849]: INFO dbcounter [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Registered counter for database nova_cell0 Oct 04 17:48:44.311096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.311375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.311690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.312005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.312321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.312637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.312966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.313321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.313737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.314608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.315089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.315438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.315765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.316086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.316477 n-d-831194-21 devstack@n-api.service[128849]: INFO dbcounter [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Registered counter for database nova_cell1 Oct 04 17:48:44.316625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.316764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.317020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.317359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.317681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.318098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.318540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.318860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.319310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.319506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.319944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.320230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.320506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.323583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.328619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.330306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.330306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.330306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.330306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.331370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.332722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.334448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.335174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writer thread running {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.335306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.335306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.335306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.335664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.335928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.336187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.336421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writer thread running {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.336558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.336687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.337056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.337455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.337658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.338009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.338339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.338662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.338979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.339318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.339636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.339955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.340275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.340592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.340907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.341232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.341548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.341890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.342214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.342536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.342870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.343201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.343526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.343871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.344162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.344523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.344835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.345708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.346361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.346689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.347010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.347403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 17:48:44.347633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128850) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 17:48:44.411461 n-d-831194-21 devstack@n-api.service[128850]: INFO dbcounter [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Registered counter for database nova_api Oct 04 17:48:44.432655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_db.sqlalchemy.engines [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.440627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writer thread running {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.493410 n-d-831194-21 devstack@n-api.service[128849]: INFO dbcounter [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Registered counter for database nova_cell0 Oct 04 17:48:44.500421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.context [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128850) load_cells /opt/stack/nova/nova/context.py:464}} Oct 04 17:48:44.501098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_db.sqlalchemy.engines [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128849) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.501810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.502161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.503706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.504472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:48:44.504983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:48:44.506258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writer thread running {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.506975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:48:44.509019 n-d-831194-21 devstack@n-api.service[128850]: INFO dbcounter [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Registered counter for database nova_cell0 Oct 04 17:48:44.513108 n-d-831194-21 devstack@n-api.service[128850]: INFO dbcounter [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Registered counter for database nova_cell1 Oct 04 17:48:44.522060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_db.sqlalchemy.engines [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.523816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_db.sqlalchemy.engines [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.528536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writer thread running {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.677006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writer thread running {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.685798 n-d-831194-21 devstack@n-api.service[128850]: INFO dbcounter [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Registered counter for database nova_cell0 Oct 04 17:48:44.693749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_db.sqlalchemy.engines [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128850) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 17:48:44.698239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writer thread running {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 17:48:44.831804 n-d-831194-21 devstack@n-api.service[128849]: WARNING keystonemiddleware.auth_token [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:48:44.839130 n-d-831194-21 devstack@n-api.service[128849]: WARNING keystonemiddleware.auth_token [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:48:45.062390 n-d-831194-21 devstack@n-api.service[128850]: WARNING keystonemiddleware.auth_token [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:48:45.070181 n-d-831194-21 devstack@n-api.service[128850]: WARNING keystonemiddleware.auth_token [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:48:45.181589 n-d-831194-21 devstack@n-api.service[128849]: WARNING keystonemiddleware.auth_token [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:48:45.187662 n-d-831194-21 devstack@n-api.service[128849]: WARNING keystonemiddleware.auth_token [None req-fb4cdd73-1268-49ec-978e-b4508ef13857 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:48:45.193118 n-d-831194-21 devstack@n-api.service[128849]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db3287c9c0 pid: 128849 (default app) Oct 04 17:48:45.411736 n-d-831194-21 devstack@n-api.service[128850]: WARNING keystonemiddleware.auth_token [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 04 17:48:45.417747 n-d-831194-21 devstack@n-api.service[128850]: WARNING keystonemiddleware.auth_token [None req-87e24b8c-47e2-4336-a31f-1fc4ba83cd11 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 04 17:48:45.422895 n-d-831194-21 devstack@n-api.service[128850]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55db3287c9c0 pid: 128850 (default app) Oct 04 17:49:24.870101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:24.871642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:24.872720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:24.873977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:26.015139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.017008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.017503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.017984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.018743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.019205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.019630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.060184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:26.061136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:26.061728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:26.062946 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d53ca3a-0118-436d-8d07-40427399d7b5 tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 1.198930 Oct 04 17:49:26.063070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:26.064129 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1/1] 10.222.0.42 () {58 vars in 1164 bytes} [Tue Oct 4 17:49:24 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:26.080696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.083103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.083843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.084679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.086218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.086680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.087114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.112239 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-874ed7a6-6c30-4ece-bdea-e8f5aa07a4cd tempest-AZAdminV2TestJSON-1742917361 tempest-AZAdminV2TestJSON-1742917361-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.039504 Oct 04 17:49:26.112848 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2/2] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:26.799658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf4509d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:26.806770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.807467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.808101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.809036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:26.809677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:26.810394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:26.842768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9403f75-6804-42f7-ab31-70c41083d984 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.506932 Oct 04 17:49:26.842768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3/3] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:27.296946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fcde9e4a-c016-4f03-abc7-c719c5f391f1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1452652214", "id": 1930313846, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:27.387169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.394512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.395205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.395817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.396702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.397311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.397902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.442743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fcde9e4a-c016-4f03-abc7-c719c5f391f1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.602004 Oct 04 17:49:27.457649 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4/4] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:26 2022] POST /compute/v2.1/flavors => generated 430 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:27.459285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a444c193-4b8c-4bee-9a90-cb42e81078a2 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 1.410848 Oct 04 17:49:27.460132 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1/5] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:49:26 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:27.474100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf456820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.477864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.478352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.478780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.479496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.480124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.480909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.506037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9011516-71dc-4e82-9114-2513a0919caa tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.047019 Oct 04 17:49:27.506823 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 5/6] 10.222.0.42 () {58 vars in 1139 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:27.578320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Calling method '.version_select at 0x7fbdbf456e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.589272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128849) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 17:49:27.590042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.590642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.591082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.598271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '.version_select at 0x7fbdbf4ed280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.609899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128850) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 04 17:49:27.610898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.611370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.611954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.619015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.619411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.619996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.644134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.644630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.645465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.645697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.645940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.646479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.655263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf74694c-b7e1-4c03-a9d0-dbc5ea9e222e tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.147415 Oct 04 17:49:27.660711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.661446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.662054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.663110 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 6/7] 10.222.0.42 () {60 vars in 1208 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:27.668210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ddf8966c-a500-47c1-abc4-60593bfb6c97 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.675637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06268f4a-a3da-40df-bf06-3b763491aef5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.214216 Oct 04 17:49:27.677958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2/8] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:27.689923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c133d3c8-a255-44f0-a5d2-efbb09ded3d7 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1788652594"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:27.709080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ddf8966c-a500-47c1-abc4-60593bfb6c97 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1930313846" status: 202 len: 0 microversion: 2.1 time: 0.044512 Oct 04 17:49:27.709764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 7/9] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:27 2022] DELETE /compute/v2.1/flavors/1930313846 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:27.712196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-c133d3c8-a255-44f0-a5d2-efbb09ded3d7 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 0a00db39-7c8e-4a1e-af87-e210d980eda3 for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:27.788939 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c133d3c8-a255-44f0-a5d2-efbb09ded3d7 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.108149 Oct 04 17:49:27.796219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3/10] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:27 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:27.797414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf379550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.801873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.802367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.803375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.804716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.805096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.805464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:27.833419 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac9b049a-e8f2-4286-8e2c-a8bdaedb0f5a tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.041850 Oct 04 17:49:27.834270 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 4/11] 10.222.0.42 () {58 vars in 1145 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:27.851302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29cfb657-2db8-4398-911b-0c815ae917e1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:27.887254 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29cfb657-2db8-4398-911b-0c815ae917e1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051939 Oct 04 17:49:27.888060 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:27.904392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd608aff-aa12-4117-87b5-db4e7f3587a9 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:27.916863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd608aff-aa12-4117-87b5-db4e7f3587a9 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:27.917475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd608aff-aa12-4117-87b5-db4e7f3587a9 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:27.918190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd608aff-aa12-4117-87b5-db4e7f3587a9 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.087813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c8a72a0-287a-4913-8226-da0a7e0c9159 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] Calling method '.version_select at 0x7fbdbf3daca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.121848 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c8a72a0-287a-4913-8226-da0a7e0c9159 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.406309 Oct 04 17:49:28.130556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 8/13] 10.222.0.42 () {60 vars in 1226 bytes} [Tue Oct 4 17:49:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:28.135986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2407114a-1f19-4b61-ae3e-85938552fd0a tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1420622058", "id": 193259216, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.158525 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2407114a-1f19-4b61-ae3e-85938552fd0a tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.026807 Oct 04 17:49:28.159570 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 9/14] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/flavors => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:28.169007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b2b6b1b-244b-4a7f-b1a6-af0ba0ee88ae tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbf389c10>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.403316 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b2b6b1b-244b-4a7f-b1a6-af0ba0ee88ae tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.239284 Oct 04 17:49:28.403985 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 10/15] 10.222.0.42 () {62 vars in 1247 bytes} [Tue Oct 4 17:49:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:28.416916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a1d56bb-ffd3-465f-9feb-76cd1bfdf1da tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.456941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a1d56bb-ffd3-465f-9feb-76cd1bfdf1da tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.043606 Oct 04 17:49:28.460907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 11/16] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.478605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-609f230a-9739-45c1-98ba-8f61a505b845 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] Calling method '.version_select at 0x7fbdbf398310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.490164 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-609f230a-9739-45c1-98ba-8f61a505b845 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.028033 Oct 04 17:49:28.497425 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 12/17] 10.222.0.42 () {60 vars in 1226 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:28.503140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e214d5f0-2502-4b8c-a3f6-65bebe717355 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.532475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e214d5f0-2502-4b8c-a3f6-65bebe717355 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/193259216" status: 202 len: 0 microversion: 2.1 time: 0.033882 Oct 04 17:49:28.536187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 13/18] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:28 2022] DELETE /compute/v2.1/flavors/193259216 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:28.540750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30f37ba0-17cb-4cd2-8ed5-04f0f5a1f485 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbf389670>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.567903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd608aff-aa12-4117-87b5-db4e7f3587a9 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 243 microversion: 2.1 time: 0.668663 Oct 04 17:49:28.568793 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 6/19] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:27 2022] POST /compute/v2.1/os-aggregates/1/action => generated 243 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:28.575786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d701991-11c6-4804-9a77-b44b24ae3b28 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.603204 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d701991-11c6-4804-9a77-b44b24ae3b28 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031202 Oct 04 17:49:28.603883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 7/20] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.614241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9,nova_api:DELETE=6,nova_api:UPDATE=13 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:28.614432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.632150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.632819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.633611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.645176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30f37ba0-17cb-4cd2-8ed5-04f0f5a1f485 tempest-QuotaClassesAdmin257Test-1572255647 tempest-QuotaClassesAdmin257Test-1572255647-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.107879 Oct 04 17:49:28.646148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 14/21] 10.222.0.42 () {62 vars in 1247 bytes} [Tue Oct 4 17:49:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:28.651172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5be7f6a-e9f6-4cac-bed3-0cecdb7763ef tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1927401180", "id": 429952397, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.674495 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5be7f6a-e9f6-4cac-bed3-0cecdb7763ef tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.027107 Oct 04 17:49:28.674831 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-831194-21. Oct 04 17:49:28.675558 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 15/22] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/flavors => generated 426 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:28.690398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe1702c8-4e0f-4f60-8a2d-b740b81791a8 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 40 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:49:28.698714 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: {"add_host": {"host": "n-h1-831194-21"}} Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:28.700054 n-d-831194-21 devstack@n-api.service[128850]: exception: Aggregate 1 already has host n-h1-831194-21. Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-831194-21'}}} Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:28.701283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-831194-21-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 17:49:28.702524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 17:49:28.703771 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:28.705335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-831194-21-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 17, 49, 28, 657151), 'updated_at': None, 'host': 'n-h1-831194-21', 'aggregate_id': 1}] Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:28.706550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-831194-21. Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.707732 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-831194-21. Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:28.709389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-831194-21. Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-831194-21. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f7916fb-ee25-40ca-9005-207d16e7ee53 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.093278 Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 8/23] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 04 17:49:28.714270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2b151f9-5405-44a5-a440-8b3cd208b010 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.715550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe1702c8-4e0f-4f60-8a2d-b740b81791a8 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/429952397" status: 202 len: 0 microversion: 2.1 time: 0.029813 Oct 04 17:49:28.715550 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 16/24] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:28 2022] DELETE /compute/v2.1/flavors/429952397 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:28.724900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b151f9-5405-44a5-a440-8b3cd208b010 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:28.725302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1b9f495-d345-4404-a48d-d7bee41c093d tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.725409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b151f9-5405-44a5-a440-8b3cd208b010 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:28.725807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b151f9-5405-44a5-a440-8b3cd208b010 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:28.754544 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1b9f495-d345-4404-a48d-d7bee41c093d tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033616 Oct 04 17:49:28.755140 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 17/25] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.776567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6364b79-ba1c-423b-939a-921bf2752840 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1997141524", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.802129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6364b79-ba1c-423b-939a-921bf2752840 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029040 Oct 04 17:49:28.802885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 18/26] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:28.814861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e390996c-1626-46e6-bd6b-53d533c4e8b9 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.833067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e390996c-1626-46e6-bd6b-53d533c4e8b9 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/a6dfe55c-03e4-4903-8896-2d42f8838507" status: 202 len: 0 microversion: 2.1 time: 0.022279 Oct 04 17:49:28.836884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 19/27] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:28 2022] DELETE /compute/v2.1/flavors/a6dfe55c-03e4-4903-8896-2d42f8838507 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:28.841436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eea204aa-44b0-4320-b745-ba6a9cbb1e13 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.875303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2b151f9-5405-44a5-a440-8b3cd208b010 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.169016 Oct 04 17:49:28.876304 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 9/28] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:28.886168 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eea204aa-44b0-4320-b745-ba6a9cbb1e13 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.041327 Oct 04 17:49:28.886168 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 20/29] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:28.893321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a57f759-8d43-488a-8327-f7cc4e440262 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.901788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec67da00-a5a0-41ea-b669-864b2e35f7d7 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1935965461", "id": "e1e316fa-b093-497d-a905-f69e384f17c1", "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.934840 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec67da00-a5a0-41ea-b669-864b2e35f7d7 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.036044 Oct 04 17:49:28.934840 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 10/30] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/flavors => generated 507 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:28.956264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edb96141-f6f2-4c8e-b0ce-196eb288a6c3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:28.972210 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a57f759-8d43-488a-8327-f7cc4e440262 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.088207 Oct 04 17:49:28.972954 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 21/31] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:28 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 17:49:28.985061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98ac70e3-4fd5-4969-b306-bb8cd18eb583 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-201323480"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:28.989009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-98ac70e3-4fd5-4969-b306-bb8cd18eb583 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 833996cb-671f-457c-bed2-a8f86f398fd1 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:28.994067 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-edb96141-f6f2-4c8e-b0ce-196eb288a6c3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/e1e316fa-b093-497d-a905-f69e384f17c1" status: 202 len: 0 microversion: 2.1 time: 0.047312 Oct 04 17:49:28.994067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 11/32] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:28 2022] DELETE /compute/v2.1/flavors/e1e316fa-b093-497d-a905-f69e384f17c1 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:29.008336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50883763-40d1-4b62-91e8-c15b857e15a4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.021034 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98ac70e3-4fd5-4969-b306-bb8cd18eb583 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.041087 Oct 04 17:49:29.021944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 22/33] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:28 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.032724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf317ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.037056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.037722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.038233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.038534 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50883763-40d1-4b62-91e8-c15b857e15a4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036568 Oct 04 17:49:29.039157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.039453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 12/34] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:29.039573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.039982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.070117 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-488cc1b3-aa7d-4bb5-a1de-b002d10f725d tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.042558 Oct 04 17:49:29.070767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 23/35] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.081041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-042b6284-b3c9-4a99-bc09-4ff588f8b4ae tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1968681007", "id": 208917570, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.101298 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-042b6284-b3c9-4a99-bc09-4ff588f8b4ae tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.023846 Oct 04 17:49:29.102007 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 24/36] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/flavors => generated 411 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.106737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf317280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.111196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.111323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.111763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.112571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.113030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.113460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.136914 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-966dc9c0-e58e-4a59-9aac-a9454810712b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.033819 Oct 04 17:49:29.137497 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 25/37] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.149690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25011906-f24b-4465-aa4a-59310167e076 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.170549 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25011906-f24b-4465-aa4a-59310167e076 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/208917570" status: 200 len: 411 microversion: 2.1 time: 0.026910 Oct 04 17:49:29.171274 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 26/38] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/flavors/208917570 => generated 411 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.176390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbf317ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.179724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.180220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.180664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.181399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.181870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.182487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.208885 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b86469a2-fe86-490f-b8b3-d952b4584a5b tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.036629 Oct 04 17:49:29.209515 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 27/39] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.218992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-166e3521-19aa-4dfe-8953-7c6068b48324 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-712364926", "name": "tempest-test_aggregate-1159580632"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.241524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-166e3521-19aa-4dfe-8953-7c6068b48324 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 4adb230f-e9f9-4fff-b287-458b6108c12f for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:29.277279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-166e3521-19aa-4dfe-8953-7c6068b48324 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.065941 Oct 04 17:49:29.278052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 28/40] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.294419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d660be8-5eb1-445e-aca1-4ce332efab3b tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.298876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d660be8-5eb1-445e-aca1-4ce332efab3b tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d660be8-5eb1-445e-aca1-4ce332efab3b tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 40 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:29.301613 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: {"add_host": {"host": "n-h1-831194-21"}} Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:29.303141 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-831194-21'}}} Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:29.304198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 04 17:49:29.305333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.306506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d660be8-5eb1-445e-aca1-4ce332efab3b tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.306506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d660be8-5eb1-445e-aca1-4ce332efab3b tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.262098 Oct 04 17:49:29.306506 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 13/41] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:29.308035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbe7be430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.316734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.317231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.317840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.333557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.333557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.333557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.377310 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ce98b6e-4a7b-4335-95cf-d4b5ceaa4602 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h1-831194-21" status: 200 len: 335 microversion: 2.1 time: 0.072606 Oct 04 17:49:29.377921 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 14/42] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-hosts/n-h1-831194-21 => generated 335 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.382381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d726bc9-3dd7-4116-83d8-d8c892e769c5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.394633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d726bc9-3dd7-4116-83d8-d8c892e769c5 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.015674 Oct 04 17:49:29.395212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 15/43] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.399552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85bc6c12-2ee8-4f96-8299-985311dde941 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.429320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85bc6c12-2ee8-4f96-8299-985311dde941 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.032924 Oct 04 17:49:29.429925 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 16/44] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:29 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:29.435333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Calling method '.version_select at 0x7fbdbfdee310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.443084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.443588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.444045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.458239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.458636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.459084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.467651 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e79cfafc-b725-43f6-9d7c-979825acfa96 tempest-HostsAdminTestJSON-622563371 tempest-HostsAdminTestJSON-622563371-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-h2-831194-21" status: 200 len: 335 microversion: 2.1 time: 0.036373 Oct 04 17:49:29.468622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 17/45] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/os-hosts/n-h2-831194-21 => generated 335 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.473159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8eb67114-8d61-4701-8dd0-958c2fb4dc29 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.490839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42f6525f-96e9-48e5-bad4-b5d59a2f2424 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.501121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8eb67114-8d61-4701-8dd0-958c2fb4dc29 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.502698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8eb67114-8d61-4701-8dd0-958c2fb4dc29 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.505081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8eb67114-8d61-4701-8dd0-958c2fb4dc29 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.518691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42f6525f-96e9-48e5-bad4-b5d59a2f2424 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.239069 Oct 04 17:49:29.519289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 29/46] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:29.537158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e879b4f-b124-4724-85d9-e9924bc85b04 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1146538061"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.540485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-7e879b4f-b124-4724-85d9-e9924bc85b04 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid d0e611d6-36fe-46bb-b8e9-a73a4662ab04 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:29.582838 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e879b4f-b124-4724-85d9-e9924bc85b04 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.062449 Oct 04 17:49:29.583441 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 30/47] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.589363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-841d510e-a7a4-44c3-a72a-33277994dbc4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.612179 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-841d510e-a7a4-44c3-a72a-33277994dbc4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/208917570" status: 202 len: 0 microversion: 2.1 time: 0.027503 Oct 04 17:49:29.613017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 31/48] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:29 2022] DELETE /compute/v2.1/flavors/208917570 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:29.620065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1024037419"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.634385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.635322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.636014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.645867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:29.646490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:29.648561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:29.665613 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1024037419 could not be found. Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 58 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:29.674218 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: {"add_host": {"host": "tempest-nonexist_host-1024037419"}} Oct 04 17:49:29.675581 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: exception: Compute host tempest-nonexist_host-1024037419 could not be found. Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1024037419'}}} Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1024037419' is not mapped to any cell Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.676343 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 04 17:49:29.677662 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1024037419 could not be found. Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1024037419 could not be found. Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.679224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1024037419 could not be found. Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1024037419 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.680623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-599ed340-0c84-4f42-a569-68330eec5785 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.064371 Oct 04 17:49:29.681187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 32/49] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:29.687520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45a32bae-9744-473b-9dbe-bb9d95fdf8cd tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.704148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8eb67114-8d61-4701-8dd0-958c2fb4dc29 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 314 microversion: 2.1 time: 0.234074 Oct 04 17:49:29.705652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 18/50] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates/3/action => generated 314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:29.714102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45a32bae-9744-473b-9dbe-bb9d95fdf8cd tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029082 Oct 04 17:49:29.722497 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 33/51] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:29.725071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0aa5742-339e-4348-b813-cf5a44531448 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.736018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c674349-e59c-4c3e-a787-aa7e869e7781 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-871612581", "id": 2051912586, "os-flavor-access:is_public": "False"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.758739 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c674349-e59c-4c3e-a787-aa7e869e7781 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.030230 Oct 04 17:49:29.759421 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 34/52] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/flavors => generated 429 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:29.773358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0aa5742-339e-4348-b813-cf5a44531448 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.056133 Oct 04 17:49:29.775749 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 19/53] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:29 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:29.780081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc9e1f33-6d29-4ee7-9ce5-e17f5c0dc149 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "2051912586"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.787646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5631623b-91a0-4d34-9b1d-878aeb97ce75 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5631623b-91a0-4d34-9b1d-878aeb97ce75 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 283 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:49:29.804061 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.805271 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:49:29.805762 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.806332 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.807160 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.808016 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:49:29.808016 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:49:29.808016 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:49:29.808016 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.808262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-fc9e1f33-6d29-4ee7-9ce5-e17f5c0dc149 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] HTTP exception thrown: Flavor 2051912586 could not be found. Oct 04 17:49:29.808331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5631623b-91a0-4d34-9b1d-878aeb97ce75 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.808331 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5631623b-91a0-4d34-9b1d-878aeb97ce75 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.028161 Oct 04 17:49:29.810004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 20/54] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc9e1f33-6d29-4ee7-9ce5-e17f5c0dc149 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Request method failure captured: Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 107 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIkPjhj4bOo4Nk6LtMyy4OebA__5W9nM0ukEhOFJrZpUQSByxa9URqF37B9L5moQjxOjagtCq3y4o9gz-q5N9Qwg2goRqnoXBNBhCtLsMSJcVyHmLurcDNlbkP2YvebH1SHHieQQNQqsl83ozV0HtwRisvkL5U7OW8lh2Oe6T5hv-w Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 330cca7fa16c4051bfe2ccdbc8651ca0 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FlavorsAdminTestJSON-1661146814 Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:29.810225 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/330cca7fa16c4051bfe2ccdbc8651ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/330cca7fa16c4051bfe2ccdbc8651ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/330cca7fa16c4051bfe2ccdbc8651ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_330cca7fa16c4051bfe2ccdbc8651ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FlavorsAdminTestJSON-1661146814 Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 330cca7fa16c4051bfe2ccdbc8651ca0 Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1661146814 Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FlavorsAdminTestJSON-1661146814-project Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: a7035622d4f54b1d8691223d87999a7f Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FlavorsAdminTestJSON-1661146814-project Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "test", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "2051912586"}} Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:29.811557 n-d-831194-21 devstack@n-api.service[128849]: exception: Flavor 2051912586 could not be found. Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '2051912586'}}} Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 2051912586 could not be found. Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.812807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 2051912586 could not be found. Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.814040 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 2051912586 could not be found. Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc9e1f33-6d29-4ee7-9ce5-e17f5c0dc149 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Returning 400 to user: Flavor 2051912586 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc9e1f33-6d29-4ee7-9ce5-e17f5c0dc149 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.043750 Oct 04 17:49:29.815994 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 35/55] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:49:29.826533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ad4a69a-e165-47ca-91bf-ec4e3ca427cc tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.830123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c494aa78-8b86-4fd1-b03d-920c9e39be01 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ad4a69a-e165-47ca-91bf-ec4e3ca427cc tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 27 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:29.832751 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: {"aggregate": {"name": ""}} Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:29.834135 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '' Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.834895 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 17:49:29.836059 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.837041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ad4a69a-e165-47ca-91bf-ec4e3ca427cc tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.837041 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ad4a69a-e165-47ca-91bf-ec4e3ca427cc tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013797 Oct 04 17:49:29.837041 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 36/56] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:49:29.844777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7393f22f-aad7-4f15-8458-13a6bb35913d tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1843787547"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.849447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7393f22f-aad7-4f15-8458-13a6bb35913d tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7393f22f-aad7-4f15-8458-13a6bb35913d tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 60 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:29.852864 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: {"aggregate": {"name": "tempest-test_aggregate-1843787547"}} Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:29.854296 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1843787547'}}} Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:29.854925 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:29.855853 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 04 17:49:29.856819 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.856819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7393f22f-aad7-4f15-8458-13a6bb35913d tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.856819 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7393f22f-aad7-4f15-8458-13a6bb35913d tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.014102 Oct 04 17:49:29.856819 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 37/57] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:29.866989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b476982-4318-4cca-9e24-a34329a4bd95 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-507203843"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.869949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-0b476982-4318-4cca-9e24-a34329a4bd95 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 420cb939-31f3-4b94-ba6b-d990faaeef92 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:29.881970 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c494aa78-8b86-4fd1-b03d-920c9e39be01 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2051912586" status: 202 len: 0 microversion: 2.1 time: 0.061000 Oct 04 17:49:29.882726 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 21/58] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:29 2022] DELETE /compute/v2.1/flavors/2051912586 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:29.891962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed0f6e0-bd68-4a85-b0e0-6ab13b8cbfd4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.904523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b476982-4318-4cca-9e24-a34329a4bd95 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.042028 Oct 04 17:49:29.905297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 38/59] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:29.919226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-507203843"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.926906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 2e1c5381-ef1d-465f-a71c-6e38a1970dfa for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:29.932844 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ed0f6e0-bd68-4a85-b0e0-6ab13b8cbfd4 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045648 Oct 04 17:49:29.933441 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 22/60] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:29.961945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-507203843 already exists. Oct 04 17:49:29.964125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91980786-4d9d-4684-9fc8-cda2c9f88236 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-90433833", "id": 300374684, "os-flavor-access:is_public": "False"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 59 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:29.976650 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: {"aggregate": {"name": "tempest-test_aggregate-507203843"}} Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:29.978068 n-d-831194-21 devstack@n-api.service[128849]: exception: Aggregate tempest-test_aggregate-507203843 already exists. Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-507203843'}}} Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 04 17:49:29.979232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-507203843 already exists. Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:29.980222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-507203843 already exists. Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-507203843 already exists. Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-507203843 already exists. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:29.981698 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6da45265-3c1e-4b96-b830-fe0038a43cb4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.065882 Oct 04 17:49:29.983186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 39/61] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:29.986723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6,nova_api:DELETE=11 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:29.990986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99297df1-9821-4b49-a9d2-450f815f74ad tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:29.995616 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91980786-4d9d-4684-9fc8-cda2c9f88236 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.036348 Oct 04 17:49:29.996498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 23/62] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:29 2022] POST /compute/v2.1/flavors => generated 410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.006879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=78,nova_api:INSERT=9,nova_api:DELETE=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:30.012712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85fef354-f6e1-4762-b699-da1c20fbafd0 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1552575873", "id": 816249283, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.032689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99297df1-9821-4b49-a9d2-450f815f74ad tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.045863 Oct 04 17:49:30.039157 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 40/63] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:29 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:30.047454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2fc535da-b41d-4b6f-9742-6b0e733ad331 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1272158068"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.051922 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85fef354-f6e1-4762-b699-da1c20fbafd0 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.045986 Oct 04 17:49:30.052098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-2fc535da-b41d-4b6f-9742-6b0e733ad331 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid b2b48251-c4b1-4a1f-a49b-dc9bd52b2b01 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:30.064749 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 24/64] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/flavors => generated 411 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:30.080113 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2fc535da-b41d-4b6f-9742-6b0e733ad331 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039448 Oct 04 17:49:30.081656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b24c1ca4-c9cf-4197-8958-4f5544eea382 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.082958 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 41/65] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.099725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5f4b92c-06ec-48e7-a775-d54a94d8c4f6 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.101878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b5f4b92c-06ec-48e7-a775-d54a94d8c4f6 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5f4b92c-06ec-48e7-a775-d54a94d8c4f6 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:30.102970 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:30.104104 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '6'} Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:30.106634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.107711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5f4b92c-06ec-48e7-a775-d54a94d8c4f6 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:30.108614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b24c1ca4-c9cf-4197-8958-4f5544eea382 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 413 microversion: 2.1 time: 0.036396 Oct 04 17:49:30.108614 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 25/66] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 413 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.108751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5f4b92c-06ec-48e7-a775-d54a94d8c4f6 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.013973 Oct 04 17:49:30.108751 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 42/67] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:30.121651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60eaf5b6-6d83-4e90-b293-f0a211a44055 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.126248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a49f6ef2-ef4b-4f6d-a024-172a48bb67fb tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.139168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60eaf5b6-6d83-4e90-b293-f0a211a44055 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 413 microversion: 2.1 time: 0.024525 Oct 04 17:49:30.139776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 26/68] 10.222.0.42 () {58 vars in 1177 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 413 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.167016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a49f6ef2-ef4b-4f6d-a024-172a48bb67fb tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.045684 Oct 04 17:49:30.168409 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 43/69] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:30.178471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-67729d25-00d0-4004-b8db-666ff10fba1b tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.212011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-67729d25-00d0-4004-b8db-666ff10fba1b tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 413 microversion: 2.1 time: 0.041796 Oct 04 17:49:30.212839 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 44/70] 10.222.0.42 () {58 vars in 1171 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 413 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.217559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e756855-b50a-4ba7-8045-4bdeb9a4ad0a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.242095 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5e756855-b50a-4ba7-8045-4bdeb9a4ad0a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e756855-b50a-4ba7-8045-4bdeb9a4ad0a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:30.245073 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: exception: Aggregate -1 could not be found. Oct 04 17:49:30.246360 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '-1'} Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:30.247157 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.248392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e756855-b50a-4ba7-8045-4bdeb9a4ad0a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e756855-b50a-4ba7-8045-4bdeb9a4ad0a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032813 Oct 04 17:49:30.251358 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 45/71] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:30.255413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96127f8d-8dc8-4f6d-871f-d8b1d3281540 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.268455 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96127f8d-8dc8-4f6d-871f-d8b1d3281540 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 413 microversion: 2.1 time: 0.018748 Oct 04 17:49:30.269232 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 46/72] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 413 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.274154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df9f1180-3a3e-41a4-870e-c384d0cadc4a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1483507034"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.277496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-df9f1180-3a3e-41a4-870e-c384d0cadc4a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 550bc2ed-43b4-475b-b337-6c5851ddbf6c for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:49:30.300480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df9f1180-3a3e-41a4-870e-c384d0cadc4a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029872 Oct 04 17:49:30.301249 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 47/73] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.311178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-396fddb8-94d2-4d58-bfce-ffe76e64e688 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.334122 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-396fddb8-94d2-4d58-bfce-ffe76e64e688 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.031744 Oct 04 17:49:30.334714 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 48/74] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.339189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6335195d-2dd0-4ccf-ba82-2b824c5f83bb tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.340714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6335195d-2dd0-4ccf-ba82-2b824c5f83bb tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6335195d-2dd0-4ccf-ba82-2b824c5f83bb tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:30.342255 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:30.343964 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '7'} Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:30.344562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.345463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6335195d-2dd0-4ccf-ba82-2b824c5f83bb tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:30.347310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6335195d-2dd0-4ccf-ba82-2b824c5f83bb tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.008862 Oct 04 17:49:30.347310 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 49/75] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:30.358664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7822bbea-85e2-4f15-b135-0598a24cc79d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.388740 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7822bbea-85e2-4f15-b135-0598a24cc79d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.034595 Oct 04 17:49:30.394417 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 50/76] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 04 17:49:30.398988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-71e56c1d-8bcc-4a53-bede-3606b27f903b tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.435537 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-71e56c1d-8bcc-4a53-bede-3606b27f903b tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.039870 Oct 04 17:49:30.446225 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 51/77] 10.222.0.42 () {58 vars in 1175 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.446225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c8028a6-81e7-4595-96fe-4f68e9f9cf76 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5c8028a6-81e7-4595-96fe-4f68e9f9cf76 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c8028a6-81e7-4595-96fe-4f68e9f9cf76 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:30.451254 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: exception: Aggregate -1 could not be found. Oct 04 17:49:30.453182 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '-1'} Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.453889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 04 17:49:30.454959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.457264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c8028a6-81e7-4595-96fe-4f68e9f9cf76 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:30.457264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c8028a6-81e7-4595-96fe-4f68e9f9cf76 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.013732 Oct 04 17:49:30.457264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 52/78] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:30.457798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8da08cdf-bd25-4405-b2a9-f3b75806afa1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.481303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8da08cdf-bd25-4405-b2a9-f3b75806afa1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.027133 Oct 04 17:49:30.482249 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 53/79] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.488254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14559d05-2645-445e-9936-dc952126c8c1 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.490843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14559d05-2645-445e-9936-dc952126c8c1 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14559d05-2645-445e-9936-dc952126c8c1 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:30.493181 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:30.494279 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:30.494878 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:30.502079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14559d05-2645-445e-9936-dc952126c8c1 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:30.502921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14559d05-2645-445e-9936-dc952126c8c1 tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.011403 Oct 04 17:49:30.502921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 54/80] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:30.504164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49ce0731-cdcc-4471-adb1-3fbe69426ea3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.520129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-848711365", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "availability_zone": "tempest-test_az-712364926"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.537091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49ce0731-cdcc-4471-adb1-3fbe69426ea3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.039875 Oct 04 17:49:30.538139 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 55/81] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:30.558896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-188d2372-9d07-4cf7-b814-164a886d82f3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.567096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:30.567374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:30.567968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:30.569003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:30.569409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:30.569862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:30.582118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-188d2372-9d07-4cf7-b814-164a886d82f3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/816249283" status: 202 len: 0 microversion: 2.1 time: 0.027865 Oct 04 17:49:30.583412 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 56/82] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/flavors/816249283 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:30.596409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ad717e3-13d5-4136-b80e-4c89ef87a7d1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.622267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ad717e3-13d5-4136-b80e-4c89ef87a7d1 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033076 Oct 04 17:49:30.636569 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 57/83] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.641709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c73e071-6e7e-40d5-b98f-105fbe350e55 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.672926 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c73e071-6e7e-40d5-b98f-105fbe350e55 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/300374684" status: 202 len: 0 microversion: 2.1 time: 0.034790 Oct 04 17:49:30.674078 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 58/84] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/flavors/300374684 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:30.694889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1b482b7-587d-4ed8-a6f9-3b67e4e691a3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.720477 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1b482b7-587d-4ed8-a6f9-3b67e4e691a3 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031689 Oct 04 17:49:30.734229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 59/85] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.742665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0ef7718-f0e1-462f-8bcb-22bd6bebe973 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1208288415", "id": 1523267790, "os-flavor-access:is_public": "False"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.765079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0ef7718-f0e1-462f-8bcb-22bd6bebe973 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.025846 Oct 04 17:49:30.769885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 60/86] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/flavors => generated 415 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.778347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19184c98-d64a-4276-8b8e-cb424230e00c tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.802404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19184c98-d64a-4276-8b8e-cb424230e00c tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027969 Oct 04 17:49:30.803602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 61/87] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:30.828198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae505417-79e8-4d22-a12c-b6075cf72f18 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.853516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae505417-79e8-4d22-a12c-b6075cf72f18 tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029721 Oct 04 17:49:30.854564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 62/88] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.875398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-196dfb6d-5bd6-4900-945e-5e168d95266e tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.903890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-196dfb6d-5bd6-4900-945e-5e168d95266e tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1523267790" status: 202 len: 0 microversion: 2.1 time: 0.033707 Oct 04 17:49:30.909332 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 63/89] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:30 2022] DELETE /compute/v2.1/flavors/1523267790 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:30.914849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5657baf-3576-45e3-9036-b1d3f390a2c0 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:30.936001 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5657baf-3576-45e3-9036-b1d3f390a2c0 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025206 Oct 04 17:49:30.936618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 64/90] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:30.957589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34a4c8a2-09e4-4920-be35-9d49bbcf14d8 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1296657965", "id": 1349923181, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:30.977181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34a4c8a2-09e4-4920-be35-9d49bbcf14d8 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.023582 Oct 04 17:49:30.977181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 65/91] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/flavors => generated 414 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:30.989799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e8f4895-e6fe-43ae-8c66-b090f0a2918d tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.011183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e8f4895-e6fe-43ae-8c66-b090f0a2918d tempest-FlavorsAdminTestJSON-1661146814 tempest-FlavorsAdminTestJSON-1661146814-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.025049 Oct 04 17:49:31.011956 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 66/92] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:30 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:31.030246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0f534b8-cc76-4493-be4f-77bd3a48a929 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.050099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0f534b8-cc76-4493-be4f-77bd3a48a929 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1349923181" status: 202 len: 0 microversion: 2.1 time: 0.023117 Oct 04 17:49:31.050856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 67/93] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:31 2022] DELETE /compute/v2.1/flavors/1349923181 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:31.059938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17fb4e44-7319-489e-8b0c-d5f06024e116 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:31.080572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17fb4e44-7319-489e-8b0c-d5f06024e116 tempest-FlavorsAdminTestJSON-471580828 tempest-FlavorsAdminTestJSON-471580828-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025387 Oct 04 17:49:31.082039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 68/94] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:31.553907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:31.929389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:31.929819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:31.930322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:31.930737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:31.931153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:31.958029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.958632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.960591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:31.961433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:31.962009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:31.962511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:32.006619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Getting quotas for project 7eae825c35b9444489b006f2dea9af61. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:32.026016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Getting quotas for user ea9d0738d842400ea07a18d711d85f6b and project 7eae825c35b9444489b006f2dea9af61. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:32.043449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:49:32.048086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:49:32.113744 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-64a687fa-c4d6-400c-a9d0-c279008f93a5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.967590 Oct 04 17:49:32.115053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 27/95] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:49:32.128209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-865e9469-6e91-4f65-96f8-5cc5995fc7d5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:32.129529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-865e9469-6e91-4f65-96f8-5cc5995fc7d5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:33.228140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36ff1a55-1c68-40c2-9994-754531f633aa tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-326444987", "id": 2032992780, "os-flavor-access:is_public": "False"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.239523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-865e9469-6e91-4f65-96f8-5cc5995fc7d5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:33.261212 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-865e9469-6e91-4f65-96f8-5cc5995fc7d5 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1241 microversion: 2.1 time: 1.138126 Oct 04 17:49:33.262603 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 69/96] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:32 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1241 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:33.264010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36ff1a55-1c68-40c2-9994-754531f633aa tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.517245 Oct 04 17:49:33.266541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 28/97] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:32 2022] POST /compute/v2.1/flavors => generated 438 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:33.281770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bda12970-4bc6-41ff-929d-90477f9c4dfc tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.806416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2022756123", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.846974 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bda12970-4bc6-41ff-929d-90477f9c4dfc tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/2032992780/action" status: 200 len: 97 microversion: 2.1 time: 0.569718 Oct 04 17:49:33.851521 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 70/98] 10.222.0.42 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:33 2022] POST /compute/v2.1/flavors/2032992780/action => generated 97 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:33.864252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-070db2f8-4c42-42f4-a8e7-2113bd9c1c06 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:33.919076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:34.168897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:34.169928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:34.170731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:34.172215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:34.172748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:34.181797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.182393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.182936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.184206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.185121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.185940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.220803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Getting quotas for project 093b213cf7734de0977b044435403d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:34.238878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Getting quotas for user 271f007582e7427ba4931f5abe921fb6 and project 093b213cf7734de0977b044435403d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:34.252578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:49:34.255290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:49:34.310834 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f1f7c7e-94db-422a-9444-b36d2d0c42cb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893361 Oct 04 17:49:34.312212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 29/99] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:49:34.326316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.327732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:34.344362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.344954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.345474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.346288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:34.346980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:34.347477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:34.519677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:DELETE=17,nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:34.549147 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-070db2f8-4c42-42f4-a8e7-2113bd9c1c06 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] HTTP exception thrown: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-070db2f8-4c42-42f4-a8e7-2113bd9c1c06 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Request method failure captured: Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/flavors/2032992780/action HTTP/1.1 Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 67 Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIqRTBvfNmwakq5YvttrTTIZYRVKBeYRRTcVXwmFg40almEnqP-VzeYZtKNT2SpRNadm1TO6-0MtgVe0E-5D3zl7k-S0NZ1hil1ScSskzou2-vCHWg4H8sVXvifuyL9AN8CIMjI-UAuPSE4Zw_-_CLyYfdcCBVupLXoewWF21DSbcE Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:34.576710 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 33793a8bdf3e48d3977edad652e4906b Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} Oct 04 17:49:34.578184 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: exception: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2032992780', 'body': {'addTenantAccess': {'tenant': '5b52bc6d77d244f48d2d51a05d99e8b3'}}} Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:34.579000 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '26-5b52bc6d77d244f48d2d51a05d99e8b3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 17:49:34.580488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 17:49:34.581740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 17:49:34.583029 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result.read() Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '26-5b52bc6d77d244f48d2d51a05d99e8b3' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 17, 49, 34, 523272), 'updated_at': None, 'flavor_id': 26, 'project_id': '5b52bc6d77d244f48d2d51a05d99e8b3'}] Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:34.583963 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:34.584773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:34.585718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:34.587961 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. Oct 04 17:49:34.587961 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:34.587961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-070db2f8-4c42-42f4-a8e7-2113bd9c1c06 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Returning 409 to user: Flavor access already exists for flavor 26 and project 5b52bc6d77d244f48d2d51a05d99e8b3 combination. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:34.587961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-070db2f8-4c42-42f4-a8e7-2113bd9c1c06 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/2032992780/action" status: 409 len: 152 microversion: 2.1 time: 0.720337 Oct 04 17:49:34.587961 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 71/100] 10.222.0.42 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:33 2022] POST /compute/v2.1/flavors/2032992780/action => generated 152 bytes in 722 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:49:34.591881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c09ad191-b681-4f62-9618-968c4a302a94 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:34.593174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c09ad191-b681-4f62-9618-968c4a302a94 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:34.669092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:34.677896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c09ad191-b681-4f62-9618-968c4a302a94 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:34.686310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c09ad191-b681-4f62-9618-968c4a302a94 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1220 microversion: 2.1 time: 0.102445 Oct 04 17:49:34.692930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 72/101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:34.701500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef13b0d2-2936-44e1-aef4-f00789591519 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:34.717529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1034db9-e03f-421a-8fe4-196ea4a572dd tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1297 microversion: 2.1 time: 0.398618 Oct 04 17:49:34.734328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 30/102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:34 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1297 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:35.439245 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef13b0d2-2936-44e1-aef4-f00789591519 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/2032992780/action" status: 200 len: 21 microversion: 2.1 time: 0.743307 Oct 04 17:49:35.442295 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 73/103] 10.222.0.42 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:34 2022] POST /compute/v2.1/flavors/2032992780/action => generated 21 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:35.461546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da244e9a-dd48-4749-896c-e99b530bd1c1 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.505264 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da244e9a-dd48-4749-896c-e99b530bd1c1 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/2032992780" status: 202 len: 0 microversion: 2.1 time: 0.048890 Oct 04 17:49:35.506293 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 31/104] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:35 2022] DELETE /compute/v2.1/flavors/2032992780 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:35.515388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-74a2e44d-8448-42a7-914c-a121b5a5956f tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.541662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-74a2e44d-8448-42a7-914c-a121b5a5956f tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031008 Oct 04 17:49:35.542445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 74/105] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:35.570645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9de887f-5ca6-48ba-b3af-69b1c3a19838 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-995320460", "id": 1272995752, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:35.595806 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9de887f-5ca6-48ba-b3af-69b1c3a19838 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.029334 Oct 04 17:49:35.597149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 32/106] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:35 2022] POST /compute/v2.1/flavors => generated 437 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:35.611754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4436fd0b-e896-4d83-b1dc-a71b9d890649 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.620454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4436fd0b-e896-4d83-b1dc-a71b9d890649 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4436fd0b-e896-4d83-b1dc-a71b9d890649 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Request method failure captured: Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/flavors/1272995752/os-flavor-access HTTP/1.1 Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIqRTBvfNmwakq5YvttrTTIZYRVKBeYRRTcVXwmFg40almEnqP-VzeYZtKNT2SpRNadm1TO6-0MtgVe0E-5D3zl7k-S0NZ1hil1ScSskzou2-vCHWg4H8sVXvifuyL9AN8CIMjI-UAuPSE4Zw_-_CLyYfdcCBVupLXoewWF21DSbcE Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:49:35.621881 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 33793a8bdf3e48d3977edad652e4906b Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: exception: Access list not available for public flavors. Oct 04 17:49:35.623468 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'flavor_id': '1272995752'} Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 04 17:49:35.624284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:35.625673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4436fd0b-e896-4d83-b1dc-a71b9d890649 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:35.625673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4436fd0b-e896-4d83-b1dc-a71b9d890649 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1272995752/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.017003 Oct 04 17:49:35.629918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 75/107] 10.222.0.42 () {58 vars in 1209 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/flavors/1272995752/os-flavor-access => generated 91 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:49:35.633279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8cd5cbf-9f57-4430-981a-fd55f77477a7 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.652734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8cd5cbf-9f57-4430-981a-fd55f77477a7 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1272995752" status: 202 len: 0 microversion: 2.1 time: 0.023090 Oct 04 17:49:35.653746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 33/108] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:35 2022] DELETE /compute/v2.1/flavors/1272995752 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:35.662796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95e2fc8b-fd92-40e3-a0eb-de6e669903cf tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.690806 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-95e2fc8b-fd92-40e3-a0eb-de6e669903cf tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031630 Oct 04 17:49:35.691408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 76/109] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:35.714513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04521892-5342-43f7-a8f2-bb37ae9f5beb tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1782016262", "id": 1475768361, "os-flavor-access:is_public": "False"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:35.719485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.720167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:35.727434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.727977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.729352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.732039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.733435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.735923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.767034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04521892-5342-43f7-a8f2-bb37ae9f5beb tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.058121 Oct 04 17:49:35.778371 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 34/110] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:35.787183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:35.787818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:35.797861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.798424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.805180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:35.805978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:35.806465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:35.806956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:36.032610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.045055 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22a5f95f-6d13-430a-a407-e25cb40cbbd3 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1295 microversion: 2.1 time: 0.272341 Oct 04 17:49:36.045801 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 35/111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1295 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:36.130860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.158449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a62b7839-bd6a-4d77-8d7d-1615f909b986 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1272 microversion: 2.1 time: 0.445413 Oct 04 17:49:36.159046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 77/112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:35 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1272 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:36.825288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70ce9434-7c15-423d-bd7e-59cde121ffb4 tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:36.828965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70ce9434-7c15-423d-bd7e-59cde121ffb4 tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '70349d47f5a24d699b264907f7b6ac3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b52bc6d77d244f48d2d51a05d99e8b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70ce9434-7c15-423d-bd7e-59cde121ffb4 tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Request method failure captured: Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/flavors/1475768361/action HTTP/1.1 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 67 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIorSxYaPUPUWtHxDx1usbk6k-JYocS3u14xy8wb3wWqkXvvJ10xjWGzNhdMKFEFU2U3VtBoB-OluxnbAs0wumwYVpn-7A2ssuKej0pzql_3jS7hagjjjSr45wzR6dt-wKV_4wwJP3L_Sx-G5X34N8pShid8iVngtSrIhI0NXFhvCY Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5b52bc6d77d244f48d2d51a05d99e8b3 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:36.838247 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5b52bc6d77d244f48d2d51a05d99e8b3 Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsAccessNegativeTestJSON-2129266176-project Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 70349d47f5a24d699b264907f7b6ac3a Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176-project Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} Oct 04 17:49:36.839681 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1475768361', 'body': {'addTenantAccess': {'tenant': '5b52bc6d77d244f48d2d51a05d99e8b3'}}} Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:36.840558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 04 17:49:36.841874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:36.844741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70ce9434-7c15-423d-bd7e-59cde121ffb4 tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:36.846853 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70ce9434-7c15-423d-bd7e-59cde121ffb4 tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] 10.222.0.42 "POST /compute/v2.1/flavors/1475768361/action" status: 403 len: 130 microversion: 2.1 time: 0.778989 Oct 04 17:49:36.853706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 36/113] 10.222.0.42 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:36 2022] POST /compute/v2.1/flavors/1475768361/action => generated 130 bytes in 786 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:36.857793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b6c9d7e-b4e1-4306-b3c7-c6b3976366fa tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:36.921955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b6c9d7e-b4e1-4306-b3c7-c6b3976366fa tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1475768361" status: 202 len: 0 microversion: 2.1 time: 0.059317 Oct 04 17:49:36.924343 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 78/114] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:36 2022] DELETE /compute/v2.1/flavors/1475768361 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:49:36.931399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7240268-3b6d-4ae6-8493-28975d8e930f tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:36.984695 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7240268-3b6d-4ae6-8493-28975d8e930f tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057074 Oct 04 17:49:36.987498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 37/115] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:37.014814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96b0bb1a-d46a-4d4a-9d50-d912b7627ebd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1324302308", "id": 974063508, "os-flavor-access:is_public": "False"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:37.079503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96b0bb1a-d46a-4d4a-9d50-d912b7627ebd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.070986 Oct 04 17:49:37.091097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:37.091727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:37.092885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 79/116] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:37 2022] POST /compute/v2.1/flavors => generated 436 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:37.106387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e279773-9f6a-4fcb-83e8-1776d525edd8 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:37.113174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.115989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.116497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:37.117255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:37.117718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:37.121324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:37.424926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:37.447586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28c069ae-9096-4c2d-9460-2e189a5be028 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.376873 Oct 04 17:49:37.448870 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 38/117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:37 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:38.152569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebd3c0f7-1106-45f4-b215-47421385b7d9 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Calling method '.version_select at 0x7fbdbe67bd30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:38.200800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e279773-9f6a-4fcb-83e8-1776d525edd8 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/974063508/action" status: 200 len: 96 microversion: 2.1 time: 1.106191 Oct 04 17:49:38.213001 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 80/118] 10.222.0.42 () {60 vars in 1197 bytes} [Tue Oct 4 17:49:37 2022] POST /compute/v2.1/flavors/974063508/action => generated 96 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:38.229697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:38.230632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:38.263364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.264052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.265133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.266131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.266648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.267087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.457401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:38.469923 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7758b726-a6ae-4038-8ff7-4dfe09e87b40 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1278 microversion: 2.1 time: 0.253263 Oct 04 17:49:38.470959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 81/119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:38 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:38.565738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebd3c0f7-1106-45f4-b215-47421385b7d9 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 371 microversion: 2.1 time: 1.115592 Oct 04 17:49:38.571258 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 39/120] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 17:49:37 2022] GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 371 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:38.583608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10788b64-4c5d-431a-b985-456c038ee2aa tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:38.586889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10788b64-4c5d-431a-b985-456c038ee2aa tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '70349d47f5a24d699b264907f7b6ac3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b52bc6d77d244f48d2d51a05d99e8b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10788b64-4c5d-431a-b985-456c038ee2aa tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Request method failure captured: Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/flavors/974063508/action HTTP/1.1 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 70 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIorSxYaPUPUWtHxDx1usbk6k-JYocS3u14xy8wb3wWqkXvvJ10xjWGzNhdMKFEFU2U3VtBoB-OluxnbAs0wumwYVpn-7A2ssuKej0pzql_3jS7hagjjjSr45wzR6dt-wKV_4wwJP3L_Sx-G5X34N8pShid8iVngtSrIhI0NXFhvCY Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5b52bc6d77d244f48d2d51a05d99e8b3 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:38.590842 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b52bc6d77d244f48d2d51a05d99e8b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5b52bc6d77d244f48d2d51a05d99e8b3 Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176 Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsAccessNegativeTestJSON-2129266176-project Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 70349d47f5a24d699b264907f7b6ac3a Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2129266176-project Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: {"removeTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} Oct 04 17:49:38.592504 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '974063508', 'body': {'removeTenantAccess': {'tenant': '5b52bc6d77d244f48d2d51a05d99e8b3'}}} Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can( Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:38.593116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 04 17:49:38.595950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:38.597346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10788b64-4c5d-431a-b985-456c038ee2aa tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:38.597346 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-10788b64-4c5d-431a-b985-456c038ee2aa tempest-FlavorsAccessNegativeTestJSON-2129266176 tempest-FlavorsAccessNegativeTestJSON-2129266176-project] 10.222.0.42 "POST /compute/v2.1/flavors/974063508/action" status: 403 len: 133 microversion: 2.1 time: 0.019767 Oct 04 17:49:38.597346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 40/121] 10.222.0.42 () {60 vars in 1197 bytes} [Tue Oct 4 17:49:38 2022] POST /compute/v2.1/flavors/974063508/action => generated 133 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:38.605984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:38.606951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:38.615922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.616654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.617297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.618394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.619060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.619887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.752176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Calling method '.version_select at 0x7fbdbe6f49d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:38.758793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.760741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.761801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.785484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.786576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.787318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.859203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.859917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.860365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.890626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.891187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.891650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.942582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:38.947387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:38.948114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:38.957546 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c173d768-b73a-4cbb-8356-65c536685cba tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1761 microversion: 2.53 time: 0.484412 Oct 04 17:49:38.958919 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 82/122] 10.222.0.42 () {60 vars in 1243 bytes} [Tue Oct 4 17:49:38 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1761 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:49:38.971313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe623f70>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:39.282201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:39.293131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3c62dc1-e674-4952-88c6-8531a461797d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.698628 Oct 04 17:49:39.294160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 41/123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:38 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:39.303169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7243756-163a-425b-862e-b32965a2e93b tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5b52bc6d77d244f48d2d51a05d99e8b3"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:39.461928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.463648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.465547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.466502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.474267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.474951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.632994 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7243756-163a-425b-862e-b32965a2e93b tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/974063508/action" status: 200 len: 21 microversion: 2.1 time: 0.333542 Oct 04 17:49:39.633761 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 42/124] 10.222.0.42 () {60 vars in 1197 bytes} [Tue Oct 4 17:49:39 2022] POST /compute/v2.1/flavors/974063508/action => generated 21 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:39.643036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Calling method '.version_select at 0x7fbdbe6135e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:39.660466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.661518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.664278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.708462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.710552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.713542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-555fa08a-e596-4808-9e3f-accef26118fd tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 328 microversion: 2.1 time: 0.751639 Oct 04 17:49:39.725883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 83/125] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:38 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 328 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:39.726142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.771498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.772002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.772502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.792337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.792832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.793265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.839715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.843153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.845632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.860083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28beb088-8cec-4ef3-bf1e-db33f58fda1f tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 451 microversion: 2.53 time: 0.224793 Oct 04 17:49:39.874149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 43/126] 10.222.0.42 () {60 vars in 1222 bytes} [Tue Oct 4 17:49:39 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 451 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:39.885737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:39.891916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:39.905426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=10,nova_api:DELETE=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:39.907800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.908571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.909225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.910223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:39.910819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:39.911373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:39.930587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6929344-7968-4c39-8451-00b97da4f039 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1042109060", "id": 862274580, "os-flavor-access:is_public": "False"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:39.974657 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6929344-7968-4c39-8451-00b97da4f039 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.255710 Oct 04 17:49:39.975234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 84/127] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:39 2022] POST /compute/v2.1/flavors => generated 428 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:39.980233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-688caab3-1385-4777-9ba4-52ac65ae8e8a tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:40.029901 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-688caab3-1385-4777-9ba4-52ac65ae8e8a tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/974063508" status: 202 len: 0 microversion: 2.1 time: 0.050564 Oct 04 17:49:40.031669 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 85/128] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:39 2022] DELETE /compute/v2.1/flavors/974063508 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:40.040969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Calling method '.version_select at 0x7fbdbe53ef70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:40.045811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.046581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.047107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:40.070151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.070834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.071329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:40.082633 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e821c8e3-a696-445d-be5f-d565dd2b5699 tempest-HypervisorAdminV253TestBase-113138189 tempest-HypervisorAdminV253TestBase-113138189-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/d1dc5f2b-d2e8-48a6-8815-3f75d8797d3b" status: 200 len: 794 microversion: 2.53 time: 0.048636 Oct 04 17:49:40.086542 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 86/129] 10.222.0.42 () {60 vars in 1298 bytes} [Tue Oct 4 17:49:40 2022] GET /compute/v2.1/os-hypervisors/d1dc5f2b-d2e8-48a6-8815-3f75d8797d3b => generated 794 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:49:40.200920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1619552796", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:40.292264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:40.310434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c6b1c1b-8583-4e75-9336-67a787ca6206 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.433714 Oct 04 17:49:40.312990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 44/130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:39 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:40.340640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e38d17d7-f6bf-417d-bfc5-d3513f001284 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0d61ab69bfc8418594e1762390961488"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:40.571184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e38d17d7-f6bf-417d-bfc5-d3513f001284 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/862274580/action" status: 200 len: 96 microversion: 2.1 time: 0.256832 Oct 04 17:49:40.571755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 45/131] 10.222.0.42 () {60 vars in 1197 bytes} [Tue Oct 4 17:49:40 2022] POST /compute/v2.1/flavors/862274580/action => generated 96 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:40.604753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fcab56f-eac5-49cb-97d9-79faab39022e tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:40.649002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9fcab56f-eac5-49cb-97d9-79faab39022e tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076057 Oct 04 17:49:40.655121 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 46/132] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:40.668585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:40.669634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:40.681480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.683492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.684085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:40.688235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:40.689474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:40.690227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:41.175574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:41.190722 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c10d87d1-6cb1-4c38-8c70-321fb64e5e9a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.522190 Oct 04 17:49:41.192062 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 47/133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:40 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:41.515818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9f3688e-a62d-4d48-8ef4-a7bbc5aa5fdf tempest-FlavorsAccessTestJSON-900934301 tempest-FlavorsAccessTestJSON-900934301-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:41.570744 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9f3688e-a62d-4d48-8ef4-a7bbc5aa5fdf tempest-FlavorsAccessTestJSON-900934301 tempest-FlavorsAccessTestJSON-900934301-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.377167 Oct 04 17:49:41.585941 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 48/134] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:41 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:41.591033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f16bbc92-68a0-44f1-b234-108d50aff6ea tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1253994231", "id": 1273104286, "os-flavor-access:is_public": "False"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:41.614086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f16bbc92-68a0-44f1-b234-108d50aff6ea tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.026891 Oct 04 17:49:41.614992 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 49/135] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:41 2022] POST /compute/v2.1/flavors => generated 439 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:41.620536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:41.621769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:41.629334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:41.630101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:41.630674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:41.631549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:41.632810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:41.633408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:41.935079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:41.943952 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52e76e37-03fc-4112-af10-e8305a9d8f45 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.327480 Oct 04 17:49:41.960596 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 50/136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:41 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:42.051788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69e10073-a547-4afa-a49d-10a1891d4c27", "tag": "27ddfa21-068c-4ca9-9341-d9c75abc89b9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:42.068686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.069609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.070264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.099820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Creating event network-changed:27ddfa21-068c-4ca9-9341-d9c75abc89b9 for instance 69e10073-a547-4afa-a49d-10a1891d4c27 on n-h1-831194-21 Oct 04 17:49:42.100670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:49:42.101304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81e1cfd7-dcb5-4017-968c-1cb80fbe8dfa req-2aee6ab8-d2f3-4eb6-af6c-bb2c0eeae1e5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:49:42.102669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.103273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.103868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.104801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:42.105743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:42.106538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:42.118989 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.compute.rpcapi [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 17:49:42.120188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] Releasing lock "compute-rpcapi-router" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:49:42.141320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49b41ab3-ed67-4116-9c83-427f268e72df None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193129 Oct 04 17:49:42.142327 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 51/137] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:42.149372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70914085-3af9-46fd-882d-a4c8ff10abbf tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0d61ab69bfc8418594e1762390961488"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:42.539714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70914085-3af9-46fd-882d-a4c8ff10abbf tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/862274580/action" status: 200 len: 21 microversion: 2.1 time: 0.395299 Oct 04 17:49:42.543964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 52/138] 10.222.0.42 () {60 vars in 1197 bytes} [Tue Oct 4 17:49:42 2022] POST /compute/v2.1/flavors/862274580/action => generated 21 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:42.550759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-022e7dff-41ea-4281-a87f-857f801c9abd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "01a40fc1fd274e51ab5ffba2f21027d7"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:42.958961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-022e7dff-41ea-4281-a87f-857f801c9abd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] HTTP exception thrown: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-022e7dff-41ea-4281-a87f-857f801c9abd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Request method failure captured: Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/flavors/1273104286/action HTTP/1.1 Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 70 Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIqRTBvfNmwakq5YvttrTTIZYRVKBeYRRTcVXwmFg40almEnqP-VzeYZtKNT2SpRNadm1TO6-0MtgVe0E-5D3zl7k-S0NZ1hil1ScSskzou2-vCHWg4H8sVXvifuyL9AN8CIMjI-UAuPSE4Zw_-_CLyYfdcCBVupLXoewWF21DSbcE Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:49:42.961777 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_59617ea568a24fb89a4accdcc84dd64b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 59617ea568a24fb89a4accdcc84dd64b Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-896010726 Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 33793a8bdf3e48d3977edad652e4906b Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: {"removeTenantAccess": {"tenant": "01a40fc1fd274e51ab5ffba2f21027d7"}} Oct 04 17:49:42.963176 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: exception: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1273104286', 'body': {'removeTenantAccess': {'tenant': '01a40fc1fd274e51ab5ffba2f21027d7'}}} Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 04 17:49:42.964191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:42.965375 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-022e7dff-41ea-4281-a87f-857f801c9abd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Returning 404 to user: Flavor access not found for 31 / 01a40fc1fd274e51ab5ffba2f21027d7 combination. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-022e7dff-41ea-4281-a87f-857f801c9abd tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1273104286/action" status: 404 len: 124 microversion: 2.1 time: 0.417877 Oct 04 17:49:42.968972 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 53/139] 10.222.0.42 () {60 vars in 1200 bytes} [Tue Oct 4 17:49:42 2022] POST /compute/v2.1/flavors/1273104286/action => generated 124 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:43.057151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b08abdc0-b2de-490b-a4ed-b390524a9426", "tag": "2635c47c-938b-4131-a204-4e622e13984f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:43.072023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.072575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.073172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.079901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:43.093738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] Creating event network-changed:2635c47c-938b-4131-a204-4e622e13984f for instance b08abdc0-b2de-490b-a4ed-b390524a9426 on n-h2-831194-21 Oct 04 17:49:43.099452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-80ca66a0-0718-4a03-b2f7-9d5fccfc0647 req-5b849e92-d258-4571-a24e-beaacff4b81d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129282 Oct 04 17:49:43.100680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 54/140] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:43.109369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:43.110296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:43.119282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.120006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.120627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.121496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.122112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.122678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.725761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:43.735861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-41b1f186-3460-41a0-b19e-bcd83b6021c6 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.633826 Oct 04 17:49:43.740414 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 55/141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:43 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:43.767715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f8be830-2aab-4fb8-bb53-f42695169cbf tempest-FlavorsAccessTestJSON-900934301 tempest-FlavorsAccessTestJSON-900934301-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:43.824101 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f8be830-2aab-4fb8-bb53-f42695169cbf tempest-FlavorsAccessTestJSON-900934301 tempest-FlavorsAccessTestJSON-900934301-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082326 Oct 04 17:49:43.828730 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 56/142] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:43 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:43.833569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:43.840698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:43.859833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.865720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.866412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:43.867289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:43.867883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:43.868454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:44.098956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:44.121883 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8289798e-66cb-4545-85d4-3d1da71ef0eb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.291901 Oct 04 17:49:44.135526 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 57/143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:43 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:44.153096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f199e12f-da69-4376-b518-1cd134e699ae tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.179978 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f199e12f-da69-4376-b518-1cd134e699ae tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1273104286" status: 202 len: 0 microversion: 2.1 time: 0.033424 Oct 04 17:49:44.182053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 58/144] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:44 2022] DELETE /compute/v2.1/flavors/1273104286 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:44.196953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c48ed8d4-9bf3-4157-84ce-d4a03b3c0b0d tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.243353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c48ed8d4-9bf3-4157-84ce-d4a03b3c0b0d tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/862274580" status: 202 len: 0 microversion: 2.1 time: 0.059601 Oct 04 17:49:44.246213 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 59/145] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:49:44 2022] DELETE /compute/v2.1/flavors/862274580 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:44.266785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-027ae2be-ac42-42b2-8664-603153d9fb53 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.363758 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-027ae2be-ac42-42b2-8664-603153d9fb53 tempest-FlavorsAccessNegativeTestJSON-896010726 tempest-FlavorsAccessNegativeTestJSON-896010726-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.109580 Oct 04 17:49:44.383282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 60/146] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:44.394058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac64a2be-934f-4f97-b438-5df1d21b18f1 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.442486 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac64a2be-934f-4f97-b438-5df1d21b18f1 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058241 Oct 04 17:49:44.464024 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 61/147] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:44.471395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1f00e0f-e6f8-4f38-8baf-f0d4ca016f00 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1772385272", "id": 1414510269, "os-flavor-access:is_public": "False"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:44.528972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1f00e0f-e6f8-4f38-8baf-f0d4ca016f00 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.058516 Oct 04 17:49:44.539438 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 62/148] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:44 2022] POST /compute/v2.1/flavors => generated 431 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:44.551870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c452cc59-272c-4d4e-9613-778dfc162397 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.586295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c452cc59-272c-4d4e-9613-778dfc162397 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1414510269/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.044884 Oct 04 17:49:44.599127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 63/149] 10.222.0.42 () {58 vars in 1209 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/flavors/1414510269/os-flavor-access => generated 21 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:44.611733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34147056-4d7d-46f1-82da-a118cd9ef184 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.650631 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34147056-4d7d-46f1-82da-a118cd9ef184 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1414510269" status: 202 len: 0 microversion: 2.1 time: 0.048521 Oct 04 17:49:44.658940 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 64/150] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:44 2022] DELETE /compute/v2.1/flavors/1414510269 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:44.677980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b105e25-b8d8-4102-95ea-a21f3586a312 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.747304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b105e25-b8d8-4102-95ea-a21f3586a312 tempest-FlavorsAccessTestJSON-179394852 tempest-FlavorsAccessTestJSON-179394852-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083299 Oct 04 17:49:44.749301 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 65/151] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:44.793565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:44.796645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:44.816065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.817493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.818904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:44.822108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:44.824383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:44.825751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.265646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:45.276362 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa8b6025-d764-4eb3-9319-5df5ed4c6c2d tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.499548 Oct 04 17:49:45.279744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 66/152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:44 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:45.304876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:45.310038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:45.335653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:45.342263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:45.343139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.344001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:45.344604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:45.346295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:45.667216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:45.685434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f2e338d-f216-4871-bf70-0c2ca0d817ea tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.398896 Oct 04 17:49:45.693330 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 67/153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:45 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:46.306413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:46.307168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:46.339558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.340108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.340881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.346104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.346769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.347367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.667872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:46.678145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd0ea05c-edef-4390-bcbf-82b45b53b580 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.376492 Oct 04 17:49:46.682725 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 68/154] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:46 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:46.713092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:46.713632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:46.728191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.728687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.729123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.729871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:46.730304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:46.730735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:46.954261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:46.968004 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d82e4b6-600c-4c5a-9a14-fc8e16d845e9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.258642 Oct 04 17:49:46.969077 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 69/155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:46 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:47.432903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85e85a5a-0e32-49d5-a757-0b3f984a499e tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] Calling method '.version_select at 0x7fbdbe7be040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:47.454948 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85e85a5a-0e32-49d5-a757-0b3f984a499e tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.484453 Oct 04 17:49:47.462698 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 70/156] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:49:46 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:47.472162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7703ac9-5804-4dc5-82e8-036b525bda67 tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe546790>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:47.657934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=11,nova_api:UPDATE=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:48.053177 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e7703ac9-5804-4dc5-82e8-036b525bda67 tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.588930 Oct 04 17:49:48.064148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 71/157] 10.222.0.42 () {60 vars in 1206 bytes} [Tue Oct 4 17:49:47 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:48.074851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.079260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:48.093337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.094275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.094925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.096875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.099402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.100194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.500888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:48.509595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bd51254-07b0-4cbe-9476-224d6896075a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.443434 Oct 04 17:49:48.510690 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 72/158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:48 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:48.516968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.517729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:48.523927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.524422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.524857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.525869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:48.526363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:48.526779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:48.855399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:48.866685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0bb0eb3-ebb0-45f9-9e74-42ac2a5d034c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.354755 Oct 04 17:49:48.875352 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 73/159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:48 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:48.886134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-645e041c-d419-48c0-8bf4-1c7bc84dbb61 tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] Calling method '.version_select at 0x7fbdbe5e6f70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:48.906089 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-645e041c-d419-48c0-8bf4-1c7bc84dbb61 tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.029064 Oct 04 17:49:48.907080 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 74/160] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:49:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:48.924359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0ab85ee-b4fb-465e-b6bb-86855b1f5a7c tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe4df430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:49.181276 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0ab85ee-b4fb-465e-b6bb-86855b1f5a7c tempest-QuotaClassesAdminTestJSON-20853450 tempest-QuotaClassesAdminTestJSON-20853450-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.263181 Oct 04 17:49:49.192179 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 75/161] 10.222.0.42 () {60 vars in 1206 bytes} [Tue Oct 4 17:49:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:49.533918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:49.534573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:49.540738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:49.544196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.544781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.545190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.550582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.551065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.551498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.561476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:49.696207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:49.832605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:49.843146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1bc502e6-bd0a-4a77-a182-5068389d464e tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.312847 Oct 04 17:49:49.844393 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 76/162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:49 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:49.864134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:49.864559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:49.865155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:49.865559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:49.876643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:49.894171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.894767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.895863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.897123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.898049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.898701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.899350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:49.903321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:49.922574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.923090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.923539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.925247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:49.926670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:49.927365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:49.929344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:49.937792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for user 25d3a6625b0e43129b28859b6e0c4a65 and project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:49.965111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.utils [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] cores quota exceeded for 4d1ec7415c2940048d5338e29e4c807f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128849) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:49:49.967091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Request method failure captured: Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 145 Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIuI30oAkt6LN6HSTjfX8DBdkVkU2A40zVPJw9DLUnE4BAh5OQJVXTHAWKo4xzopsgqlsxydgruVcWm7yHilWC_5lzmJi64POzm-TzQMicoxanKzg6QeV2LlfgVaDPHSOUhrJ8Pn-4uF-qBTrUUa7gWUkwTOVFF1MaToX1Dwlawx4A Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:49.973250 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 25d3a6625b0e43129b28859b6e0c4a65 Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1619552796", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} Oct 04 17:49:49.974841 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1619552796', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452'}}} Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:49:49.975693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:49.976974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.978704 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:49.980858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58697baa-2dce-4502-b826-242a3bc261c6 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 9.892574 Oct 04 17:49:49.981980 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 87/163] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:40 2022] POST /compute/v2.1/servers => generated 111 bytes in 9895 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:49.990620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe54edc0>, body: {"quota_set": {"cores": 20}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:50.236851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:50.251356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d09ab232-04f8-4568-b688-1059fb83470e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.354480 Oct 04 17:49:50.253051 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 77/164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:49 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:50.329144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.329630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.330112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:50.330837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.331289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.331747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:50.462672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=86,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:50.476220 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0a11b30-99f5-4bad-813f-010e7f908bdb tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 329 microversion: 2.1 time: 0.488088 Oct 04 17:49:50.476513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 88/165] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:49 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 329 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:50.499881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b244e84b-b7fe-493a-b618-32b4d1e47022 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Calling method '.version_select at 0x7fbdbe4df310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:50.850760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b244e84b-b7fe-493a-b618-32b4d1e47022 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 371 microversion: 2.1 time: 0.357051 Oct 04 17:49:50.851676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 78/166] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 17:49:50 2022] GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 371 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:50.863797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe4d9af0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:50.868698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:50.869499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:50.878563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.879379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.880115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:50.881016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:50.881592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:50.882267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.043508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:51.053048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37000b4f-1a8f-41cd-a6e9-0fd7a536165a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.188728 Oct 04 17:49:51.054145 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 79/167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:50 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:51.350645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dfa9d056-51d3-4d84-8b54-50b09a700c87 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:51.355223 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-dfa9d056-51d3-4d84-8b54-50b09a700c87 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dfa9d056-51d3-4d84-8b54-50b09a700c87 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin] Request method failure captured: Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHI-DO1_4s7sCnHYA9RhN3Qc2JvHvFSC6bWur2-ziK5LX2z-_3qvtTm2tSow4FTAV2L7UFKv8ynprtFYBSTrV67rV0UP1VhzIU9XmGpQmyCPtX2WnsXOBFMeor0NMEM6P1babt7haqJkUsgdPJIm2U-ecDsHCMBRFoxZqSFDXMsFkgw Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5cf12c309bc64e38b04c1f4733923cdc Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:49:51.363812 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5cf12c309bc64e38b04c1f4733923cdc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5cf12c309bc64e38b04c1f4733923cdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5cf12c309bc64e38b04c1f4733923cdc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5cf12c309bc64e38b04c1f4733923cdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5cf12c309bc64e38b04c1f4733923cdc Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 1683b45b8def496e897d5fef7df36f09 Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:51.365452 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid timestamp for date invalid_time Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'invalid_time'} Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:51.366230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.367367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dfa9d056-51d3-4d84-8b54-50b09a700c87 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:51.368453 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dfa9d056-51d3-4d84-8b54-50b09a700c87 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324 tempest-InstanceUsageAuditLogNegativeTestJSON-1659122324-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.285477 Oct 04 17:49:51.374266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 80/168] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Oct 4 17:49:51 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 293 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 17:49:51.378543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.379039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.379532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.380274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.380735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.381168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.381640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:51.382400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:51.390660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.391276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.391936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.393067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:51.393733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:51.394697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:51.474787 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ca343aa-d48a-43ce-889f-deb3818d68b6 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 328 microversion: 2.1 time: 0.615173 Oct 04 17:49:51.475628 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 89/169] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:50 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 328 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:51.580345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:51.589429 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a9f9faf-a521-4ded-9acc-69466950baa9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.213347 Oct 04 17:49:51.590393 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 81/170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:51 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:51.705601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-544387142", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:51.731447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff9ee571-dfe0-4ac6-b083-083d2fc5930e tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:51.733996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff9ee571-dfe0-4ac6-b083-083d2fc5930e tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '60c301349d654f80af1c4e43a9559f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35dc09478a74259877a2bece6d5ff86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff9ee571-dfe0-4ac6-b083-083d2fc5930e tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Request method failure captured: Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHI9el6ci89ixAQRDmG_3yo_QoNGe4mXs4IdnRU_AR5h3NJkGcHI4sp4_5sx_-g7RNCctGCg2BqQrpGm1nn78aoDe1GztCeM5WWogIPdKFm2Ka5oml4RrrqwLfCe0qZNAdzkmzG-cZ8mYQ4ww7RAdDHZ_SDNg6FsOW9SYQjrlmJwsic Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b35dc09478a74259877a2bece6d5ff86 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:51.735452 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b35dc09478a74259877a2bece6d5ff86 Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 60c301349d654f80af1c4e43a9559f8e Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project Oct 04 17:49:51.736691 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:51.737300 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 04 17:49:51.738456 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.739392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff9ee571-dfe0-4ac6-b083-083d2fc5930e tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:51.739392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff9ee571-dfe0-4ac6-b083-083d2fc5930e tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.260083 Oct 04 17:49:51.739522 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 90/171] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:49:51 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:51.754659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58ae6588-9ad3-4f7e-a799-ba33f5d60451 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:51.756747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58ae6588-9ad3-4f7e-a799-ba33f5d60451 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '60c301349d654f80af1c4e43a9559f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b35dc09478a74259877a2bece6d5ff86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58ae6588-9ad3-4f7e-a799-ba33f5d60451 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Request method failure captured: Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017:49:51 HTTP/1.1 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHI9el6ci89ixAQRDmG_3yo_QoNGe4mXs4IdnRU_AR5h3NJkGcHI4sp4_5sx_-g7RNCctGCg2BqQrpGm1nn78aoDe1GztCeM5WWogIPdKFm2Ka5oml4RrrqwLfCe0qZNAdzkmzG-cZ8mYQ4ww7RAdDHZ_SDNg6FsOW9SYQjrlmJwsic Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b35dc09478a74259877a2bece6d5ff86 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:49:51.759220 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b35dc09478a74259877a2bece6d5ff86"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b35dc09478a74259877a2bece6d5ff86 Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 60c301349d654f80af1c4e43a9559f8e Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project Oct 04 17:49:51.760278 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2022-10-04 17:49:51'} Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:51.760945 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 04 17:49:51.762049 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:49:51.762969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58ae6588-9ad3-4f7e-a799-ba33f5d60451 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:51.762969 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58ae6588-9ad3-4f7e-a799-ba33f5d60451 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033 tempest-InstanceUsageAuditLogNegativeTestJSON-1469710033-project] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 17:49:51" status: 403 len: 128 microversion: 2.1 time: 0.017498 Oct 04 17:49:51.762969 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 91/172] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 17:49:51 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017%3A49%3A51 => generated 128 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:51.772218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:51.997787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:51.998987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:51.999795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:52.000509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:52.001103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:52.012093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.012658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.013392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.015049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.015544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.016158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.036977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:52.046085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for user 25d3a6625b0e43129b28859b6e0c4a65 and project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:52.060525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.utils [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] instances quota exceeded for 4d1ec7415c2940048d5338e29e4c807f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128850) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:49:52.062334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Request method failure captured: Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 144 Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIuI30oAkt6LN6HSTjfX8DBdkVkU2A40zVPJw9DLUnE4BAh5OQJVXTHAWKo4xzopsgqlsxydgruVcWm7yHilWC_5lzmJi64POzm-TzQMicoxanKzg6QeV2LlfgVaDPHSOUhrJ8Pn-4uF-qBTrUUa7gWUkwTOVFF1MaToX1Dwlawx4A Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:52.066525 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 25d3a6625b0e43129b28859b6e0c4a65 Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-544387142", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} Oct 04 17:49:52.067964 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-544387142', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452'}}} Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:49:52.068755 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.069935 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.071015 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:52.072500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-046ee38d-bf19-4ca6-a7a3-ff843f779819 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.371736 Oct 04 17:49:52.074232 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 82/173] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:51 2022] POST /compute/v2.1/servers => generated 119 bytes in 377 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:52.081595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.082833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:52.084615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe409160>, body: {"quota_set": {"instances": 10}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:52.093547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.094337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.095261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.096465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.096931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.097361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.271204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:52.280937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c15ea8ab-5d5e-4277-a40b-5e80d565dc39 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.205535 Oct 04 17:49:52.281925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 92/174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:52.469438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.470573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.471155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.471903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.472353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.472774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.577439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=73,nova_api:UPDATE=21 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:52.593432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a137400-13a4-4093-a112-470fc395b418 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 329 microversion: 2.1 time: 0.518188 Oct 04 17:49:52.594568 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 83/175] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:52 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 329 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:52.610936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ffc4eed-c621-4a1f-a6be-8ccf59ed7981 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Calling method '.version_select at 0x7fbdbe4d9e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.627064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:52.627773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:52.635365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.636083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.636813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.637707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:52.638332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:52.639291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:52.789382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:52.806356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eaa9402f-fd44-4fa8-89a5-7364766f4a43 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.184786 Oct 04 17:49:52.806986 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 84/176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:53.032192 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ffc4eed-c621-4a1f-a6be-8ccf59ed7981 tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 371 microversion: 2.1 time: 0.427791 Oct 04 17:49:53.034156 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 93/177] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 17:49:52 2022] GET /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 371 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:53.048058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe41c940>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:53.304573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:53.305180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:53.320603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.321288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.321928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.323132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.323594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.324020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.593970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:53.605503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bb6a00a8-dc36-42e7-b962-91c57cc15a65 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.304563 Oct 04 17:49:53.606314 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 94/178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:53 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:53.773966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.774747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.775354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.776245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.777095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.777686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.861407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c15a5524-c627-4846-858b-ec52be181f5e tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 325 microversion: 2.1 time: 0.819608 Oct 04 17:49:53.870453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 85/179] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:53 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 325 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:53.884727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:53.885774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:53.894320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.894936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.895380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.897541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:53.898043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:53.898656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:53.917964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8d6816f-d1db-4a35-a0a0-f2f98313481c tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-881593587", "ram": 512, "vcpus": 1, "disk": 10, "id": 1706200823, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:53.957174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8d6816f-d1db-4a35-a0a0-f2f98313481c tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.347392 Oct 04 17:49:53.959656 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 95/180] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:53 2022] POST /compute/v2.1/flavors => generated 415 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:53.979774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e9fd4b3-4a6f-4cb9-8fcd-11b025f216f0 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.025362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e9fd4b3-4a6f-4cb9-8fcd-11b025f216f0 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.053990 Oct 04 17:49:54.030010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 96/181] 10.222.0.42 () {60 vars in 1224 bytes} [Tue Oct 4 17:49:53 2022] POST /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.054699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:54.064926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e3e7d81f-70b8-4004-b3e2-bd5307a15cb9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.192163 Oct 04 17:49:54.074235 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 86/182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:53 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:54.150145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-393199049", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.208203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:54.296216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-195dea38-eb47-4f21-9aa2-e7ae23c2db7c tempest-FlavorsExtraSpecsTestJSON-1924993535 tempest-FlavorsExtraSpecsTestJSON-1924993535-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.306586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-195dea38-eb47-4f21-9aa2-e7ae23c2db7c tempest-FlavorsExtraSpecsTestJSON-1924993535 tempest-FlavorsExtraSpecsTestJSON-1924993535-project] 10.222.0.42 "GET /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.271635 Oct 04 17:49:54.307885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 97/183] 10.222.0.42 () {58 vars in 1203 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:49:54.322560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f47628a-8f87-411e-8736-ba5c5b42ae09 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.362098 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f47628a-8f87-411e-8736-ba5c5b42ae09 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046520 Oct 04 17:49:54.363320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 98/184] 10.222.0.42 () {60 vars in 1224 bytes} [Tue Oct 4 17:49:54 2022] POST /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.375228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c902656c-283b-4ca8-a414-4f56b8be0075 tempest-FlavorsExtraSpecsTestJSON-1924993535 tempest-FlavorsExtraSpecsTestJSON-1924993535-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.384933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c902656c-283b-4ca8-a414-4f56b8be0075 tempest-FlavorsExtraSpecsTestJSON-1924993535 tempest-FlavorsExtraSpecsTestJSON-1924993535-project] 10.222.0.42 "GET /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015767 Oct 04 17:49:54.385688 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 99/185] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.396090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d685c1d-a3d8-41c8-b3dc-93cf8400681b tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.427087 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d685c1d-a3d8-41c8-b3dc-93cf8400681b tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034733 Oct 04 17:49:54.432371 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 100/186] 10.222.0.42 () {60 vars in 1224 bytes} [Tue Oct 4 17:49:54 2022] POST /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:49:54.438072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5b84beb-4a84-4e0f-b66e-e9cb7c11ea18 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.446188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5b84beb-4a84-4e0f-b66e-e9cb7c11ea18 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012624 Oct 04 17:49:54.452214 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 101/187] 10.222.0.42 () {58 vars in 1203 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.453908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:54.454355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:54.454847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:54.455252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:54.455668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:54.457551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a4808d6-3e3c-47dc-8e95-71b51aff1268 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.469183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.470003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.470666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.471849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.473089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.474103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.500758 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a4808d6-3e3c-47dc-8e95-71b51aff1268 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.047185 Oct 04 17:49:54.501979 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 102/188] 10.222.0.42 () {60 vars in 1265 bytes} [Tue Oct 4 17:49:54 2022] PUT /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes => generated 22 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.503783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:54.509444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Getting quotas for user 25d3a6625b0e43129b28859b6e0c4a65 and project 4d1ec7415c2940048d5338e29e4c807f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:54.512433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd463d9e-e51b-42be-9e45-329bd1410a97 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.524390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.utils [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] ram quota exceeded for 4d1ec7415c2940048d5338e29e4c807f, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128850) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 04 17:49:54.525014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:49:54.525796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd463d9e-e51b-42be-9e45-329bd1410a97 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.018418 Oct 04 17:49:54.527067 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 103/189] 10.222.0.42 () {58 vars in 1203 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/flavors/1706200823/os-extra_specs => generated 66 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Request method failure captured: Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 144 Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIuI30oAkt6LN6HSTjfX8DBdkVkU2A40zVPJw9DLUnE4BAh5OQJVXTHAWKo4xzopsgqlsxydgruVcWm7yHilWC_5lzmJi64POzm-TzQMicoxanKzg6QeV2LlfgVaDPHSOUhrJ8Pn-4uF-qBTrUUa7gWUkwTOVFF1MaToX1Dwlawx4A Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:54.527792 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 25d3a6625b0e43129b28859b6e0c4a65 Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-393199049", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} Oct 04 17:49:54.528984 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-393199049', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452'}}} Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 17:49:54.530297 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.531320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.532373 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:54.533426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f2b6a9e3-23fc-4f8f-a92c-5d04004f4774 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.383556 Oct 04 17:49:54.535030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 87/190] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:54 2022] POST /compute/v2.1/servers => generated 110 bytes in 389 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:49:54.541474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe3b9040>, body: {"quota_set": {"ram": 51200}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:54.543428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87af3c7b-f4bf-4708-8548-15f48dd72545 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.589880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87af3c7b-f4bf-4708-8548-15f48dd72545 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.050719 Oct 04 17:49:54.593944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 104/191] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 17:49:54 2022] DELETE /compute/v2.1/flavors/1706200823/os-extra_specs/hw:numa_nodes => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:54.602107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d6e4b0f-3cf7-4ef3-b1d1-172db6d03a23 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.626755 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d6e4b0f-3cf7-4ef3-b1d1-172db6d03a23 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1706200823/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.030962 Oct 04 17:49:54.627670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 105/192] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 17:49:54 2022] DELETE /compute/v2.1/flavors/1706200823/os-extra_specs/hw:cpu_policy => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:49:54.632466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.633455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:54.642235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.642834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.643391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.644381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.645124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.645799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.888443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:54.905783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be801136-9495-41d3-9ad3-528e4096e001 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.276597 Oct 04 17:49:54.907926 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 106/193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:54.937800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72911e75-d557-4156-bcad-cd85610a912c tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.958748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72911e75-d557-4156-bcad-cd85610a912c tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/1706200823/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.048597 Oct 04 17:49:54.958886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.959716 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 107/194] 10.222.0.42 () {58 vars in 1203 bytes} [Tue Oct 4 17:49:54 2022] GET /compute/v2.1/flavors/1706200823/os-extra_specs => generated 19 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:49:54.965214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.965214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.965214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:54.965214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:54.966212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:54.973943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72cf74e0-bb5b-491f-9e4d-631a534f33bc tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:54.979169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4,nova_api:SAVEPOINT=9,nova_api:RELEASE=9,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:55.012884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72cf74e0-bb5b-491f-9e4d-631a534f33bc tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1706200823" status: 202 len: 0 microversion: 2.1 time: 0.043386 Oct 04 17:49:55.014583 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 108/195] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:49:54 2022] DELETE /compute/v2.1/flavors/1706200823 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:49:55.023794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59cfa70a-37b6-4f92-b203-f335da0ec717 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:55.057229 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59cfa70a-37b6-4f92-b203-f335da0ec717 tempest-FlavorsExtraSpecsTestJSON-1872602822 tempest-FlavorsExtraSpecsTestJSON-1872602822-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037143 Oct 04 17:49:55.057911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 109/196] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:49:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:55.094427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:55.095046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:55.108873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.109366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.115315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04eaadc0-5a8a-4704-b308-a23d469470ae tempest-QuotasAdminNegativeTest-1356416705 tempest-QuotasAdminNegativeTest-1356416705-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 200 len: 329 microversion: 2.1 time: 0.578675 Oct 04 17:49:55.117145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.119502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.119989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.120423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.125098 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 88/197] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:54 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 329 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:55.127842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=79 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:55.141709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b189f51-5e91-40d1-b880-f2cd3766cb13 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Action: 'update', calling method: .version_select at 0x7fbdbe546d30>, body: {"quota_set": {"ram": 0}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:55.148887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b189f51-5e91-40d1-b880-f2cd3766cb13 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '25d3a6625b0e43129b28859b6e0c4a65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d1ec7415c2940048d5338e29e4c807f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b189f51-5e91-40d1-b880-f2cd3766cb13 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Request method failure captured: Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f HTTP/1.1 Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 25 Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIuI30oAkt6LN6HSTjfX8DBdkVkU2A40zVPJw9DLUnE4BAh5OQJVXTHAWKo4xzopsgqlsxydgruVcWm7yHilWC_5lzmJi64POzm-TzQMicoxanKzg6QeV2LlfgVaDPHSOUhrJ8Pn-4uF-qBTrUUa7gWUkwTOVFF1MaToX1Dwlawx4A Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:49:55.153803 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4d1ec7415c2940048d5338e29e4c807f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4d1ec7415c2940048d5338e29e4c807f Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-924269120 Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 25d3a6625b0e43129b28859b6e0c4a65 Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-QuotasAdminNegativeTest-924269120-project Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: {"quota_set": {"ram": 0}} Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:49:55.155810 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4d1ec7415c2940048d5338e29e4c807f', 'body': {'quota_set': {'ram': 0}}} Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:49:55.156731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:55.158010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:49:55.159399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b189f51-5e91-40d1-b880-f2cd3766cb13 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:49:55.160187 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b189f51-5e91-40d1-b880-f2cd3766cb13 tempest-QuotasAdminNegativeTest-924269120 tempest-QuotasAdminNegativeTest-924269120-project] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f" status: 403 len: 116 microversion: 2.1 time: 0.023530 Oct 04 17:49:55.162111 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 89/198] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:49:55 2022] PUT /compute/v2.1/os-quota-sets/4d1ec7415c2940048d5338e29e4c807f => generated 116 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:49:55.333155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:55.345779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d547505-3352-4974-b4c4-fbd20615f008 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.256104 Oct 04 17:49:55.349341 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 110/199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:55 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:55.909707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e10073-a547-4afa-a49d-10a1891d4c27", "name": "network-vif-plugged", "status": "completed", "tag": "27ddfa21-068c-4ca9-9341-d9c75abc89b9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:55.928898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.931799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.932307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.934350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:55.934969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:55.945759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.946290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.946880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.947888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:55.948348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:55.948771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:55.958791 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] Creating event network-vif-plugged:27ddfa21-068c-4ca9-9341-d9c75abc89b9 for instance 69e10073-a547-4afa-a49d-10a1891d4c27 on n-h1-831194-21 Oct 04 17:49:55.965881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a21bede0-e242-4722-84e1-548f50c4a289 req-6fa81e14-a46d-4488-8f3d-8f21d12444bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149803 Oct 04 17:49:55.967356 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 90/200] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:56.206925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:56.222042 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1db8cb05-288d-43a8-9f7f-fecab50cea0b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.293468 Oct 04 17:49:56.222861 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 111/201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:55 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:56.375326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:56.376100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:56.386792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.387333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.388134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.389024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:56.389885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:56.390446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:56.428917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:49:56.686966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:56.699430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e665fc4e-8d15-408e-b6ca-0193cdd236c5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.332678 Oct 04 17:49:56.701576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 91/202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:56 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:56.869615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33839a41-bb25-4c1a-aabb-dd877d2bf222 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] Action: 'create', calling method: .version_select at 0x7fbdbe4c2dc0>, body: {"security_group": {"name": "tempest-securitygroup-561832971", "description": "tempest-description-2011044229"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:57.139956 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33839a41-bb25-4c1a-aabb-dd877d2bf222 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.554977 Oct 04 17:49:57.140733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 112/203] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:49:56 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:57.153282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03e05608-f5f0-434e-b9f2-0d629f0664bd tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] Action: 'create', calling method: .version_select at 0x7fbdbe41cf70>, body: {"security_group": {"name": "tempest-securitygroup-128258373", "description": "tempest-description-2040859469"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:57.256032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:57.256981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:57.269307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:57.270370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:57.271139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:57.272450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:57.273197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:57.273845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:57.409484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03e05608-f5f0-434e-b9f2-0d629f0664bd tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.258986 Oct 04 17:49:57.421858 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 92/204] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:49:57 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:57.507082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.521083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed8d13c9-1ec8-4617-a12f-eb60755ba5ef tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1337 microversion: 2.1 time: 0.274009 Oct 04 17:49:57.522196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 113/205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:57 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1337 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:57.727849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:57.728856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:57.744950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:57.745471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:57.746992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:57.748000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:57.748492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:57.748915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:57.863375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b26caedf-19a7-4cfe-8353-031b9f081c3e tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] Action: 'create', calling method: .version_select at 0x7fbdbe41c790>, body: {"security_group": {"name": "tempest-securitygroup-1890794024", "description": "tempest-description-439738898"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:57.968574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:57.978369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db603fee-fa89-4039-967b-af4b2668ba44 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.255098 Oct 04 17:49:57.979832 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 114/206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:57 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:58.001449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08abdc0-b2de-490b-a4ed-b390524a9426", "name": "network-vif-plugged", "status": "completed", "tag": "2635c47c-938b-4131-a204-4e622e13984f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:58.028862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.029323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.029759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.053280 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Creating event network-vif-plugged:2635c47c-938b-4131-a204-4e622e13984f for instance b08abdc0-b2de-490b-a4ed-b390524a9426 on n-h2-831194-21 Oct 04 17:49:58.053554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:49:58.053986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ed42783e-7a9b-43fa-a0ba-5c14d6ee1290 req-9b5ced26-b63e-4dd4-aac6-cec6c0a3efac service nova] Acquired lock "compute-rpcapi-router" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:49:58.055042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.055499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.056002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.056629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.057082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.057534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.067687 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.rpcapi [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 04 17:49:58.068579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] Releasing lock "compute-rpcapi-router" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:49:58.094230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b51788d-1bd9-4ff7-8764-3f2e475e162a None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095287 Oct 04 17:49:58.102899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 115/207] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:58.268012 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b26caedf-19a7-4cfe-8353-031b9f081c3e tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.836408 Oct 04 17:49:58.277867 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 93/208] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:49:57 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:49:58.284328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-341d1539-35c5-40b1-87e2-797fb994b37b tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] Action: 'create', calling method: .version_select at 0x7fbdbe4daa60>, body: {"security_group": {"name": "tempest-securitygroup-1802398727", "description": "tempest-description-1881951042"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:58.530838 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-341d1539-35c5-40b1-87e2-797fb994b37b tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.251781 Oct 04 17:49:58.542339 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 116/209] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:49:58 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:49:58.544437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26cfea78-097a-4e33-b165-60765b427a3a tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] Calling method '.version_select at 0x7fbdbe3b9430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:58.563214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:58.564210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:58.571510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.572247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.572932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.573966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.574561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.575125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.735405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:58.745530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d4fb6b7f-1560-4f60-bd30-961c208cac16 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1487 microversion: 2.1 time: 0.186735 Oct 04 17:49:58.746492 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 117/210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:58 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1487 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:49:58.771734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:58.772483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:58.782503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.782707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.783439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:58.784293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:58.786668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:58.787794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.131232 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e41ff933-0de4-4261-8e13-30c6559e1591 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1640 microversion: 2.1 time: 0.364266 Oct 04 17:49:59.132783 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 118/211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:58 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1640 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:59.448911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2083793298", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:49:59.511746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:49:59.548497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26cfea78-097a-4e33-b165-60765b427a3a tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 5632 microversion: 2.1 time: 1.007694 Oct 04 17:49:59.549410 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 94/212] 10.222.0.42 () {58 vars in 1191 bytes} [Tue Oct 4 17:49:58 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 5632 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:59.557068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:59.557683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:59.567389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.568386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.570461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.573241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.574575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.575830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.767023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:49:59.776327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:49:59.776858 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16924af1-4b2b-4608-9344-35382e1e1d3d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1320 microversion: 2.1 time: 0.223241 Oct 04 17:49:59.776980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:49:59.777546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:49:59.777816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:49:59.778257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:49:59.779620 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 95/213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:49:59 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1320 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:49:59.786697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:59.787403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:49:59.793670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.794960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.795790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.796483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.797037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.797457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.810778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.811308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.812054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.812961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:49:59.813587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:49:59.814226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:49:59.830353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:49:59.838214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:49:59.854698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for user 2bb5f950cb1544818f9329360b84865a and project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:49:59.869443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:49:59.873659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:49:59.953329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10bb7a5d-2096-40f0-9399-c7c481de0a9f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.819465 Oct 04 17:49:59.965928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 119/214] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:49:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:49:59.971341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-793e4cf6-2086-4aaf-b555-38402288aeca tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] Calling method '.version_select at 0x7fbdbe4d9af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:49:59.994778 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e74fa8b9-94a4-46fd-a5e4-bc1bc4087bf0 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 204 len: 0 microversion: 2.1 time: 0.211338 Oct 04 17:50:00.000428 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 96/215] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:49:59 2022] DELETE /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:00.014066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:00.014956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:00.026804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:00.027605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:00.028495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:00.030618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:00.031382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:00.031969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:00.272028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:00.283456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e3f4fff-368e-4881-907c-b4377fe62f2a tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1493 microversion: 2.1 time: 0.281737 Oct 04 17:50:00.284583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 97/216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:00 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1493 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:00.289734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-443194349", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:00.330693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-793e4cf6-2086-4aaf-b555-38402288aeca tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.370662 Oct 04 17:50:00.331268 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 120/217] 10.222.0.42 () {58 vars in 1191 bytes} [Tue Oct 4 17:49:59 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:00.386885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:00.622371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:00.623870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:00.624325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:00.624732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:00.625137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:00.632131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=82,nova_cell0:UPDATE=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:00.634862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:00.635338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:00.635931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:00.636666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:00.637123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:00.637565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:00.645295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=23 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:00.659262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:00.664821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for user 2bb5f950cb1544818f9329360b84865a and project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:00.677891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-593778990", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:00.679494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:00.681761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:00.728910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7f480ca-0a58-4661-bb20-d6e601f7e22c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.442993 Oct 04 17:50:00.729517 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 98/218] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 444 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:00.735368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-629d5b99-9316-4756-b9ee-c9dca65b5049 tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] Calling method '.version_select at 0x7fbdbe4f3ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:00.756360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:00.928398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-629d5b99-9316-4756-b9ee-c9dca65b5049 tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/c43328e7-9ca5-4ccf-9c32-ffcc13d478a5" status: 202 len: 0 microversion: 2.1 time: 0.197418 Oct 04 17:50:00.928999 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 99/219] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:00 2022] DELETE /compute/v2.1/os-security-groups/c43328e7-9ca5-4ccf-9c32-ffcc13d478a5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:01.001866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:01.002289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:01.002768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:01.003178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:01.003607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:01.012844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.013906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.014669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.015112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.015725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.016444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Calling method '.version_select at 0x7fbdbe4f39d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.016712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.020767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.021268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.021686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.022448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.026105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.026996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.058845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d4b529e-77ba-410a-b9cf-65133c0a78bf tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.128807 Oct 04 17:50:01.060036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Getting quotas for project ed552cf81af742b7b2f9fa7c78d95b99. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:01.060319 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 100/220] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:50:00 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:01.066294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Getting quotas for user 205d19e5e5fe4781aa8a1bde57a126ec and project ed552cf81af742b7b2f9fa7c78d95b99. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:01.067696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf61b206-267c-4e09-9ebe-e253e323f1d0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.068410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf61b206-267c-4e09-9ebe-e253e323f1d0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.083097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:01.085480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:01.145721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28c0d461-d77a-4c2f-85bf-8d38048a94a1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.813279 Oct 04 17:50:01.146839 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 121/221] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:01.151626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.152407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.160795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf61b206-267c-4e09-9ebe-e253e323f1d0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.160940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.161416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.161878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.162593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.163470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.164080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.175590 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf61b206-267c-4e09-9ebe-e253e323f1d0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1213 microversion: 2.1 time: 0.113116 Oct 04 17:50:01.176300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 101/222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:01.190091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-738b6ed7-ab84-4802-b593-ddcc85696d6f tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] Calling method '.version_select at 0x7fbdbe4f3940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.340198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.349690 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33bfa602-81f8-4357-ab75-030b4da1f336 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1470 microversion: 2.1 time: 0.201548 Oct 04 17:50:01.350536 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 122/223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1470 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:01.500865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-049311db-2a4d-4353-9786-a091bf9b74d5 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Calling method '.version_select at 0x7fbdbe4c2ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.509298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-049311db-2a4d-4353-9786-a091bf9b74d5 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-049311db-2a4d-4353-9786-a091bf9b74d5 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:01.525180 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:50:01.526666 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:01.527525 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 04 17:50:01.528686 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:01.539636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-049311db-2a4d-4353-9786-a091bf9b74d5 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:01.541291 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-049311db-2a4d-4353-9786-a091bf9b74d5 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.189780 Oct 04 17:50:01.546821 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 123/224] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 196 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:01.557580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4aadfa87-64bb-40d0-b750-e927cb71da33 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.558578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4aadfa87-64bb-40d0-b750-e927cb71da33 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.625337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4aadfa87-64bb-40d0-b750-e927cb71da33 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:01.640765 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4aadfa87-64bb-40d0-b750-e927cb71da33 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1222 microversion: 2.1 time: 0.084411 Oct 04 17:50:01.646849 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 124/225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1222 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:01.654231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.655102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.678161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.678947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.679542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.681185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:01.681799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:01.682617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:01.801097 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-738b6ed7-ab84-4802-b593-ddcc85696d6f tempest-SecurityGroupsTestAdminJSON-1596118620 tempest-SecurityGroupsTestAdminJSON-1596118620-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b8f0eeed-a0e2-4457-8696-1716e988303d" status: 202 len: 0 microversion: 2.1 time: 0.623544 Oct 04 17:50:01.803640 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 102/226] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:01 2022] DELETE /compute/v2.1/os-security-groups/b8f0eeed-a0e2-4457-8696-1716e988303d => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:01.990837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:01.991367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:01.999801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.000386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.001748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.002597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.003167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.003687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.108009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.122294 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1745185-3bcc-42bb-b82c-ca59e12c370b tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1493 microversion: 2.1 time: 0.472007 Oct 04 17:50:02.126446 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 125/227] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:01 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1493 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:02.137247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0e00170-9d0b-4733-b769-317abbfac300 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Calling method '.version_select at 0x7fbdbe469b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.146686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0e00170-9d0b-4733-b769-317abbfac300 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0e00170-9d0b-4733-b769-317abbfac300 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hosts/n-d-831194-21/reboot HTTP/1.1 Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:02.150620 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'n-d-831194-21'} Oct 04 17:50:02.151828 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:02.152523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 04 17:50:02.154132 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.155133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0e00170-9d0b-4733-b769-317abbfac300 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:02.155874 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0e00170-9d0b-4733-b769-317abbfac300 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-831194-21/reboot" status: 403 len: 111 microversion: 2.1 time: 0.028111 Oct 04 17:50:02.162529 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 126/228] 10.222.0.42 () {58 vars in 1191 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/os-hosts/n-d-831194-21/reboot => generated 111 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:02.181427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d557d1e-253d-4372-adb4-4c18447f3473 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] Calling method '.version_select at 0x7fbdbe444ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.275752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:50:02.443671 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a496b93-b51c-4fde-a833-26082ac7a29b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 204 len: 0 microversion: 2.1 time: 0.638989 Oct 04 17:50:02.445357 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 103/229] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:01 2022] DELETE /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:02.452227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed11553-8239-476f-b720-4ade3a1ef831 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Calling method '.version_select at 0x7fbdbe4f3280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.463611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5ed11553-8239-476f-b720-4ade3a1ef831 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed11553-8239-476f-b720-4ade3a1ef831 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:02.488716 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:50:02.490268 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:02.491423 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:50:02.493114 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:02.494452 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.497083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed11553-8239-476f-b720-4ade3a1ef831 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:02.499932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ed11553-8239-476f-b720-4ade3a1ef831 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.053128 Oct 04 17:50:02.500567 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 104/230] 10.222.0.42 () {58 vars in 1212 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:02.507300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.508280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:02.511355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:UPDATE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:02.520122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.521182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.521631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.522376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.522833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.523262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.637029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.647479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a743f527-9d25-4512-af64-aa85027a9c39 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1265 microversion: 2.1 time: 0.145554 Oct 04 17:50:02.649329 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 105/231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:02.656000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.656753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:02.666327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.666858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.667349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.668206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.668991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.669908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.677682 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d557d1e-253d-4372-adb4-4c18447f3473 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/76770b69-d362-4069-be5c-91d05a28874a" status: 202 len: 0 microversion: 2.1 time: 0.514110 Oct 04 17:50:02.678885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 127/232] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:02 2022] DELETE /compute/v2.1/os-security-groups/76770b69-d362-4069-be5c-91d05a28874a => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:02.685216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69e10073-a547-4afa-a49d-10a1891d4c27", "name": "network-vif-deleted", "tag": "27ddfa21-068c-4ca9-9341-d9c75abc89b9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:02.708606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.717093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.717808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.733341 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] Creating event network-vif-deleted:27ddfa21-068c-4ca9-9341-d9c75abc89b9 for instance 69e10073-a547-4afa-a49d-10a1891d4c27 on n-h1-831194-21 Oct 04 17:50:02.755154 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e7110bc3-6666-4791-89be-14382c18992f req-53f96567-e4c6-438d-a1fe-2038dbb610ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074590 Oct 04 17:50:02.756176 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 128/233] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:02.762453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bec38da-302f-471f-ae99-205242f631aa tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Calling method '.version_select at 0x7fbdbe4c2af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.765540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6bec38da-302f-471f-ae99-205242f631aa tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bec38da-302f-471f-ae99-205242f631aa tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hosts/n-d-831194-21 HTTP/1.1 Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:02.768169 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'n-d-831194-21'} Oct 04 17:50:02.769368 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:02.772435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 04 17:50:02.773490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:02.774419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bec38da-302f-471f-ae99-205242f631aa tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:02.774419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6bec38da-302f-471f-ae99-205242f631aa tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-831194-21" status: 403 len: 109 microversion: 2.1 time: 0.012021 Oct 04 17:50:02.774419 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 129/234] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/os-hosts/n-d-831194-21 => generated 109 bytes in 14 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:02.782377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.783536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:02.792406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.793200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.793962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.795503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:02.796091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:02.796536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:02.898271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:02.909568 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36db5b45-0916-470c-bb4d-2acdc5155382 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1303 microversion: 2.1 time: 0.132147 Oct 04 17:50:02.914211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 130/235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:02.924423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-541962b4-2aae-497e-87f2-eeb8883fe781 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] Calling method '.version_select at 0x7fbdbe671f70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:02.992370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.008570 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a8d008b-93f6-469a-9494-23b8e4a5e43b tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1476 microversion: 2.1 time: 0.358387 Oct 04 17:50:03.009268 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 106/236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:02 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1476 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:03.014748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d51be7cd-9905-4c09-9a02-caddfc99c309 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Calling method '.version_select at 0x7fbdbe4f78b0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.027283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d51be7cd-9905-4c09-9a02-caddfc99c309 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d51be7cd-9905-4c09-9a02-caddfc99c309 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.029595 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:50:03.031022 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.031868 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.033067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.035641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d51be7cd-9905-4c09-9a02-caddfc99c309 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.036504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d51be7cd-9905-4c09-9a02-caddfc99c309 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025982 Oct 04 17:50:03.037870 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 107/237] 10.222.0.42 () {58 vars in 1191 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:03.052016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98ec05fd-9d21-401b-bba4-18af63a6812f tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Calling method '.version_select at 0x7fbdbe333040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.054828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98ec05fd-9d21-401b-bba4-18af63a6812f tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98ec05fd-9d21-401b-bba4-18af63a6812f tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/n-d-831194-21/shutdown HTTP/1.1 Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:03.058400 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'n-d-831194-21'} Oct 04 17:50:03.060104 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.061133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 04 17:50:03.062397 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.063530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98ec05fd-9d21-401b-bba4-18af63a6812f tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.063860 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98ec05fd-9d21-401b-bba4-18af63a6812f tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-831194-21/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019419 Oct 04 17:50:03.064652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 108/238] 10.222.0.42 () {58 vars in 1197 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/os-hosts/n-d-831194-21/shutdown => generated 113 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:50:03.075989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d998712-3cf8-4db5-a1d4-0bacf68a95d9 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Calling method '.version_select at 0x7fbdbf3a6a60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.087426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1d998712-3cf8-4db5-a1d4-0bacf68a95d9 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d998712-3cf8-4db5-a1d4-0bacf68a95d9 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.089344 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:50:03.090775 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:03.092460 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:50:03.094136 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d998712-3cf8-4db5-a1d4-0bacf68a95d9 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d998712-3cf8-4db5-a1d4-0bacf68a95d9 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.022781 Oct 04 17:50:03.095338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 109/239] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:03.104055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39da62a9-91c0-4c3b-8d93-8f07b8c56760 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Calling method '.version_select at 0x7fbdbe588c10>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.105812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-39da62a9-91c0-4c3b-8d93-8f07b8c56760 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39da62a9-91c0-4c3b-8d93-8f07b8c56760 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/n-d-831194-21/startup HTTP/1.1 Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:03.108456 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'n-d-831194-21'} Oct 04 17:50:03.109915 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.110779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 04 17:50:03.111929 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.113658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39da62a9-91c0-4c3b-8d93-8f07b8c56760 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.114725 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-39da62a9-91c0-4c3b-8d93-8f07b8c56760 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "GET /compute/v2.1/os-hosts/n-d-831194-21/startup" status: 403 len: 110 microversion: 2.1 time: 0.014432 Oct 04 17:50:03.115389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 110/240] 10.222.0.42 () {58 vars in 1194 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/os-hosts/n-d-831194-21/startup => generated 110 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:50:03.124564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6ede10a-f207-4cb6-9305-697988042132 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Calling method '.version_select at 0x7fbdbe6f6af0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.133626 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c6ede10a-f207-4cb6-9305-697988042132 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6ede10a-f207-4cb6-9305-697988042132 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.135343 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'nonexistent_hostname'} Oct 04 17:50:03.136703 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:03.141544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 04 17:50:03.142837 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6ede10a-f207-4cb6-9305-697988042132 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c6ede10a-f207-4cb6-9305-697988042132 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.016151 Oct 04 17:50:03.144134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 111/241] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:50:03.146714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1389706f-fe09-4c8a-809e-f159ae5ffe1e tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe4f7af0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1389706f-fe09-4c8a-809e-f159ae5ffe1e tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-hosts/n-d-831194-21 HTTP/1.1 Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 51 Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.150507 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: {"status": "enable", "maintenance_mode": "invalid"} Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.151851 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'n-d-831194-21', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.154383 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.155747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1389706f-fe09-4c8a-809e-f159ae5ffe1e tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1389706f-fe09-4c8a-809e-f159ae5ffe1e tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-831194-21" status: 400 len: 199 microversion: 2.1 time: 0.009604 Oct 04 17:50:03.156912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 112/242] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:50:03 2022] PUT /compute/v2.1/os-hosts/n-d-831194-21 => generated 199 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:03.160488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.161102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:03.167673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.168158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.168594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.169340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.170598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.171057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.201941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.202430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.202873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.203324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lazy-loading 'fault' on Instance uuid 69e10073-a547-4afa-a49d-10a1891d4c27 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:03.250127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea9d0738d842400ea07a18d711d85f6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7eae825c35b9444489b006f2dea9af61', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.267342 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ec88ecd-f493-4402-9152-9d94d88c62e2 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 200 len: 1327 microversion: 2.1 time: 0.111992 Oct 04 17:50:03.267993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 113/243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:03.272112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-541962b4-2aae-497e-87f2-eeb8883fe781 tempest-SecurityGroupsTestAdminJSON-1239732531 tempest-SecurityGroupsTestAdminJSON-1239732531-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/30b8290d-e8f1-4a1c-a9d1-5bca2e079385" status: 202 len: 0 microversion: 2.1 time: 0.352674 Oct 04 17:50:03.272741 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 131/244] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:02 2022] DELETE /compute/v2.1/os-security-groups/30b8290d-e8f1-4a1c-a9d1-5bca2e079385 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:03.282821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-105b6d20-4fec-4c87-bf37-652d3244cbe4 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbeb4c430>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-105b6d20-4fec-4c87-bf37-652d3244cbe4 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-hosts/n-d-831194-21 HTTP/1.1 Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 51 Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.287074 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: {"status": "invalid", "maintenance_mode": "enable"} Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.288296 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'n-d-831194-21', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.288997 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.290344 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-105b6d20-4fec-4c87-bf37-652d3244cbe4 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-105b6d20-4fec-4c87-bf37-652d3244cbe4 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-831194-21" status: 400 len: 189 microversion: 2.1 time: 0.019461 Oct 04 17:50:03.291353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 114/245] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:50:03 2022] PUT /compute/v2.1/os-hosts/n-d-831194-21 => generated 189 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:03.301666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b69a831a-1052-4223-af52-b4c7e5765c44 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Action: 'update', calling method: .version_select at 0x7fbdbe4c2b80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.305356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b69a831a-1052-4223-af52-b4c7e5765c44 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'e8638cbb6ba34e3989cc8b048a704f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff55beaaf802423cabad57504647e67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b69a831a-1052-4223-af52-b4c7e5765c44 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Request method failure captured: Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/os-hosts/n-d-831194-21 HTTP/1.1 Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 50 Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJH63C1h2Q9QUWUc6qFVGWbc-KLimXtnzhlCZjZeOUraQBHGMee0zyt7JJgUXWTi-6HSzsOvJ6_JJBw8NWKxkDGef1Zqb6gkod0Fil0qdD2R_7Eas-GGpq4tfnjooNBJ7C1RqLSV-rrSvfUOSMyYP4r2_FMGSgBZg7k6C0L9b8Ci0I Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:03.307111 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ff55beaaf802423cabad57504647e67a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ff55beaaf802423cabad57504647e67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ff55beaaf802423cabad57504647e67a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ff55beaaf802423cabad57504647e67a Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1675632787 Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e8638cbb6ba34e3989cc8b048a704f1d Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1675632787-project Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:50:03.308282 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'n-d-831194-21', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.309005 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 04 17:50:03.310660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.314537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b69a831a-1052-4223-af52-b4c7e5765c44 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.317533 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b69a831a-1052-4223-af52-b4c7e5765c44 tempest-HostsAdminNegativeTestJSON-1675632787 tempest-HostsAdminNegativeTestJSON-1675632787-project] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-831194-21" status: 403 len: 111 microversion: 2.1 time: 0.020135 Oct 04 17:50:03.320012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 132/246] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:50:03 2022] PUT /compute/v2.1/os-hosts/n-d-831194-21 => generated 111 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:03.332113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-582f03ee-2fde-4c6a-a8c3-29248ef34311 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe333670>, body: {"status": null, "maintenance_mode": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-582f03ee-2fde-4c6a-a8c3-29248ef34311 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-hosts/n-d-831194-21 HTTP/1.1 Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 42 Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:03.351749 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: {"status": null, "maintenance_mode": null} Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:50:03.353291 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'n-d-831194-21', 'body': {'status': None, 'maintenance_mode': None}} Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'disable', Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Enable', Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'Disable', Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi None Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.354261 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.356702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.358036 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:50:03.358036 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:50:03.358036 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 04 17:50:03.358036 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.359713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-582f03ee-2fde-4c6a-a8c3-29248ef34311 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.369130 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-582f03ee-2fde-4c6a-a8c3-29248ef34311 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/n-d-831194-21" status: 400 len: 127 microversion: 2.1 time: 0.043158 Oct 04 17:50:03.372612 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 115/247] 10.222.0.42 () {60 vars in 1190 bytes} [Tue Oct 4 17:50:03 2022] PUT /compute/v2.1/os-hosts/n-d-831194-21 => generated 127 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:03.382247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe3f1a60>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:03.401119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.hosts [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Enabling host nonexistent_hostname. Oct 04 17:50:03.430568 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Request method failure captured: Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 50 Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJIgwR2L3OTpLNlUgRz1jdgnxxR1PpuZi_UuEUa6RKR0DBtn4cyiP1xJ2hLV7mrlJmj0sMNCuMA708fEy1m2OETD1WhGyiLlMgPNuI_QkFuxbD-3xZOtKCvvvqQlm7e0Jk1j5pbSrHmgSpZCPsPBo6kIWr169g-CSal8dK71YNgZOQ Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:03.432589 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7983f346b393476d9e1c8eb0b5f585cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 7983f346b393476d9e1c8eb0b5f585cd Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-389724868 Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 0a7198f8df8147cc9d3a3791a0bdb209 Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HostsAdminNegativeTestJSON-389724868-project-admin Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: {"status": "enable", "maintenance_mode": "enable"} Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.434014 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:03.435538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:03.437787 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:03.439533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:03.441639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2193afb-76b0-497b-957e-36a715d85642 tempest-HostsAdminNegativeTestJSON-389724868 tempest-HostsAdminNegativeTestJSON-389724868-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.061041 Oct 04 17:50:03.445004 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 133/248] 10.222.0.42 () {60 vars in 1211 bytes} [Tue Oct 4 17:50:03 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:03.674918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.675542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:03.692024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.692537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.692985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.699201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.700046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.706017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.859049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:03.874118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b9592df-ec85-4bca-a7b0-651d902d378a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1273 microversion: 2.1 time: 0.200255 Oct 04 17:50:03.877563 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 116/249] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1273 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:03.939269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:03.940427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:03.951422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.953858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.954492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:03.955224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:03.957420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:03.957896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.032733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:04.033370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:04.049302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.049795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.050280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.051183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.051636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.052061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.227591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:04.243856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0015ce3c-5176-44ae-981f-5d2879cc7ac3 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1301 microversion: 2.1 time: 0.308152 Oct 04 17:50:04.245098 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 134/250] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:03 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1301 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:04.292300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:04.293080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:04.300323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.301205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.301892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.302869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.303624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.304288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.317362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:04.323794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] HTTP exception thrown: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Request method failure captured: Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 HTTP/1.1 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIkElMew9iF53DOkW3U9pNEbgf4IWk7yWjK4HQiHrCTClY7l1hQec3p7rY9p5OfDde01_6eIpLiLEmCSD8yuLOHn4XSNkwp9iIg_1kgJRUvRgIXpnJ7lbkxEw1xZyEuscFIV0lpePj1IUZ0ThNbHiEj6mkgHBO072nU25Gy2KqPrp4 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:04.327527 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eae825c35b9444489b006f2dea9af61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ea9d0738d842400ea07a18d711d85f6b Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:04.329095 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '69e10073-a547-4afa-a49d-10a1891d4c27'} Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:04.329814 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:04.330926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:04.333329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Returning 404 to user: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:04.334499 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8d08128-211d-462c-9629-f825b92d6185 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 404 len: 111 microversion: 2.1 time: 0.046813 Oct 04 17:50:04.335637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 135/251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:04 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:04.339611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efc6126a-87f8-4a65-ae84-1e9ccddba203 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1476 microversion: 2.1 time: 0.306552 Oct 04 17:50:04.342178 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 117/252] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:04 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1476 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:04.363483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c24dd0de-dcf6-419c-b076-70d51e7aae87 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:04.383371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c24dd0de-dcf6-419c-b076-70d51e7aae87 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.384348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c24dd0de-dcf6-419c-b076-70d51e7aae87 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.384789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c24dd0de-dcf6-419c-b076-70d51e7aae87 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.896909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:04.897594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:04.907726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.908321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.908785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:04.913362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:04.913860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:04.914315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.086921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:05.101497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e47a678-c19a-4140-8c13-8896f397e837 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1271 microversion: 2.1 time: 0.208572 Oct 04 17:50:05.105292 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 118/253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:04 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:05.270490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:05.271210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:05.290867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:05.291551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:05.296684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.297940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:05.303870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:05.304684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.575181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c24dd0de-dcf6-419c-b076-70d51e7aae87 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 298 microversion: 2.1 time: 1.234239 Oct 04 17:50:05.578513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 136/254] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:50:04 2022] POST /compute/v2.1/os-aggregates/3/action => generated 298 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:05.586818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:05.587802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:05.595665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:05.613907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:05.615798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.617646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:05.618483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:05.620005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.835253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:05.846770 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c19ac54d-3f48-4501-842f-9607740196b9 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1343 microversion: 2.1 time: 0.580881 Oct 04 17:50:05.862999 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 119/255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:05 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1343 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:05.870993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-09f1518c-daff-4541-b410-0a4908b9dddf tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:05.899738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-09f1518c-daff-4541-b410-0a4908b9dddf tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.034628 Oct 04 17:50:05.900667 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 120/256] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:05 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:05.907460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b08abdc0-b2de-490b-a4ed-b390524a9426", "name": "network-vif-deleted", "tag": "2635c47c-938b-4131-a204-4e622e13984f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:05.920691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:05.921507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:05.922192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:05.938522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] Creating event network-vif-deleted:2635c47c-938b-4131-a204-4e622e13984f for instance b08abdc0-b2de-490b-a4ed-b390524a9426 on n-h2-831194-21 Oct 04 17:50:05.941151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:05.947065 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-55fdacb5-8dd1-49f7-8047-56f87afa8fca req-33802c31-2923-48f0-9892-24a2a5f21b6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044662 Oct 04 17:50:05.948166 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 121/257] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:05.954218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cfa032e5-4012-48f2-a861-e4245e97f223 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1023691819"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:05.954414 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb6be823-e128-4b0f-a31e-348bac3a869e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 200 len: 1434 microversion: 2.1 time: 0.373782 Oct 04 17:50:05.957706 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 137/258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:05 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 1434 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:05.959189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-cfa032e5-4012-48f2-a861-e4245e97f223 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 5d315087-dbea-499b-80ce-7f69b73fdf89 for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:06.039720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cfa032e5-4012-48f2-a861-e4245e97f223 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.088106 Oct 04 17:50:06.043694 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 122/259] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.054686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4eb640fa-397f-47c7-bd66-0f01a8330e76 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.068396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb640fa-397f-47c7-bd66-0f01a8330e76 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.069193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb640fa-397f-47c7-bd66-0f01a8330e76 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.069926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb640fa-397f-47c7-bd66-0f01a8330e76 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.132609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.142315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:06.156331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.158191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.158789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.159790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.160351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.161041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.197678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:06.304387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4eb640fa-397f-47c7-bd66-0f01a8330e76 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 243 microversion: 2.1 time: 0.253515 Oct 04 17:50:06.304960 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 138/260] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:50:06 2022] POST /compute/v2.1/os-aggregates/8/action => generated 243 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.316295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.353649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.357752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.358236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.369792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] Creating event network-changed:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:50:06.386840 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-61396375-94cd-49ca-b7d9-a580b0b12075 req-683cc028-5c64-4f88-abcf-375e153a45c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080381 Oct 04 17:50:06.387754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 139/261] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.397609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f459eceb-43aa-4eac-b81b-fe18450c7055 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.408295 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f459eceb-43aa-4eac-b81b-fe18450c7055 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 243 microversion: 2.1 time: 0.014561 Oct 04 17:50:06.409145 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 140/262] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 17:50:06 2022] GET /compute/v2.1/os-aggregates/8 => generated 243 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.422301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54fb18db-cf69-46d6-83d9-cc9ce2512627 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.438277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54fb18db-cf69-46d6-83d9-cc9ce2512627 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.438769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54fb18db-cf69-46d6-83d9-cc9ce2512627 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.439459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54fb18db-cf69-46d6-83d9-cc9ce2512627 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.677436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=88,nova_api:INSERT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:06.692135 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54fb18db-cf69-46d6-83d9-cc9ce2512627 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.274756 Oct 04 17:50:06.697307 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 141/263] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:50:06 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.715113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8cfefc7-fa26-4773-938c-92eda6adca83 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.766148 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8cfefc7-fa26-4773-938c-92eda6adca83 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.059454 Oct 04 17:50:06.769399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 142/264] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:06 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:06.792478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e91ee60-f1ae-4864-be56-34cf33f45b2a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1165596316"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.796329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-9e91ee60-f1ae-4864-be56-34cf33f45b2a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid ccffa4a0-1f08-4afd-a799-0e1253bd9a60 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:06.862700 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e91ee60-f1ae-4864-be56-34cf33f45b2a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084002 Oct 04 17:50:06.869216 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 143/265] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:06.880070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:06.881434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:06.896260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.897565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.898045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.898772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.899233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.899669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:06.936711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:06.949404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb918cc8-cefe-4960-899b-9f0c087fb7c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.820462 Oct 04 17:50:06.950102 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 123/266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:06 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:06.959798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-321ea2d1-d019-4baf-9c25-0476aaa24ba6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:06.992615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-321ea2d1-d019-4baf-9c25-0476aaa24ba6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:06.993114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-321ea2d1-d019-4baf-9c25-0476aaa24ba6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:06.993548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-321ea2d1-d019-4baf-9c25-0476aaa24ba6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.220957 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-321ea2d1-d019-4baf-9c25-0476aaa24ba6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 243 microversion: 2.1 time: 0.268546 Oct 04 17:50:07.223351 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 124/267] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:50:06 2022] POST /compute/v2.1/os-aggregates/9/action => generated 243 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:07.234258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:07.235168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:07.242550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.243350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.243973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.245087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.245733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.246483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.265069 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 HTTP/1.1 Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:07.267698 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:07.268851 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b08abdc0-b2de-490b-a4ed-b390524a9426'} Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:07.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:07.270667 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:07.273189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:07.274284 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-822c7d80-9460-479a-a3d9-3735dcde3038 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 404 len: 111 microversion: 2.1 time: 0.049774 Oct 04 17:50:07.275332 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 125/268] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:07 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:07.292807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1edbeb32-0e39-4c0d-ba69-3d33d3e9dbcc tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:07.303551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1edbeb32-0e39-4c0d-ba69-3d33d3e9dbcc tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.026494 Oct 04 17:50:07.305358 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 126/269] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:50:07 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:07.321997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa35bc18-dccd-4376-b464-4fd1f4eaba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:07.327434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:07.344720 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e29e06f8-f5ec-418a-9f26-a804a91a9c96 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.467887 Oct 04 17:50:07.345370 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 144/270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:06 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:07.352231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35bc18-dccd-4376-b464-4fd1f4eaba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.355551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35bc18-dccd-4376-b464-4fd1f4eaba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.356030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35bc18-dccd-4376-b464-4fd1f4eaba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.494067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-964407090", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:07.557633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa35bc18-dccd-4376-b464-4fd1f4eaba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.240911 Oct 04 17:50:07.560795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 127/271] 10.222.0.42 () {60 vars in 1191 bytes} [Tue Oct 4 17:50:07 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:07.572839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-393a6047-c721-493c-884c-23575f1756ab tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:07.618430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-393a6047-c721-493c-884c-23575f1756ab tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.049804 Oct 04 17:50:07.619003 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 128/272] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:07 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:07.632998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3d75252-751b-4e36-a8f7-955391f1bc66 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1243234931"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:07.637451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-a3d75252-751b-4e36-a8f7-955391f1bc66 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 4004b1d7-027a-4263-9e0c-102fed158ba2 for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:07.655214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:07.663978 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3d75252-751b-4e36-a8f7-955391f1bc66 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.036450 Oct 04 17:50:07.665224 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 129/273] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:07.680081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9de8a676-f745-45b4-a51d-495872b9409b tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:07.717599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de8a676-f745-45b4-a51d-495872b9409b tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:07.719635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de8a676-f745-45b4-a51d-495872b9409b tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:07.722199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de8a676-f745-45b4-a51d-495872b9409b tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:07.976675 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9de8a676-f745-45b4-a51d-495872b9409b tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 244 microversion: 2.1 time: 0.302900 Oct 04 17:50:07.977729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 130/274] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:07 2022] POST /compute/v2.1/os-aggregates/10/action => generated 244 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:07.982943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:07.987768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:08.003179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.003844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.004454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.008878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.009508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.012187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.030860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:08.032487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:08.033193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:08.034533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:08.035182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:08.050047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.052140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.053089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.054791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.055516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.056156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.084466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Getting quotas for project 093b213cf7734de0977b044435403d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:08.093809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Getting quotas for user 271f007582e7427ba4931f5abe921fb6 and project 093b213cf7734de0977b044435403d1c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:08.114643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:08.117210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:08.191088 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ed7cfef-3a9e-4cce-b238-49fd2d54dd2d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707203 Oct 04 17:50:08.192240 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 145/275] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:08.230543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-763a8f12-d51c-4905-bd23-bc850fe17951 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:08.265779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-763a8f12-d51c-4905-bd23-bc850fe17951 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.266396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-763a8f12-d51c-4905-bd23-bc850fe17951 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.266722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-763a8f12-d51c-4905-bd23-bc850fe17951 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.276882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:08.470153 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-763a8f12-d51c-4905-bd23-bc850fe17951 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.276084 Oct 04 17:50:08.479586 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 146/276] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:08 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.484988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caec5f65-8ebb-495e-8f5d-de011b213812", "tag": "4717915d-879a-4494-876b-4f51ea52a66c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:08.515593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.516104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.516550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.536452 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] Creating event network-changed:4717915d-879a-4494-876b-4f51ea52a66c for instance caec5f65-8ebb-495e-8f5d-de011b213812 on n-h1-831194-21 Oct 04 17:50:08.543338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-eddefcc6-fa35-4d6b-8fed-fed8101a1b40 req-5a4761c6-7646-44e4-b3a2-f3f0af2b10e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061879 Oct 04 17:50:08.544879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 147/277] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.550695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8db2b75-3a11-46a8-ad43-cc4742f8a462 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.558020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:08.568690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8db2b75-3a11-46a8-ad43-cc4742f8a462 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:08.572518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e03eeb37-a39e-4716-90ba-7b3f036612b5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.593439 Oct 04 17:50:08.577557 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 131/278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:07 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:08.590629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.595148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:08.618841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.619780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.620549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.621969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.623131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.623842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.901899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8db2b75-3a11-46a8-ad43-cc4742f8a462 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:08.917120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:08.926211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a995e460-0998-4517-aae5-ac479b3b3bfc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.347129 Oct 04 17:50:08.927871 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 132/279] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:08 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:08.930966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8db2b75-3a11-46a8-ad43-cc4742f8a462 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1219 microversion: 2.1 time: 0.384454 Oct 04 17:50:08.933309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 148/280] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:08 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1219 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:08.934253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65a1a47-2136-4ab6-9804-55fbec00b5a3", "tag": "4722f639-4207-4bf2-86f8-4692d48cbb2e"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:08.946306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:08.946667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e03c67ef-f84f-42d0-826b-25593a312e82 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:08.947308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:08.948386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:08.960981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] Creating event network-changed:4722f639-4207-4bf2-86f8-4692d48cbb2e for instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 on n-h2-831194-21 Oct 04 17:50:08.967767 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05b36c5f-11c1-4c8f-8b29-53ff34d658bf req-14ac7370-1115-492a-8389-c3ee2f9f0980 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038442 Oct 04 17:50:08.969311 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 133/281] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:08.991835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e03c67ef-f84f-42d0-826b-25593a312e82 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.057182 Oct 04 17:50:08.992830 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 149/282] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:08 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:09.007962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a050353b-15b4-457f-a978-ca05a6ba15a2 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-363420262"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.013292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-a050353b-15b4-457f-a978-ca05a6ba15a2 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 18ad168b-2601-4e8e-9e42-0a17b16428ed for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:09.053682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a050353b-15b4-457f-a978-ca05a6ba15a2 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053324 Oct 04 17:50:09.055405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 134/283] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.060955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80b23a2e-7944-423d-b48d-7a81b3303ec1 tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1069330714"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.064661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-80b23a2e-7944-423d-b48d-7a81b3303ec1 tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Generated uuid 58e0800e-e0d8-4e73-bb0d-63778203896d for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:09.092513 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80b23a2e-7944-423d-b48d-7a81b3303ec1 tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.035322 Oct 04 17:50:09.098136 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 135/284] 10.222.0.42 () {62 vars in 1205 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:09.109776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4d6737d-c143-478a-a2f5-2faab6058120 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.150598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4d6737d-c143-478a-a2f5-2faab6058120 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.050664 Oct 04 17:50:09.151834 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 136/285] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:09.158267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-935d412d-0481-4386-add1-b7776202885b tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-774186484"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.290429 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-935d412d-0481-4386-add1-b7776202885b tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.137171 Oct 04 17:50:09.291400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 137/286] 10.222.0.42 () {62 vars in 1213 bytes} [Tue Oct 4 17:50:09 2022] PUT /compute/v2.1/os-aggregates/12 => generated 299 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:09.296967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1289b48-4166-4edd-a640-be9a11305176 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.306486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:09.307592 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d1289b48-4166-4edd-a640-be9a11305176 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1289b48-4166-4edd-a640-be9a11305176 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Request method failure captured: Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHImY7u_jEcOsBSbnqmCKjFU_tclr-_36swABx8SzOLKo3MwoTgKK8QZANTH0Z6IpA7FeKL2Gs8s_Eqks9sKuE2F7RGnaTJuVxQHLniMTSvG-YIxQXNaxUHpGYG1mZXv6-E7J4rWgbE5FFuJVQQjtXzk1HL1dSEB-bbI2aqInSVmQeY Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:09.310091 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3a795bd4dc19487bb60257351967ca52 Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: exception: Aggregate 11 could not be found. Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '11'} Oct 04 17:50:09.311984 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.312752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 04 17:50:09.313981 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.314961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1289b48-4166-4edd-a640-be9a11305176 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:09.314961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1289b48-4166-4edd-a640-be9a11305176 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.019279 Oct 04 17:50:09.314961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 138/287] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:09.316906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-51c093b4-586e-4270-a5f3-06bcd41e0793 tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.331509 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-51c093b4-586e-4270-a5f3-06bcd41e0793 tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/12" status: 200 len: 299 microversion: 2.41 time: 0.018107 Oct 04 17:50:09.332464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 139/288] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-aggregates/12 => generated 299 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:09.340111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47ea1051-0bbc-4994-8aa4-632a681dfc98 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.355111 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-47ea1051-0bbc-4994-8aa4-632a681dfc98 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47ea1051-0bbc-4994-8aa4-632a681dfc98 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Request method failure captured: Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-aggregates/11 HTTP/1.1 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHImY7u_jEcOsBSbnqmCKjFU_tclr-_36swABx8SzOLKo3MwoTgKK8QZANTH0Z6IpA7FeKL2Gs8s_Eqks9sKuE2F7RGnaTJuVxQHLniMTSvG-YIxQXNaxUHpGYG1mZXv6-E7J4rWgbE5FFuJVQQjtXzk1HL1dSEB-bbI2aqInSVmQeY Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:09.357664 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3a795bd4dc19487bb60257351967ca52 Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: exception: Aggregate 11 could not be found. Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '11'} Oct 04 17:50:09.359055 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:09.359905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 11 could not be found. Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 11 could not be found. Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.361133 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.362454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.362454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:09.362454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:09.362454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 could not be found. Oct 04 17:50:09.362454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.362792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47ea1051-0bbc-4994-8aa4-632a681dfc98 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:09.363638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47ea1051-0bbc-4994-8aa4-632a681dfc98 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.030098 Oct 04 17:50:09.366743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 140/289] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:09 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:09.377179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3815466c-9b8a-45ba-8edb-92ef26996b9a tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.389601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3815466c-9b8a-45ba-8edb-92ef26996b9a tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.390211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3815466c-9b8a-45ba-8edb-92ef26996b9a tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.390639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3815466c-9b8a-45ba-8edb-92ef26996b9a tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.458405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.465243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.465735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.467228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.467981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.469003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.469440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.498574 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cca4190-095a-4441-a26b-5ac336cf84a5 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.476903 Oct 04 17:50:09.499651 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 150/290] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-services => generated 949 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.510924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3dc0d029-e0b2-4c60-95af-1f55c578ec90 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-708227449", "name": "tempest-test_aggregate-785488178"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.515776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-3dc0d029-e0b2-4c60-95af-1f55c578ec90 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 5675834e-5617-463b-b47b-626291bd3739 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:09.550277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3815466c-9b8a-45ba-8edb-92ef26996b9a tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 315 microversion: 2.41 time: 0.182263 Oct 04 17:50:09.550998 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3dc0d029-e0b2-4c60-95af-1f55c578ec90 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.048242 Oct 04 17:50:09.551997 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 141/291] 10.222.0.42 () {62 vars in 1235 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/os-aggregates/12/action => generated 315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:09.558018 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 151/292] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.562622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.566066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68525e53-cad5-47ce-bf89-0950a7523d4e tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.567304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.567774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.568523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.569393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.582556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.586066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.601813 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68525e53-cad5-47ce-bf89-0950a7523d4e tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.040936 Oct 04 17:50:09.602462 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 152/293] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:09 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:09.612742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7690d975-1bcb-48b5-99ab-d00034376b7f tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:09.625411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7690d975-1bcb-48b5-99ab-d00034376b7f tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.625937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7690d975-1bcb-48b5-99ab-d00034376b7f tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.626552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7690d975-1bcb-48b5-99ab-d00034376b7f tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.629308 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5eda74ba-e92b-4241-b5ee-8954ab54030c tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-831194-21" status: 200 len: 581 microversion: 2.1 time: 0.075008 Oct 04 17:50:09.631202 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 142/294] 10.222.0.42 () {58 vars in 1174 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-services?host=n-d-831194-21 => generated 581 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.636810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.637746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:09.644044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.645071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.645519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.647893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.648385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.648813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.775746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7690d975-1bcb-48b5-99ab-d00034376b7f tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 299 microversion: 2.41 time: 0.172175 Oct 04 17:50:09.776799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 153/295] 10.222.0.42 () {62 vars in 1235 bytes} [Tue Oct 4 17:50:09 2022] POST /compute/v2.1/os-aggregates/12/action => generated 299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:09.782657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-faee087c-ca3f-4719-89f5-6ba943ccad94 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.791257 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-faee087c-ca3f-4719-89f5-6ba943ccad94 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-faee087c-ca3f-4719-89f5-6ba943ccad94 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Request method failure captured: Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHImY7u_jEcOsBSbnqmCKjFU_tclr-_36swABx8SzOLKo3MwoTgKK8QZANTH0Z6IpA7FeKL2Gs8s_Eqks9sKuE2F7RGnaTJuVxQHLniMTSvG-YIxQXNaxUHpGYG1mZXv6-E7J4rWgbE5FFuJVQQjtXzk1HL1dSEB-bbI2aqInSVmQeY Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:09.793174 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3a795bd4dc19487bb60257351967ca52 Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: exception: Aggregate 13 could not be found. Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '13'} Oct 04 17:50:09.795245 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.796181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 04 17:50:09.797398 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.800547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-faee087c-ca3f-4719-89f5-6ba943ccad94 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:09.801790 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-faee087c-ca3f-4719-89f5-6ba943ccad94 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.023817 Oct 04 17:50:09.802694 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 154/296] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:09.807953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.812236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.812324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.812753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.814211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.814918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.815262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.842219 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24804863-e44a-463a-b62f-f20ee6d5d3da tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.038184 Oct 04 17:50:09.842807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 155/297] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.847905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0203822e-226f-478c-906f-321c191a23cd tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.872098 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0203822e-226f-478c-906f-321c191a23cd tempest-AggregatesAdminTestV241-1021259039 tempest-AggregatesAdminTestV241-1021259039-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.41 time: 0.028138 Oct 04 17:50:09.877197 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 156/298] 10.222.0.42 () {60 vars in 1196 bytes} [Tue Oct 4 17:50:09 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:09.911641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:09.925702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e71f05f-6a36-419e-a6e4-6056609f44fc tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.293254 Oct 04 17:50:09.928650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 143/299] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:09.936282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee603b0a-8e81-47a7-beed-90589700fa09 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.966510 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ee603b0a-8e81-47a7-beed-90589700fa09 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee603b0a-8e81-47a7-beed-90589700fa09 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Request method failure captured: Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHImY7u_jEcOsBSbnqmCKjFU_tclr-_36swABx8SzOLKo3MwoTgKK8QZANTH0Z6IpA7FeKL2Gs8s_Eqks9sKuE2F7RGnaTJuVxQHLniMTSvG-YIxQXNaxUHpGYG1mZXv6-E7J4rWgbE5FFuJVQQjtXzk1HL1dSEB-bbI2aqInSVmQeY Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:09.968365 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8cd92a2f1a4748b6aedfa7fe5a7b14f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8cd92a2f1a4748b6aedfa7fe5a7b14f1 Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1372324889 Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3a795bd4dc19487bb60257351967ca52 Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminTestJSON-1372324889-project-admin Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: exception: Aggregate 13 could not be found. Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '13'} Oct 04 17:50:09.969664 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:09.970459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:09.971496 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee603b0a-8e81-47a7-beed-90589700fa09 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:09.975499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee603b0a-8e81-47a7-beed-90589700fa09 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.040095 Oct 04 17:50:09.985727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 144/300] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:09 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:09.990470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:09.994185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.994582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.995073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:09.996100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:09.996609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:09.997214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.048186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b14d9b14-c1ae-4c9b-a9a6-7c5e18b8f476 tempest-ServicesAdminTestJSON-1094624764 tempest-ServicesAdminTestJSON-1094624764-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.061208 Oct 04 17:50:10.048785 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 145/301] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-services => generated 949 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.065590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.066256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:10.072420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.073307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.073808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.074797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.075851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.076284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.095597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Calling method '.version_select at 0x7fbdbe9f4820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.097501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.098317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.098888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.118417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.119233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.119683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.132424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.132948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.133385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.143428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-712e5157-dd88-49d7-a075-9c227d894fbd tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.267275 Oct 04 17:50:10.143428 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 157/302] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.147379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.148376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:10.156859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.157594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.158322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.159420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.160198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.160863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.250341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:10.259303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef22c813-dd1d-4ef7-a540-963078bd0db9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1271 microversion: 2.1 time: 0.115427 Oct 04 17:50:10.270072 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 158/303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1271 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:10.270072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09536a76-4ebe-47eb-9e1f-b38336e08f2e tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1715916123"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.274374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-09536a76-4ebe-47eb-9e1f-b38336e08f2e tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid 14235b02-c468-4c43-af26-277982904838 for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:10.304542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09536a76-4ebe-47eb-9e1f-b38336e08f2e tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.040035 Oct 04 17:50:10.305142 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 159/304] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.316636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b48abf6b-2eb7-47a0-b047-2497033cba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1887691992"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.319924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-b48abf6b-2eb7-47a0-b047-2497033cba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 4988cd9d-002a-47f1-a503-dedd69a417bf for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:10.330111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:10.345694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b48abf6b-2eb7-47a0-b047-2497033cba02 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.032408 Oct 04 17:50:10.346381 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 160/305] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.347188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5827e3ae-49a7-40b6-82d4-05d8909bdc7d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.296916 Oct 04 17:50:10.364944 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 146/306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:10.370175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82eb224f-1750-4f9e-b0aa-0d7e311c8d4d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.382043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eb224f-1750-4f9e-b0aa-0d7e311c8d4d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.382748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eb224f-1750-4f9e-b0aa-0d7e311c8d4d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.383338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eb224f-1750-4f9e-b0aa-0d7e311c8d4d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.585145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82eb224f-1750-4f9e-b0aa-0d7e311c8d4d tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 244 microversion: 2.1 time: 0.218747 Oct 04 17:50:10.587424 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 147/307] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates/14/action => generated 244 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.594097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1a6639f-e629-4d93-9ddc-4a7708989811 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.604800 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1a6639f-e629-4d93-9ddc-4a7708989811 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 228 microversion: 2.1 time: 0.015274 Oct 04 17:50:10.614108 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 148/308] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-aggregates/15 => generated 228 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.619313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4facd51b-e7d0-4fd9-bdde-1bef86bf49da tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.624981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4facd51b-e7d0-4fd9-bdde-1bef86bf49da tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'cd013bc4812146eda0494a4a29872c8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c14b5232b044484af54cea2e9168182', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4facd51b-e7d0-4fd9-bdde-1bef86bf49da tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Request method failure captured: Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-aggregates/14/action HTTP/1.1 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 43 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIjOcgkgGLJWi4utZmyDarPzvqNIjbLL_0YPFBlP-dfRVgsPwsiBo-YONkfVRvFwOd8MPbBXE1fLlggTDPDw9uugENazXAO7Z-eJMSI8RMbxKQxQ6U0lHA-g2XPp9bzzzLLYYWmP8LGCHqpg1lTEeiX-_ygnyzGrm1PNWx7gKKmwB0 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:10.627166 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5c14b5232b044484af54cea2e9168182"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5c14b5232b044484af54cea2e9168182"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5c14b5232b044484af54cea2e9168182"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5c14b5232b044484af54cea2e9168182 Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556 Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: cd013bc4812146eda0494a4a29872c8c Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1160543556-project Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: {"remove_host": {"host": "n-h1-831194-21"}} Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:10.628637 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '14', 'body': {'remove_host': {'host': 'n-h1-831194-21'}}} Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:10.629516 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 04 17:50:10.630873 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.634844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4facd51b-e7d0-4fd9-bdde-1bef86bf49da tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:10.636234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4facd51b-e7d0-4fd9-bdde-1bef86bf49da tempest-AggregatesAdminNegativeTestJSON-1160543556 tempest-AggregatesAdminNegativeTestJSON-1160543556-project] 10.222.0.42 "POST /compute/v2.1/os-aggregates/14/action" status: 403 len: 121 microversion: 2.1 time: 0.020755 Oct 04 17:50:10.637296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 149/309] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates/14/action => generated 121 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:10.645933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc1c99cd-c5a5-428e-9aa0-60f508ad76ba tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.681188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc1c99cd-c5a5-428e-9aa0-60f508ad76ba tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 266 microversion: 2.1 time: 0.041755 Oct 04 17:50:10.686168 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 150/310] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates/15/action => generated 266 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.698638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5bb67afa-bb12-4dc8-99e7-e84099d8a2c4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:10.713003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb67afa-bb12-4dc8-99e7-e84099d8a2c4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.717155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb67afa-bb12-4dc8-99e7-e84099d8a2c4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.717818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb67afa-bb12-4dc8-99e7-e84099d8a2c4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.825617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-571c99ce-886a-407d-8f75-ee02e3d23ae0 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Calling method '.version_select at 0x7fbdbe4e9670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.828547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-571c99ce-886a-407d-8f75-ee02e3d23ae0 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '03e786cd0ae54a5c9c4801deeccb3f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71eacb67e1f404ea0918da6d15f9d1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-571c99ce-886a-407d-8f75-ee02e3d23ae0 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Request method failure captured: Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors/n-h1-831194-21/search HTTP/1.1 Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJQOEPABMu550-y5vnmibZX7sfOvAFL9LJX262sPBL4OYe94eNCPxcwEM0Or9ZeyLPTEnuNtx9XVbqzFfVgTLHuHIuP0T4odHZVpccvxtVjMemKoO-A0sf4r04LT19S1_xXi72vqe7btyenc8PyGo9uQL-Kndz9dolLSpBNPHCYHfM Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: f71eacb67e1f404ea0918da6d15f9d1f Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:10.831048 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: f71eacb67e1f404ea0918da6d15f9d1f Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-923460848-project Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 03e786cd0ae54a5c9c4801deeccb3f6d Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848-project Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:50:10.832479 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'n-h1-831194-21'} Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:10.833301 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 04 17:50:10.834459 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.836516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-571c99ce-886a-407d-8f75-ee02e3d23ae0 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:10.838387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-571c99ce-886a-407d-8f75-ee02e3d23ae0 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-831194-21/search" status: 403 len: 117 microversion: 2.1 time: 0.489967 Oct 04 17:50:10.844753 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 161/311] 10.222.0.42 () {58 vars in 1212 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-hypervisors/n-h1-831194-21/search => generated 117 bytes in 498 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:10.850771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecbd5b3e-1178-4921-8934-d730a199db30 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.854501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:10.866825 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecbd5b3e-1178-4921-8934-d730a199db30 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 242 microversion: 2.1 time: 0.019782 Oct 04 17:50:10.867794 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 162/312] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-aggregates/15 => generated 242 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.875625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Calling method '.version_select at 0x7fbdbe97b3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.879300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.879965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.880577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.897551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Request method failure captured: Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJR93rOZdedYkWgkFy3Abba1LcnpRDvaliyGi1pQGRMH30GMHhcIR8UnGjg_7pMIASCzA1V7msM2bf2kNn9YlD2Li9M_iOIzQHqgAPFXyk53ROG_5aKIoBS9UgbfRBl7yvuWPbwQxsJ4R4XmVCvUmdv5YqQcpwBMmwXF-ScUuxQEiI Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b954dec10d884e92938e44d8189f4cea Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:10.899455 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b954dec10d884e92938e44d8189f4cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b954dec10d884e92938e44d8189f4cea Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ff8296dd7aad4eb7b91c492c4f2063d4 Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:50:10.900692 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:10.901519 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:10.902612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e0afa32-160b-4afe-b7c2-8fcdd7e7e275 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.031733 Oct 04 17:50:10.906673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 163/313] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:10.911731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5bb67afa-bb12-4dc8-99e7-e84099d8a2c4 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 228 microversion: 2.1 time: 0.217688 Oct 04 17:50:10.911874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d94881a-8355-4d7f-bfb2-a85fc9c94ae7 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.912878 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 151/314] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates/14/action => generated 228 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:10.921451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Calling method '.version_select at 0x7fbdbe333f70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.925585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.926328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.926883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.949962 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d94881a-8355-4d7f-bfb2-a85fc9c94ae7 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.041790 Oct 04 17:50:10.951789 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 164/315] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:10 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:10.957200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfa05c44-2061-422f-ab67-55f1c6b089aa tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:10.962676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.963258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.964569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.978266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:10.978918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:10.979467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:10.992454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfa05c44-2061-422f-ab67-55f1c6b089aa tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.039304 Oct 04 17:50:10.993294 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 165/316] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:10 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:10.994933 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61a5c10d-5ab7-4821-bdb7-4aa8d3a68d91 tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.080674 Oct 04 17:50:10.995663 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 152/317] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.007042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca6a6cdb-3a08-4036-8596-fc3ffb4b8b1a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850327095", "availability_zone": "tempest-test_az-1655824667"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:11.010920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.011662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:11.021506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.022090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.022534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.023226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.024282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.025303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.035790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-ca6a6cdb-3a08-4036-8596-fc3ffb4b8b1a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 01016ff5-868d-4cbf-99fd-e5fd2f7c5bf4 for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:11.093757 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca6a6cdb-3a08-4036-8596-fc3ffb4b8b1a tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 223 microversion: 2.1 time: 0.076997 Oct 04 17:50:11.094508 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 153/318] 10.222.0.42 () {60 vars in 1165 bytes} [Tue Oct 4 17:50:10 2022] POST /compute/v2.1/os-aggregates => generated 223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.112845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8d96c9a-68c0-46ac-a687-4ea9c7326063 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-413279325"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:11.116713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-e8d96c9a-68c0-46ac-a687-4ea9c7326063 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Generated uuid a5f14547-729e-4bf3-97f5-ca627f9fb23c for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:11.144458 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8d96c9a-68c0-46ac-a687-4ea9c7326063 tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.047416 Oct 04 17:50:11.146322 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 154/319] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.152637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22ce5e8c-99a9-4b8b-ae16-7bd9951d08e9 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Calling method '.version_select at 0x7fbdbe2e5550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.156832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22ce5e8c-99a9-4b8b-ae16-7bd9951d08e9 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '03e786cd0ae54a5c9c4801deeccb3f6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f71eacb67e1f404ea0918da6d15f9d1f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22ce5e8c-99a9-4b8b-ae16-7bd9951d08e9 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Request method failure captured: Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJQOEPABMu550-y5vnmibZX7sfOvAFL9LJX262sPBL4OYe94eNCPxcwEM0Or9ZeyLPTEnuNtx9XVbqzFfVgTLHuHIuP0T4odHZVpccvxtVjMemKoO-A0sf4r04LT19S1_xXi72vqe7btyenc8PyGo9uQL-Kndz9dolLSpBNPHCYHfM Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f71eacb67e1f404ea0918da6d15f9d1f Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:11.159669 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f71eacb67e1f404ea0918da6d15f9d1f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f71eacb67e1f404ea0918da6d15f9d1f Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848 Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-923460848-project Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 03e786cd0ae54a5c9c4801deeccb3f6d Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-923460848-project Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:50:11.161164 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1'} Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:11.162031 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 04 17:50:11.163308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.165421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22ce5e8c-99a9-4b8b-ae16-7bd9951d08e9 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:11.166813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22ce5e8c-99a9-4b8b-ae16-7bd9951d08e9 tempest-HypervisorAdminNegativeUnderV252Test-923460848 tempest-HypervisorAdminNegativeUnderV252Test-923460848-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019178 Oct 04 17:50:11.173600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 155/320] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:11.177242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:11.199616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56f5ee39-184b-46ce-bd66-70218b78a725 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1850327095_new", "availability_zone": "tempest-test_az-1655824667_new"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:11.260321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f5ee39-184b-46ce-bd66-70218b78a725 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.260803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f5ee39-184b-46ce-bd66-70218b78a725 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.261454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f5ee39-184b-46ce-bd66-70218b78a725 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.314648 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56f5ee39-184b-46ce-bd66-70218b78a725 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 337 microversion: 2.1 time: 0.138740 Oct 04 17:50:11.316751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 156/321] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 17:50:11 2022] PUT /compute/v2.1/os-aggregates/16 => generated 337 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.324953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.330926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:11.334431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bef0aea9-f9d2-4a05-ab64-ec64398199a8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.334286 Oct 04 17:50:11.353274 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 166/322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:10 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:11.359912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.360544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Calling method '.version_select at 0x7fbdbe54eb80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.360708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.361321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.363898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.364597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.365183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.381535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.382607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.383266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.390520 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] HTTP exception thrown: No hypervisor matching '5d80c97c-d2c3-4d3b-b194-9b284d0cf563' could be found. Oct 04 17:50:11.394330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.compute.aggregates [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Failed to remove host nonexist_host from aggregate 17. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Request method failure captured: Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors/5d80c97c-d2c3-4d3b-b194-9b284d0cf563/servers HTTP/1.1 Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJR93rOZdedYkWgkFy3Abba1LcnpRDvaliyGi1pQGRMH30GMHhcIR8UnGjg_7pMIASCzA1V7msM2bf2kNn9YlD2Li9M_iOIzQHqgAPFXyk53ROG_5aKIoBS9UgbfRBl7yvuWPbwQxsJ4R4XmVCvUmdv5YqQcpwBMmwXF-ScUuxQEiI Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b954dec10d884e92938e44d8189f4cea Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:11.394471 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b954dec10d884e92938e44d8189f4cea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b954dec10d884e92938e44d8189f4cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b954dec10d884e92938e44d8189f4cea Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472 Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ff8296dd7aad4eb7b91c492c4f2063d4 Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: exception: No hypervisor matching '5d80c97c-d2c3-4d3b-b194-9b284d0cf563' could be found. Oct 04 17:50:11.395696 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '5d80c97c-d2c3-4d3b-b194-9b284d0cf563'} Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '5d80c97c-d2c3-4d3b-b194-9b284d0cf563' could be found. Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.396556 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '5d80c97c-d2c3-4d3b-b194-9b284d0cf563' could be found. Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.397558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] Returning 404 to user: No hypervisor matching '5d80c97c-d2c3-4d3b-b194-9b284d0cf563' could be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:11.398140 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0bb396c-c857-4361-8ce7-98f86d2f156a tempest-HypervisorAdminNegativeUnderV252Test-424725472 tempest-HypervisorAdminNegativeUnderV252Test-424725472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/5d80c97c-d2c3-4d3b-b194-9b284d0cf563/servers" status: 404 len: 123 microversion: 2.1 time: 0.042965 Oct 04 17:50:11.400510 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 17 Oct 04 17:50:11.400622 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 167/323] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/os-hypervisors/5d80c97c-d2c3-4d3b-b194-9b284d0cf563/servers => generated 123 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:11.408698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.409307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Request method failure captured: Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 42 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIlJWFe45pKpS2ZQCWVUa4YjUHrnr7kAPgRFnbmDxyUEV7pjc77GMh1iAe5Qv4jvVf98RfGOhhB88re-UYtqx1DM4OyOw8ar8m5K2MVQ92ZsF0E67559oRUtKHEGzlKPIHQSVbPUYzHl90WjUggwBCA-i7TAnhWCA_ypHQESZ4Xor4 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:11.409955 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4fd8b30141704369aa4f0b01a66a7d12"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4fd8b30141704369aa4f0b01a66a7d12 Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490 Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 31d22e559d0f43eda7634dff608d805b Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: {"remove_host": {"host": "nonexist_host"}} Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:11.413293 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot remove host nonexist_host in aggregate 17 Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 04 17:50:11.416028 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 04 17:50:11.419398 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 17 Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.424113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 17 Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:11.426632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 17 {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:11.427841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.428413 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4057500-cd55-41e6-a653-760fa7efe18a tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/17/action" status: 404 len: 94 microversion: 2.1 time: 0.102405 Oct 04 17:50:11.429202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.429667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.430419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.430760 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 157/324] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 17:50:11 2022] POST /compute/v2.1/os-aggregates/17/action => generated 94 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:11.436190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.436753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.437509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdeab30e-f518-40e6-954f-643fdbf25c66 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.447719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdeab30e-f518-40e6-954f-643fdbf25c66 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 554 microversion: 2.1 time: 0.015545 Oct 04 17:50:11.458517 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 158/325] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/os-aggregates => generated 554 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.465057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.467155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:11.474063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.474908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.475503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.476566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.477310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.477918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.616010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.635219 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dbde8323-82a6-449b-8388-54b40115d50e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1277 microversion: 2.1 time: 0.234139 Oct 04 17:50:11.636795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 168/326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1277 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:11.649654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8632f1d0-1eca-4cfc-8c0e-cfd9c47acf0e tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.704835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8632f1d0-1eca-4cfc-8c0e-cfd9c47acf0e tempest-AggregatesAdminNegativeTestJSON-2055101490 tempest-AggregatesAdminNegativeTestJSON-2055101490-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.061610 Oct 04 17:50:11.710373 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 169/327] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:11 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:11.728231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-11c20e92-11df-4d93-ac4c-244fa5df9b2c tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.752206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:11.760299 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9f03ead-825e-4f5d-812c-6365331f215e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.300448 Oct 04 17:50:11.765610 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 159/328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:11.801517 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-11c20e92-11df-4d93-ac4c-244fa5df9b2c tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.089097 Oct 04 17:50:11.802632 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 170/329] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:11 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:11.812805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7f79e7f-c61f-4ab3-99bc-a5016bc6b9d4 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-362330012"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:11.818814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.aggregate [None req-d7f79e7f-c61f-4ab3-99bc-a5016bc6b9d4 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Generated uuid 0e6cf03c-4ff6-44cb-b3cb-218f8be6fa7b for aggregate {{(pid=128850) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 17:50:11.882919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7f79e7f-c61f-4ab3-99bc-a5016bc6b9d4 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074110 Oct 04 17:50:11.890764 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 160/330] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 17:50:11 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:11.896591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f2f4247-e5d5-4a1d-bd67-032660428518 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.915719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f2f4247-e5d5-4a1d-bd67-032660428518 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.024389 Oct 04 17:50:11.917630 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 171/331] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:50:11 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:50:11.933674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c914531d-2ff0-4258-92a2-4ac18dbb38c6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.968100 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c914531d-2ff0-4258-92a2-4ac18dbb38c6 tempest-AggregatesAdminTestJSON-1372324889 tempest-AggregatesAdminTestJSON-1372324889-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.041309 Oct 04 17:50:11.969125 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 161/332] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 17:50:11 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 17:50:11.979819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:11.980326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:11.992827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.993311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.993953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:11.994812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:11.995260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:11.996139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.016140 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] HTTP exception thrown: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Request method failure captured: Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 HTTP/1.1 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIkElMew9iF53DOkW3U9pNEbgf4IWk7yWjK4HQiHrCTClY7l1hQec3p7rY9p5OfDde01_6eIpLiLEmCSD8yuLOHn4XSNkwp9iIg_1kgJRUvRgIXpnJ7lbkxEw1xZyEuscFIV0lpePj1IUZ0ThNbHiEj6mkgHBO072nU25Gy2KqPrp4 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:12.017370 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eae825c35b9444489b006f2dea9af61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ea9d0738d842400ea07a18d711d85f6b Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.018836 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '69e10073-a547-4afa-a49d-10a1891d4c27'} Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:12.019591 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.020680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.021777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Returning 404 to user: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:12.021777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a2f5dc99-4ad9-4def-bb5d-5f07c3def65f tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 404 len: 111 microversion: 2.1 time: 0.044367 Oct 04 17:50:12.021777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 172/333] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:11 2022] DELETE /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:12.030229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:12.031097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] [instance: 69e10073-a547-4afa-a49d-10a1891d4c27] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:12.041117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.044471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.045215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.046168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.046732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.047165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.070545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] HTTP exception thrown: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Request method failure captured: Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 HTTP/1.1 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHIkElMew9iF53DOkW3U9pNEbgf4IWk7yWjK4HQiHrCTClY7l1hQec3p7rY9p5OfDde01_6eIpLiLEmCSD8yuLOHn4XSNkwp9iIg_1kgJRUvRgIXpnJ7lbkxEw1xZyEuscFIV0lpePj1IUZ0ThNbHiEj6mkgHBO072nU25Gy2KqPrp4 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:12.072308 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7eae825c35b9444489b006f2dea9af61"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7eae825c35b9444489b006f2dea9af61"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7eae825c35b9444489b006f2dea9af61 Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2032926402 Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ea9d0738d842400ea07a18d711d85f6b Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AggregatesAdminTestJSON-2032926402-project Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.073793 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '69e10073-a547-4afa-a49d-10a1891d4c27'} Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:12.074596 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. Oct 04 17:50:12.076099 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:12.078274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] Returning 404 to user: Instance 69e10073-a547-4afa-a49d-10a1891d4c27 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:12.079353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6b328e8-56e3-44ad-a947-c191d41bf0e9 tempest-AggregatesAdminTestJSON-2032926402 tempest-AggregatesAdminTestJSON-2032926402-project] 10.222.0.42 "GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27" status: 404 len: 111 microversion: 2.1 time: 0.055554 Oct 04 17:50:12.080375 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 162/334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:12 2022] GET /compute/v2.1/servers/69e10073-a547-4afa-a49d-10a1891d4c27 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:12.360850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:12.361734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:12.375311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.376165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.376758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.377728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.378217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.378637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.664398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:12.665261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:12.681247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.681999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.682583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.683435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.684070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.685171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.796662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:12.812108 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5bc5a0fa-2ee0-41b1-b3bb-b4bf833943c4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.455145 Oct 04 17:50:12.812978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 173/335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:12 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:12.817577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:12.822319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:12.839501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.840029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.840447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.842015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:12.842519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:12.842941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:12.969276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:12.978663 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6268a93c-7832-4a8f-a524-756a89f6ffb2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.318096 Oct 04 17:50:13.002624 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 163/336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:12 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:13.311258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c682ce9-4e9a-464b-9468-1258137fa08c", "tag": "0613a95c-1044-4b3c-9ee3-10e5e261cbca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:13.329557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:13.331471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:13.348252 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e59f78a8-7409-4c62-aa79-963a8744b45b tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.528721 Oct 04 17:50:13.349529 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 174/337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:12 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:13.369901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.370809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.373269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.406140 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] Creating event network-changed:0613a95c-1044-4b3c-9ee3-10e5e261cbca for instance 3c682ce9-4e9a-464b-9468-1258137fa08c on n-h1-831194-21 Oct 04 17:50:13.419434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-26640bf1-f3af-4a7d-ac1b-84b1b62eb098 req-5b1047c1-e58d-46f3-8594-c6c60df1920b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114098 Oct 04 17:50:13.422049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 164/338] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:13.812944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-plugged", "status": "completed", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:13.837851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:13.839529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:13.859214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.860927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.861702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.862882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.863083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:13.865388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.866780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:13.867318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.868049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:13.910691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] Creating event network-vif-plugged:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:50:13.944880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c33f5d43-fa43-45d2-ac6a-50845fbd2c25 req-7ca3bb95-29c7-45e9-a8ef-8978028b353a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131876 Oct 04 17:50:13.947016 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 175/339] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:14.005473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:14.006219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:14.025632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.026188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.027619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:14.028407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.028882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.029328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:14.382247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:14.391793 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-024094e1-3667-45e0-9c23-3f52f29c30a3 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.391091 Oct 04 17:50:14.397799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 176/340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:13 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:14.403434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:14.404222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:14.410574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.411281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.411881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:14.412746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:14.413355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:14.413976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:14.671941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:14.687202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8367ca0-3009-4eae-98f6-1a18cd738ac1 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.286057 Oct 04 17:50:14.687826 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 177/341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:14 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:14.757528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:14.773171 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fc98510-bc1b-4aa6-9bb8-6b93c413fa17 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.939720 Oct 04 17:50:14.776174 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 165/342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:13 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:15.421924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.422590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:15.443690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.444333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.444784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.445521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.446035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.453070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.714291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.715065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:15.726239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.726745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.727253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.727911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.728373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.728810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.733469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:15.749454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7f15b02b-8713-4e7e-b9a1-a01db905cb31 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.332197 Oct 04 17:50:15.770705 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 178/343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:15.799744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:15.800802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:15.810085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.810412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.811131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.812024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:15.812360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:15.812795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:15.990121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:16.000501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d3503cb-db60-4369-99c9-e030d229e7be tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.207491 Oct 04 17:50:16.001524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 179/344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:16.007423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caec5f65-8ebb-495e-8f5d-de011b213812", "name": "network-vif-plugged", "status": "completed", "tag": "4717915d-879a-4494-876b-4f51ea52a66c"}, {"server_uuid": "e65a1a47-2136-4ab6-9804-55fbec00b5a3", "name": "network-vif-plugged", "status": "completed", "tag": "4722f639-4207-4bf2-86f8-4692d48cbb2e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:16.019086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:16.019581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:16.020025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:16.034881 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Creating event network-vif-plugged:4717915d-879a-4494-876b-4f51ea52a66c for instance caec5f65-8ebb-495e-8f5d-de011b213812 on n-h1-831194-21 Oct 04 17:50:16.035401 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] Creating event network-vif-plugged:4722f639-4207-4bf2-86f8-4692d48cbb2e for instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 on n-h2-831194-21 Oct 04 17:50:16.048064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-437c719e-65b0-431a-af39-ae0f8a1dff54 req-74e5af74-93eb-4e67-b7fb-5f8f326e1109 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044224 Oct 04 17:50:16.048656 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 180/345] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:16.292639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:16.304911 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f0aebe0-4bf1-40f2-8299-19d2360d730d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.596863 Oct 04 17:50:16.306360 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 166/346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:15 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:16.778440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:16.780239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:16.788015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:16.788691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:16.789133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:16.789974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:16.790424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:16.791019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:16.932932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:16.941566 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9a137f8-8fd4-41fe-bd61-96270ae620ae tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.168537 Oct 04 17:50:16.942492 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 181/347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:16 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:17.022401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:17.022988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:17.028944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.029431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.029883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:17.030815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.031272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.031852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:17.052046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:17.188924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:17.197118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df54abe2-a700-40ff-9973-c5555f2b764c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1313 microversion: 2.1 time: 0.178460 Oct 04 17:50:17.197696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 167/348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:17 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:17.328880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:17.329392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:17.336188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.336673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.337574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:17.338310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.338746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.339179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:17.542849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:17.554053 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52a2b619-cb03-4a67-90ae-506af6e2185d tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1322 microversion: 2.1 time: 0.228917 Oct 04 17:50:17.556196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 182/349] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:17 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:17.965182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:17.967628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:17.974454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.975486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.976101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:17.976848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:17.979645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:17.982932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.159775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:18.172379 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d96f20c-c1ef-45ce-914b-9fa51008d663 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.209319 Oct 04 17:50:18.175875 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 168/350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:17 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:18.220791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:18.221311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:18.227585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.228079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.228513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.239162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.239707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.240148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.421603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:18.423892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:18.432387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32fefc5b-faa9-46f0-b2df-df361dc35b6e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1461 microversion: 2.1 time: 0.216597 Oct 04 17:50:18.433137 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 183/351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1461 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:18.458107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:18.458884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:18.465855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.466541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.467087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.468178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.468709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.469351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.626650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:18.646818 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75317f31-433d-4a35-897e-b4a008d126b0 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1464 microversion: 2.1 time: 0.194314 Oct 04 17:50:18.648123 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 184/352] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1464 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:18.862613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:18.867856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.868727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.869424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.870462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.871161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.872764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.911210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=46 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:18.916816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85e368ad-9924-4963-b99d-3a57783183b5 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.550811 Oct 04 17:50:18.926459 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 169/353] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/os-services => generated 949 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:18.931523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:18.932376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:18.939585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.940348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.940991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:18.941961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:18.942596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:18.943229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.157433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.165469 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19c3446e-7e26-4098-af59-ce8e0cfd3938 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1471 microversion: 2.1 time: 0.237679 Oct 04 17:50:19.166002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e212407-70b0-4ad7-968a-5ce1be52308d tempest-AZAdminNegativeTestJSON-49516349 tempest-AZAdminNegativeTestJSON-49516349-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.167440 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 170/354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1471 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.169291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e212407-70b0-4ad7-968a-5ce1be52308d tempest-AZAdminNegativeTestJSON-49516349 tempest-AZAdminNegativeTestJSON-49516349-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '1d253b6bcf424b61a2a9942f18fdf0ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b526e6651894b3b9e2e366188c84d87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.172874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e212407-70b0-4ad7-968a-5ce1be52308d tempest-AZAdminNegativeTestJSON-49516349 tempest-AZAdminNegativeTestJSON-49516349-project] Request method failure captured: Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJYrDkdb3JJBqjOJistaiamIL7zz-9jqKjFqt05FBc31Av55CTN-chauViAOJv5_cfckg0NH7P0J7FpaPmkEkFI_yKUdhu69ZcpLeecWTIdYpzR7ggeM1iLrEJj9PIAyo2grlstgum5uIbgVDG0D2J2sq1q9mLZiF8GeYcfhLb1k60 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5b526e6651894b3b9e2e366188c84d87 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AZAdminNegativeTestJSON-49516349 Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:19.174126 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5b526e6651894b3b9e2e366188c84d87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b526e6651894b3b9e2e366188c84d87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5b526e6651894b3b9e2e366188c84d87"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5b526e6651894b3b9e2e366188c84d87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AZAdminNegativeTestJSON-49516349 Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5b526e6651894b3b9e2e366188c84d87 Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-49516349 Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AZAdminNegativeTestJSON-49516349-project Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 1d253b6bcf424b61a2a9942f18fdf0ae Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AZAdminNegativeTestJSON-49516349-project Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:50:19.175669 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:19.176415 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.177529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e212407-70b0-4ad7-968a-5ce1be52308d tempest-AZAdminNegativeTestJSON-49516349 tempest-AZAdminNegativeTestJSON-49516349-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:19.183582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e212407-70b0-4ad7-968a-5ce1be52308d tempest-AZAdminNegativeTestJSON-49516349 tempest-AZAdminNegativeTestJSON-49516349-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.527604 Oct 04 17:50:19.183582 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 185/355] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:50:18 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 529 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:19.188292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.189075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-417235514", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "445364bc-c274-4d90-b6b7-acd488b398e3"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:19.189757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.190448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.191407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.192040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.192655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.221485 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50387a00-e00f-40bb-ac27-3371fbecbaf8 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.051996 Oct 04 17:50:19.222984 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 171/356] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:19.229018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.229791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:19.237190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.238001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.238652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.240132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.241341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.241997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.289948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.290899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Request method failure captured: Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812/diagnostics HTTP/1.1 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJH7Aw3dUyLwc1_NOVO4tN0r09BBfv1WSl2P_hxxQv8lx1tbwrd_WWc0rId4PCb4WqrqpE7yzEBVsTP9CNncFAn6ALsEk9hqf3bWiHMKylIvPi4pHRxOvntY31GhGQ2N60xFWfVAs5XB9cSUjxIGt_Xw-WA1kbRAXzOujO4Dt-uGT0 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ed552cf81af742b7b2f9fa7c78d95b99 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:19.295162 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ed552cf81af742b7b2f9fa7c78d95b99 Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiagnosticsNegativeTest-899371884-project Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 205d19e5e5fe4781aa8a1bde57a126ec Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-899371884-project Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:19.296451 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': 'caec5f65-8ebb-495e-8f5d-de011b213812'} Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:19.297225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:19.298345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:19.299251 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-244b1f81-8326-467a-978c-24c02d730774 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.074740 Oct 04 17:50:19.302118 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 172/357] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812/diagnostics => generated 117 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:19.312662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.313293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:19.328022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.328541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.331319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.333930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.337203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.337959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.547080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:19.557414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03e55e85-a412-4d0c-89a6-a8c8a6a965a2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.254197 Oct 04 17:50:19.565884 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 173/358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:19.565884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.569941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.571999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.572751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.573979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.574764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.575751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.630421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28879cb6-3bc5-4dc9-aff6-18186216b299 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.069922 Oct 04 17:50:19.641160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 174/359] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/os-services => generated 949 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:19.645598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.646135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:19.656016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.656514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.657173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.658123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.658758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.659382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.703139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:50:19.781967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:19.782441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:19.783004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:19.784452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:19.784961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:19.813522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.814045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.815893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.816889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.817363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.832859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.851319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:19.867146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f1cefdc-78cd-49f9-a0d7-98b7eacc81e7 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "DELETE /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 204 len: 0 microversion: 2.1 time: 0.225402 Oct 04 17:50:19.882930 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 175/360] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:19 2022] DELETE /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:19.896667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:19.896983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:19.906977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.907522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.908059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.908948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:19.909415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:19.914164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Getting quotas for user 2bb5f950cb1544818f9329360b84865a and project 5e2e949182104c65a654c04496273e81. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:19.921895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:19.951230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:19.954362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:19.992370 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de8aec53-1fdf-4a7f-a555-5054a65e2cae tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-831194-21&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.105087 Oct 04 17:50:20.002238 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 176/361] 10.222.0.42 () {58 vars in 1196 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/os-services?host=n-d-831194-21&binary=xxx => generated 16 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:20.004334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.008431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:20.015757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.016289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.016884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.017716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.018335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.018770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.071654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a7ecc06-7432-48aa-9998-5b83d24ecc86 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886487 Oct 04 17:50:20.072347 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 186/362] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:50:20.094560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.099754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.109919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.110622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.113910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.114633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.115297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.192948 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8af9b6b0-bcf4-45de-b864-94a238acf1ff tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.109954 Oct 04 17:50:20.205525 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 187/363] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/os-services => generated 949 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:20.223301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bc6da60-ca76-48ad-a1c7-04ade69ccf63 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.223939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0bc6da60-ca76-48ad-a1c7-04ade69ccf63 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:20.410051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0bc6da60-ca76-48ad-a1c7-04ade69ccf63 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:20.427259 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0bc6da60-ca76-48ad-a1c7-04ade69ccf63 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1213 microversion: 2.1 time: 0.219055 Oct 04 17:50:20.443745 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 188/364] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1213 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:20.479317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:20.491132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.495080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.495423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.496208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:20.496749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:20.497858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:20.564820 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b22893b4-fcda-4060-bcb7-a694e47a5e87 tempest-ServicesAdminNegativeTestJSON-562276160 tempest-ServicesAdminNegativeTestJSON-562276160-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.118385 Oct 04 17:50:20.565863 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 189/365] 10.222.0.42 () {58 vars in 1198 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:20.594184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:20.610075 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b420e66-d07c-4e5a-bc5e-e35255965fc8 tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1477 microversion: 2.1 time: 0.609607 Oct 04 17:50:20.611714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 177/366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:19 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1477 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:20.818996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbf4509d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:21.003236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fa3b0af-c6b5-4f7c-a1cd-545673c64738 tempest-ServicesAdminNegativeTestJSON-1282586755 tempest-ServicesAdminNegativeTestJSON-1282586755-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:21.017781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1fa3b0af-c6b5-4f7c-a1cd-545673c64738 tempest-ServicesAdminNegativeTestJSON-1282586755 tempest-ServicesAdminNegativeTestJSON-1282586755-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '99cbea93bfa043d881eacc92a2095af6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba5c62365b414f509f5f3e2b73b2bd3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fa3b0af-c6b5-4f7c-a1cd-545673c64738 tempest-ServicesAdminNegativeTestJSON-1282586755 tempest-ServicesAdminNegativeTestJSON-1282586755-project] Request method failure captured: Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJYF3PP8hDlr2YMG83KPx-1rZHecQsGizkx8QQrnhBWlgppuEe1ySacfmkvAhiWwPdiQWvJa8MQTBki2Tuz4pwcBoxMKXls5MyLxqq9-NgbV--3ZIXUrTz3izGL6hltt1aIURLxACOKFqeH51JTEDPtdsz7FyougglYwGlIs-LwYqU Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ba5c62365b414f509f5f3e2b73b2bd3a Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1282586755 Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:21.026753 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ba5c62365b414f509f5f3e2b73b2bd3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ba5c62365b414f509f5f3e2b73b2bd3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ba5c62365b414f509f5f3e2b73b2bd3a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ba5c62365b414f509f5f3e2b73b2bd3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1282586755 Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ba5c62365b414f509f5f3e2b73b2bd3a Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1282586755 Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServicesAdminNegativeTestJSON-1282586755-project Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 99cbea93bfa043d881eacc92a2095af6 Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1282586755-project Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:21.028152 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:21.029202 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:21.030268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:21.033408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fa3b0af-c6b5-4f7c-a1cd-545673c64738 tempest-ServicesAdminNegativeTestJSON-1282586755 tempest-ServicesAdminNegativeTestJSON-1282586755-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:21.035023 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1fa3b0af-c6b5-4f7c-a1cd-545673c64738 tempest-ServicesAdminNegativeTestJSON-1282586755 tempest-ServicesAdminNegativeTestJSON-1282586755-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.422364 Oct 04 17:50:21.038018 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 178/367] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:20 2022] GET /compute/v2.1/os-services => generated 112 bytes in 426 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:21.045040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:21.049685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:21.059487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.060458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.061048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.061947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.062839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.063409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.256754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.257336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.257799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.262378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.263124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.263578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.352021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=8,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:21.355415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb099da4-3d8b-4d56-a518-81684b10f635 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d" status: 200 len: 240 microversion: 2.36 time: 0.787635 Oct 04 17:50:21.358777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 190/368] 10.222.0.42 () {62 vars in 1303 bytes} [Tue Oct 4 17:50:20 2022] PUT /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d => generated 240 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:21.548690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:21.560384 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-417ec8a8-cfeb-4016-80a5-e67eb4b5d0c2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.521145 Oct 04 17:50:21.566541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 179/369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:21 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:21.578394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Calling method '.version_select at 0x7fbdbeb4c430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:21.633803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b83e50a-1914-4c06-9203-70e3a2f2ff3d tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2055083064", "id": 870545146, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:21.748251 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b83e50a-1914-4c06-9203-70e3a2f2ff3d tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.386497 Oct 04 17:50:21.763134 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 191/370] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:50:21 2022] POST /compute/v2.1/flavors => generated 446 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:21.776166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:21.777245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:21.796564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.799085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.799689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.801077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:21.803289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:21.803528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:21.998534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:22.015986 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbdc1a4f-67ca-4fb8-aa90-81b6ed51a03f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1265 microversion: 2.1 time: 0.251547 Oct 04 17:50:22.017877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 192/371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:21 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:22.044154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.044871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:22.062045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.062045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.062585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.063554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.064131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.064638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.344972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:22.357396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fedc3d9-5dd1-4808-9b84-ea8615b9a30a tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1477 microversion: 2.1 time: 0.338075 Oct 04 17:50:22.358017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 193/372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:22.433118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.433716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.434726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.438879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.442835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.443289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.466518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b74c9789-f267-4149-ac1c-b0991ca9ee6d tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d/detail" status: 200 len: 672 microversion: 2.36 time: 0.897794 Oct 04 17:50:22.467162 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 180/373] 10.222.0.42 () {60 vars in 1304 bytes} [Tue Oct 4 17:50:21 2022] GET /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d/detail => generated 672 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:22.483845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682ce9-4e9a-464b-9468-1258137fa08c", "name": "network-vif-plugged", "status": "completed", "tag": "0613a95c-1044-4b3c-9ee3-10e5e261cbca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:22.511376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.511855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.512318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.528683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] Creating event network-vif-plugged:0613a95c-1044-4b3c-9ee3-10e5e261cbca for instance 3c682ce9-4e9a-464b-9468-1258137fa08c on n-h1-831194-21 Oct 04 17:50:22.547255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-28f5aadc-f959-4285-baed-e450d6b2ca5a req-867c3fab-9b59-4fe7-ba6e-e572db63edf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067548 Oct 04 17:50:22.554187 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 181/374] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:22.594648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.595767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:22.608359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.608865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.613919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.614877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:22.615427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:22.615950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:22.804411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20ef8ec6-3ca6-4c58-81ff-ee31d62f9e08 tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.822937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20ef8ec6-3ca6-4c58-81ff-ee31d62f9e08 tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] 10.222.0.42 "GET /compute/v2.1/flavors/870545146" status: 200 len: 446 microversion: 2.55 time: 0.462736 Oct 04 17:50:22.823971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 194/375] 10.222.0.42 () {60 vars in 1196 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/flavors/870545146 => generated 446 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:22.838077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3c78dd7-c8bb-460e-97e5-a21c1854ad44 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbf96a670>, body: {"flavor": {"description": "new"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:22.925111 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3c78dd7-c8bb-460e-97e5-a21c1854ad44 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/870545146" status: 200 len: 447 microversion: 2.55 time: 0.090852 Oct 04 17:50:22.937799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 195/376] 10.222.0.42 () {62 vars in 1216 bytes} [Tue Oct 4 17:50:22 2022] PUT /compute/v2.1/flavors/870545146 => generated 447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:50:22.950927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-176841d5-6045-464e-b810-24b232347ad3 tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:22.995020 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-176841d5-6045-464e-b810-24b232347ad3 tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.050068 Oct 04 17:50:22.995624 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 196/377] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:23.021932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9880c3d6-2bea-408b-abe4-692cc4db902e tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.052365 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9880c3d6-2bea-408b-abe4-692cc4db902e tempest-FlavorsV255TestJSON-1849436349 tempest-FlavorsV255TestJSON-1849436349-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.034540 Oct 04 17:50:23.065921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 197/378] 10.222.0.42 () {60 vars in 1166 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:23.073404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.074255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:23.082203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.084778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.085746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.087898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.088825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.089625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.237920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:23.247550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6eaa316d-d280-4d53-a94f-6c377c7965a6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1271 microversion: 2.1 time: 0.178826 Oct 04 17:50:23.261884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 198/379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:23.261884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16cfa118-9d52-43d6-b1ae-a4eb787ee792 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.280273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16cfa118-9d52-43d6-b1ae-a4eb787ee792 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/870545146" status: 202 len: 0 microversion: 2.55 time: 0.030107 Oct 04 17:50:23.280831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 199/380] 10.222.0.42 () {60 vars in 1199 bytes} [Tue Oct 4 17:50:23 2022] DELETE /compute/v2.1/flavors/870545146 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:50:23.288617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe4c2ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:23.405633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.406149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.406782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.407900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.408514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.409130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.471985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.472149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:23.474386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.475661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.476640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.477860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.478451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.516194 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8edcd75c-f9d6-4134-a5bd-497f07c52e4c tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1319 microversion: 2.1 time: 0.913151 Oct 04 17:50:23.519855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 182/381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:22 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1319 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:23.540935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e81157e5-dde2-4ce6-8d51-e66b5c5ed0c9 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.599942 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e81157e5-dde2-4ce6-8d51-e66b5c5ed0c9 tempest-FlavorsV255TestJSON-845224607 tempest-FlavorsV255TestJSON-845224607-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.075429 Oct 04 17:50:23.629767 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 183/382] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:23.635463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.647680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:23.657729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.660558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.664622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.671261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee221533-8ce8-422d-bd0e-180ec965a26a tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d?user_id=41d5f284923f4dd7914deab4342a8548" status: 200 len: 240 microversion: 2.36 time: 0.389422 Oct 04 17:50:23.678024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.678024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.678024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.685923 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 200/383] 10.222.0.42 () {62 vars in 1384 bytes} [Tue Oct 4 17:50:23 2022] PUT /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d?user_id=41d5f284923f4dd7914deab4342a8548 => generated 240 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:23.700035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7df4f88c-a04f-4018-a2f1-f303bc860c12 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] Calling method '.version_select at 0x7fbdbe4daee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:23.853184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205d19e5e5fe4781aa8a1bde57a126ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed552cf81af742b7b2f9fa7c78d95b99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:23.865394 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-23d94e71-a554-42f0-8321-d45de37f68cc tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 200 len: 1435 microversion: 2.1 time: 0.233857 Oct 04 17:50:23.868323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 184/384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 1435 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:23.879425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caec5f65-8ebb-495e-8f5d-de011b213812", "name": "network-vif-deleted", "tag": "4717915d-879a-4494-876b-4f51ea52a66c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:23.900840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:23.903814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:23.906155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:23.938891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] Creating event network-vif-deleted:4717915d-879a-4494-876b-4f51ea52a66c for instance caec5f65-8ebb-495e-8f5d-de011b213812 on n-h1-831194-21 Oct 04 17:50:23.949206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d9930c3d-a72f-43e7-92d3-054a586ed1a3 req-8f09fbba-10f9-4920-b484-c1322f5d161d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078873 Oct 04 17:50:23.953338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 185/385] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:24.275933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:24.276895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:24.287646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:24.289915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:24.290885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:24.292257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:24.294424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:24.296216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:24.828731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7df4f88c-a04f-4018-a2f1-f303bc860c12 tempest-QuotasAdminTestV236-610664839 tempest-QuotasAdminTestV236-610664839-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d?user_id=41d5f284923f4dd7914deab4342a8548" status: 200 len: 282 microversion: 2.36 time: 1.140883 Oct 04 17:50:24.837386 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 201/386] 10.222.0.42 () {60 vars in 1364 bytes} [Tue Oct 4 17:50:23 2022] GET /compute/v2.1/os-quota-sets/25cf8311898e44ddaf155adb3f893a3d?user_id=41d5f284923f4dd7914deab4342a8548 => generated 282 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:24.879241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:24.882175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:24.904937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:24.909600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:24.911168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:24.913786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:24.914415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:24.915193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.224966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.238774 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bef50462-0769-4069-b85f-9a0df082100b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.963929 Oct 04 17:50:25.239793 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 186/387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:24 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:25.244550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.249941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] [instance: caec5f65-8ebb-495e-8f5d-de011b213812] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:25.269328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.269858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.270305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.271016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.271477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.272252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.301512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] HTTP exception thrown: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Request method failure captured: Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 HTTP/1.1 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJH7Aw3dUyLwc1_NOVO4tN0r09BBfv1WSl2P_hxxQv8lx1tbwrd_WWc0rId4PCb4WqrqpE7yzEBVsTP9CNncFAn6ALsEk9hqf3bWiHMKylIvPi4pHRxOvntY31GhGQ2N60xFWfVAs5XB9cSUjxIGt_Xw-WA1kbRAXzOujO4Dt-uGT0 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ed552cf81af742b7b2f9fa7c78d95b99 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:25.305538 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ed552cf81af742b7b2f9fa7c78d95b99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ed552cf81af742b7b2f9fa7c78d95b99 Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-899371884 Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiagnosticsNegativeTest-899371884-project Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 205d19e5e5fe4781aa8a1bde57a126ec Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-899371884-project Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. Oct 04 17:50:25.307034 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'caec5f65-8ebb-495e-8f5d-de011b213812'} Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:25.307885 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. Oct 04 17:50:25.309275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:25.310501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] Returning 404 to user: Instance caec5f65-8ebb-495e-8f5d-de011b213812 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:25.310501 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf23c3e0-4f94-4607-8949-6fab07f89d3e tempest-ServerDiagnosticsNegativeTest-899371884 tempest-ServerDiagnosticsNegativeTest-899371884-project] 10.222.0.42 "GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812" status: 404 len: 111 microversion: 2.1 time: 0.066519 Oct 04 17:50:25.315620 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 187/388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:25 2022] GET /compute/v2.1/servers/caec5f65-8ebb-495e-8f5d-de011b213812 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:25.580843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:25.596928 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a4934fa-6751-4350-bba6-cfeac3ef8bc5 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1467 microversion: 2.1 time: 0.748101 Oct 04 17:50:25.598881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 202/389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:24 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1467 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:25.623371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:25.625700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:25.633357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.634302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.634750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.638378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.639083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.639533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.818267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:25.832621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-64d7cbd6-c360-488a-870c-b0333ddf594b tempest-DeleteServersAdminTestJSON-819423563 tempest-DeleteServersAdminTestJSON-819423563-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c/action" status: 202 len: 0 microversion: 2.1 time: 0.213667 Oct 04 17:50:25.837028 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 188/390] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:25 2022] POST /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:25.843494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:25.844611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:25.852780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.857906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.859459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.862516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.863736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.864384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.926476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:25.927504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:25.928111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:25.928936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lazy-loading 'fault' on Instance uuid 3c682ce9-4e9a-464b-9468-1258137fa08c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:26.274337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.274963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:26.312369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.313015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.313462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.314205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.317946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.319461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.362008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:26.373877 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75fce993-0f35-437a-9923-72d174500ea0 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1450 microversion: 2.1 time: 0.535326 Oct 04 17:50:26.377781 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 203/391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:25 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1450 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:26.404693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.405499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:26.414359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.417935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.419821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.420575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.421044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.421478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.500847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:50:26.709921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:26.720319 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b7cfa35-41c4-4a83-80fa-cc7f403a24c1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.459126 Oct 04 17:50:26.723894 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 189/392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:26 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:26.787895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a60a514-a031-4d09-a041-e73b1752db71", "tag": "0ecf06b7-4ab2-489e-a83b-0db3120d4394"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:26.808165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.809249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.810633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.829006 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0c17e165-2a57-489a-8e89-4c0e70185b8f tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 204 len: 0 microversion: 2.1 time: 0.431868 Oct 04 17:50:26.829711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 204/393] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:26 2022] DELETE /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:50:26.841211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] Creating event network-changed:0ecf06b7-4ab2-489e-a83b-0db3120d4394 for instance 2a60a514-a031-4d09-a041-e73b1752db71 on n-h2-831194-21 Oct 04 17:50:26.848961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a475650c-e454-48d5-b024-c3f18df197fe req-426f6a2e-655a-4599-9043-c38bf3690d8e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064873 Oct 04 17:50:26.860407 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 190/394] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:26.864130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:26.867813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:26.904963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.907909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.908625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.910272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.912050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.913912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.987945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:26.988442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:26.988884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:26.990641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lazy-loading 'fault' on Instance uuid 3c682ce9-4e9a-464b-9468-1258137fa08c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:27.247496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:27.257246 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52946299-db8c-419d-8b88-c0b0b26d430e tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1456 microversion: 2.1 time: 0.415633 Oct 04 17:50:27.266516 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 205/395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:26 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1456 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:27.749928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:27.751303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:27.764860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.766904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.768405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:27.769486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:27.770139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:27.772281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.291861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:28.292726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:28.305650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:28.307161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:28.309054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.310561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:28.312773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:28.314346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.401490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:28.404676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:28.405391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:28.406983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lazy-loading 'fault' on Instance uuid 3c682ce9-4e9a-464b-9468-1258137fa08c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:28.674816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:28.691601 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91d80ee0-ea07-4909-bfaa-aedd54d9dee9 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1456 microversion: 2.1 time: 0.399983 Oct 04 17:50:28.693698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 206/396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:28 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1456 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:28.714240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:28.725688 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71c718e1-9bdd-4817-ade2-24b6c9eac3ff tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.980899 Oct 04 17:50:28.736691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 191/397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:27 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:29.638788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c682ce9-4e9a-464b-9468-1258137fa08c", "name": "network-vif-deleted", "tag": "0613a95c-1044-4b3c-9ee3-10e5e261cbca"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:29.652366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.654009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.655513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.695824 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] Creating event network-vif-deleted:0613a95c-1044-4b3c-9ee3-10e5e261cbca for instance 3c682ce9-4e9a-464b-9468-1258137fa08c on n-h1-831194-21 Oct 04 17:50:29.711743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4519732c-efbf-4ab9-a3a6-0c8c1f17b319 req-f285e373-a993-4eb3-a972-10ec04854aa8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075452 Oct 04 17:50:29.720198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:29.721547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:29.726124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 207/398] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:29.734751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.736439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.737217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.737988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.738594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.739295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.765447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:29.766358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:29.777858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.783297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.786251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.789179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.791536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.794091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.818258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:29.818946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:29.819691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:29.820350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lazy-loading 'fault' on Instance uuid 3c682ce9-4e9a-464b-9468-1258137fa08c {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:50:29.923751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '271f007582e7427ba4931f5abe921fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093b213cf7734de0977b044435403d1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:29.948002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8f679dd-71af-4103-8be0-c57ea64c6af2 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 200 len: 1287 microversion: 2.1 time: 0.226507 Oct 04 17:50:29.948961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 192/399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:29 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 1287 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:30.156563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:30.167788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b651abe3-2707-4088-a833-30a7fb0bc8f4 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.407951 Oct 04 17:50:30.184778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 208/400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:29 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:30.972632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:30.974925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:30.983287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.984443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.985206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:30.986766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:30.987706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:30.988992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.010416 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c HTTP/1.1 Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:31.013299 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.014797 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3c682ce9-4e9a-464b-9468-1258137fa08c'} Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:31.015742 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.016838 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.019497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:31.020542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9cfa828c-39bf-4499-9ded-db7ba717de26 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 404 len: 111 microversion: 2.1 time: 0.052245 Oct 04 17:50:31.022026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 209/401] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:30 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:50:31.035105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.035849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.042488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.043975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.044801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.045685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.046331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.047173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.065390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c HTTP/1.1 Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:31.067712 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.068870 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3c682ce9-4e9a-464b-9468-1258137fa08c'} Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:31.069528 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.070688 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.071752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:31.071823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92b5e7c5-282c-4aba-bc5c-a23994c73a02 tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 404 len: 111 microversion: 2.1 time: 0.040684 Oct 04 17:50:31.074686 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 210/402] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:31 2022] DELETE /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:50:31.085586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.086231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: 3c682ce9-4e9a-464b-9468-1258137fa08c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.094132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.094811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.095438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.096393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.096931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.097494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.124793 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c HTTP/1.1 Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:31.126710 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.127900 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3c682ce9-4e9a-464b-9468-1258137fa08c'} Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:31.128634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. Oct 04 17:50:31.133026 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.134101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance 3c682ce9-4e9a-464b-9468-1258137fa08c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:31.134101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb8d589c-0ce6-4f6d-8bb0-36315f6390be tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c" status: 404 len: 111 microversion: 2.1 time: 0.049181 Oct 04 17:50:31.134101 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 211/403] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/servers/3c682ce9-4e9a-464b-9468-1258137fa08c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:31.136328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0337596e-970b-4d77-bfc1-979a8bdd48b7 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-661848660", "id": 236862515, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:31.137727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.137821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.145473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.146177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.146510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.147228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.147688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.148151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.154304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:31.171443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 HTTP/1.1 Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:31.173806 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.175044 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b08abdc0-b2de-490b-a4ed-b390524a9426'} Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:31.175792 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.177174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.180899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:31.180899 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66637ad6-cbf3-4636-bbcb-8d1ce8aafaeb tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 404 len: 111 microversion: 2.1 time: 0.042433 Oct 04 17:50:31.180899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 212/404] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:50:31 2022] DELETE /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:31.181343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0337596e-970b-4d77-bfc1-979a8bdd48b7 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.556108 Oct 04 17:50:31.189194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.189946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] [instance: b08abdc0-b2de-490b-a4ed-b390524a9426] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.190546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 193/405] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:50:30 2022] POST /compute/v2.1/flavors => generated 467 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:31.197928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.198628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:31.200709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.201221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.201669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.203564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.204057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.204493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.207093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.207793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.208331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.209066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:31.209576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:31.210253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:31.223250 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] HTTP exception thrown: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Request method failure captured: Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 HTTP/1.1 Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHIq5wzLMJIZrEluIewt47fATFcBbRdKgNTL9_EgIVYzavG9-MP2tNCUlXrh1oDOG8D42bXmqgbaVlJ3cq7BpqnGYkHITonedo3_paH1C_djYVKeC-GDU7eOtC7f2i82TSdF7dJXk2k02E4CaIUm1XlA38pb_PhPMV8fZBal-nAl0wY Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:50:31.226382 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/093b213cf7734de0977b044435403d1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/093b213cf7734de0977b044435403d1c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_093b213cf7734de0977b044435403d1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 093b213cf7734de0977b044435403d1c Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-154196002 Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 271f007582e7427ba4931f5abe921fb6 Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersAdminTestJSON-154196002-project Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.227565 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b08abdc0-b2de-490b-a4ed-b390524a9426'} Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:31.228220 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. Oct 04 17:50:31.229268 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:31.233015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] Returning 404 to user: Instance b08abdc0-b2de-490b-a4ed-b390524a9426 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:31.235863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e22b2d3-eb09-4aee-9973-5c97107c5c4d tempest-DeleteServersAdminTestJSON-154196002 tempest-DeleteServersAdminTestJSON-154196002-project] 10.222.0.42 "GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426" status: 404 len: 111 microversion: 2.1 time: 0.053711 Oct 04 17:50:31.237212 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 213/406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/servers/b08abdc0-b2de-490b-a4ed-b390524a9426 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:31.242977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-094ea4a6-d1a8-40cb-b4fe-02a910cf1610 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:31.426446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=2,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:31.454807 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-094ea4a6-d1a8-40cb-b4fe-02a910cf1610 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/236862515/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.216045 Oct 04 17:50:31.456029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 214/407] 10.222.0.42 () {62 vars in 1262 bytes} [Tue Oct 4 17:50:31 2022] POST /compute/v2.1/flavors/236862515/os-extra_specs => generated 62 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:31.468386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e48f7ff-1781-4cc1-9d20-02cb04ea6c7e tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.471831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:31.482143 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab07abba-5f2e-4b59-9905-ca0299fe0224 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.290222 Oct 04 17:50:31.482737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 194/408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:31.506326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e48f7ff-1781-4cc1-9d20-02cb04ea6c7e tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/236862515" status: 202 len: 0 microversion: 2.86 time: 0.043451 Oct 04 17:50:31.507571 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 215/409] 10.222.0.42 () {60 vars in 1199 bytes} [Tue Oct 4 17:50:31 2022] DELETE /compute/v2.1/flavors/236862515 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:50:31.516959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a8cb1d4d-6f97-463b-89c9-bccc686bee96 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:31.541235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a8cb1d4d-6f97-463b-89c9-bccc686bee96 tempest-FlavorMetadataValidation-1475427538 tempest-FlavorMetadataValidation-1475427538-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.028584 Oct 04 17:50:31.542002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 195/410] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:50:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:32.326622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a60a514-a031-4d09-a041-e73b1752db71", "name": "network-vif-plugged", "status": "completed", "tag": "0ecf06b7-4ab2-489e-a83b-0db3120d4394"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:32.353216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.354571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.357701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.379461 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] Creating event network-vif-plugged:0ecf06b7-4ab2-489e-a83b-0db3120d4394 for instance 2a60a514-a031-4d09-a041-e73b1752db71 on n-h2-831194-21 Oct 04 17:50:32.392880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-701ff215-2e07-4578-b59e-9c69722ceabf req-7d3b8b0c-bbbe-41ae-9e7e-3fe95834ad81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071145 Oct 04 17:50:32.397726 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 216/411] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:32.508479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:32.509098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:32.511117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:32.513069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=19 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:32.531826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.532339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.532777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.533500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:32.533984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:32.534418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:32.727501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:32.743261 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d76aa7e1-4886-4024-990e-01b8f39631ab tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.238853 Oct 04 17:50:32.744325 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 196/412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:32 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:33.500214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=13 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:33.690716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe31f5e0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:33.695784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.696504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.697136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.705334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.706182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.706813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.718735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] HTTP exception thrown: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Request method failure captured: Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 HTTP/1.1 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 56 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJp9Z7gfekycXPJ256o1hLhJQKe2AHR6A5SoVzCv9ZI7woeTHXZAAUypVtFKk9lR73dBkNr7pZNdXegYwS9sBrfRm-KH6c1-WKoenSGDpNnePl5_Fb1YC4AwlECSl_f2_no-KOMq4l2LMoL0VCmi_xHsvzD2MrOV2ZGTtPCfd4BAoA Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:33.721361 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3558690640a341fe92335aafb6eb1676 Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:50:33.723021 n-d-831194-21 devstack@n-api.service[128849]: exception: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '98ab5cf4-f64f-436e-92e3-b9daa448d949', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.723927 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.725334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:33.726717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:33.726717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.726717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.727652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Returning 404 to user: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:33.728660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56d12e40-3b50-44fd-a96d-6b634789f645 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949" status: 404 len: 110 microversion: 2.53 time: 0.572070 Oct 04 17:50:33.729767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 217/413] 10.222.0.42 () {62 vars in 1309 bytes} [Tue Oct 4 17:50:33 2022] PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 => generated 110 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:33.741278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe3339d0>, body: {"status": "disabled"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:33.746355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.747599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.748320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.769221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:33.769983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:33.770677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.771388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.772031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.780158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.780997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.787783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.789177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.790252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.791807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.792467 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] HTTP exception thrown: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Request method failure captured: Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 HTTP/1.1 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 22 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJp9Z7gfekycXPJ256o1hLhJQKe2AHR6A5SoVzCv9ZI7woeTHXZAAUypVtFKk9lR73dBkNr7pZNdXegYwS9sBrfRm-KH6c1-WKoenSGDpNnePl5_Fb1YC4AwlECSl_f2_no-KOMq4l2LMoL0VCmi_xHsvzD2MrOV2ZGTtPCfd4BAoA Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:33.795376 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3558690640a341fe92335aafb6eb1676 Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: {"status": "disabled"} Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: exception: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.796615 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '98ab5cf4-f64f-436e-92e3-b9daa448d949', 'body': {'status': 'disabled'}} Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.797538 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:33.799168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:33.800816 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.800816 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.806773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Returning 404 to user: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:33.812270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7bc672c1-c791-4d60-858d-237bb1c76c22 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949" status: 404 len: 110 microversion: 2.53 time: 0.074158 Oct 04 17:50:33.814253 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 197/414] 10.222.0.42 () {62 vars in 1309 bytes} [Tue Oct 4 17:50:33 2022] PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 => generated 110 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:33.831010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe3ed670>, body: {"status": "enabled"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:33.840533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.843557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.845200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.861818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.865804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.866810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.878150 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] HTTP exception thrown: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Request method failure captured: Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 HTTP/1.1 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 21 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJp9Z7gfekycXPJ256o1hLhJQKe2AHR6A5SoVzCv9ZI7woeTHXZAAUypVtFKk9lR73dBkNr7pZNdXegYwS9sBrfRm-KH6c1-WKoenSGDpNnePl5_Fb1YC4AwlECSl_f2_no-KOMq4l2LMoL0VCmi_xHsvzD2MrOV2ZGTtPCfd4BAoA Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:33.880245 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3edb9dd0eff4918942b7cdf4dc84fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b3edb9dd0eff4918942b7cdf4dc84fde Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439 Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3558690640a341fe92335aafb6eb1676 Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: {"status": "enabled"} Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: exception: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.881579 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '98ab5cf4-f64f-436e-92e3-b9daa448d949', 'body': {'status': 'enabled'}} Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.882437 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:33.883573 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:33.884606 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. Oct 04 17:50:33.884606 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:33.887962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Returning 404 to user: Service 98ab5cf4-f64f-436e-92e3-b9daa448d949 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:33.889098 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ab78c28-60f5-42c1-a10f-80da2bef651c tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949" status: 404 len: 110 microversion: 2.53 time: 0.069762 Oct 04 17:50:33.890235 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 198/415] 10.222.0.42 () {62 vars in 1309 bytes} [Tue Oct 4 17:50:33 2022] PUT /compute/v2.1/os-services/98ab5cf4-f64f-436e-92e3-b9daa448d949 => generated 110 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:50:33.921526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:33.927146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.927842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.928751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.932864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:33.934418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:33.935520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:33.986394 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf477446-aabb-4d39-8f0e-5964fea97ce7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.087588 Oct 04 17:50:33.987740 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 199/416] 10.222.0.42 () {60 vars in 1178 bytes} [Tue Oct 4 17:50:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:34.013174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.019574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.020560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.022096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.024449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.025080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.025523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.072467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:34.095353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-867dd7f5-3e5d-473e-9fb8-286c739b27de tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.095656 Oct 04 17:50:34.098864 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 200/417] 10.222.0.42 () {60 vars in 1211 bytes} [Tue Oct 4 17:50:33 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:34.114709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.120032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.120517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.121183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.124112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.128473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.129016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.186215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:34.197921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68bf718e-0435-466f-bf0a-1a61e950470a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1313 microversion: 2.1 time: 0.435177 Oct 04 17:50:34.208249 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 218/418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:33 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:34.217252 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2812080d-76cb-4d1e-a1e8-151a7d126504 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.107280 Oct 04 17:50:34.222092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 201/419] 10.222.0.42 () {60 vars in 1178 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:34.243354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.253440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.253983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.254449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.258590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.259075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.259861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.331411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-85e402ef-df43-47e0-9983-d11878c9d5e7 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=n-d-831194-21&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.096650 Oct 04 17:50:34.332028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 219/420] 10.222.0.42 () {60 vars in 1237 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/os-services?host=n-d-831194-21&binary=xxx => generated 16 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:34.347437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.352269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.353293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.353845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.354693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.356184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.356851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.389547 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13960332-f28b-4f24-a85a-988a3263ecd3 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.046888 Oct 04 17:50:34.390911 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 202/421] 10.222.0.42 () {60 vars in 1178 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:34.408106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:34.415878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.416760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.418842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.420011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:34.421420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:34.422161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:34.454571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2cec0fb6-4b92-4f2c-975a-3ee219165d24 tempest-ServicesAdminNegativeV253TestJSON-206234439 tempest-ServicesAdminNegativeV253TestJSON-206234439-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.054540 Oct 04 17:50:34.456640 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 220/422] 10.222.0.42 () {60 vars in 1239 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:35.178831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:35.186988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '203b44c3323b4ee7aea02a66f19ed6c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e54ef578a6b4c64beb957e90b88e298', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] Request method failure captured: Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJmlFTuCIrD-SZa33C0ftNqmQcDUHwRiOjrp77ZYk2ottFF0uZkYTvRdUjZZgWjBNE4mWHT5h75xqqNTYtskIm2TgAc2xRGX_jmwfG2G4j34J1H_NUeuR-coGZC1Sgev8WLqFDHhiG61Gx9vYXNUkJ6IrB8espcNGkR-ABlI_nGXRI Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.53 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 3e54ef578a6b4c64beb957e90b88e298 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1514638222 Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:35.190749 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3e54ef578a6b4c64beb957e90b88e298"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e54ef578a6b4c64beb957e90b88e298"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3e54ef578a6b4c64beb957e90b88e298"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3e54ef578a6b4c64beb957e90b88e298"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1514638222 Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 3e54ef578a6b4c64beb957e90b88e298 Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1514638222 Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1514638222-project Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 203b44c3323b4ee7aea02a66f19ed6c9 Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1514638222-project Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:35.192025 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:35.192815 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 04 17:50:35.194025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:35.203086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:35.204195 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] 10.222.0.42 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.737245 Oct 04 17:50:35.207176 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 203/423] 10.222.0.42 () {60 vars in 1178 bytes} [Tue Oct 4 17:50:34 2022] GET /compute/v2.1/os-services => generated 112 bytes in 739 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:35.241210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:35.241846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:35.244119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=32 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:35.256344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.262725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.263440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.264379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:35.265005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:35.265621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:35.796919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:35.798471 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e011833c-8204-4f4a-a394-6f7e09d2b0f5 tempest-ServicesAdminNegativeV253TestJSON-1514638222 tempest-ServicesAdminNegativeV253TestJSON-1514638222-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001782 Oct 04 17:50:35.799261 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 204/424] 10.222.0.42 () {56 vars in 886 bytes} [Tue Oct 4 17:50:35 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 17:50:35.992807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:36.004495 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-466a925b-6d6d-47e8-9ae5-5754997b2027 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1463 microversion: 2.1 time: 0.767708 Oct 04 17:50:36.019721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 221/425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:35 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1463 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:36.514275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:36.523238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'deleted': False, 'project_id': '847fe84f2adc47c3b442eeb254ff5052'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:36.544281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.545081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.546479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.548543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.550431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.551197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.767583 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77ec81bb-b5f8-4126-b5af-20fe8f6b98e6 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.734104 Oct 04 17:50:36.767583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 205/426] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:36 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:36.793287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:36.802834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'deleted': False} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:36.819195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.821794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.822480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:36.825973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:36.826777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:36.827411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:37.045857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:50:37.230712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:37.232080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:37.232785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.109104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-194334994", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:38.239706 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cadb02de-ea59-4791-9a3d-7f1bce703af5 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 4830 microversion: 2.1 time: 1.451026 Oct 04 17:50:38.241074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:38.241511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:38.242119 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 222/427] 10.222.0.42 () {58 vars in 1171 bytes} [Tue Oct 4 17:50:36 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 4830 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:38.256215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:38.256733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:38.257167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:38.277502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.285582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.286409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.287072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.287946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.288587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'deleted': False, 'project_id': '847fe84f2adc47c3b442eeb254ff5052'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:38.289239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.289856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.307261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.307783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.308430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.310679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.312998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.315297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.335532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Getting quotas for project 64b456357702463285e32b96eb859f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:38.352777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Getting quotas for user d4f4074aed4d4417a26570763f08632d and project 64b456357702463285e32b96eb859f1a. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:38.400691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:38.404993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:38.510434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0334267f-1486-4ae4-95e1-085a67b2e96b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.964356 Oct 04 17:50:38.514486 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 206/428] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:50:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:50:38.535267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:38.545366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:38.576523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-209cbbf7-ba5a-4629-ba58-ee8282b15f95 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?tenant_id=5e2e949182104c65a654c04496273e81" status: 200 len: 15 microversion: 2.1 time: 0.305721 Oct 04 17:50:38.578991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 223/429] 10.222.0.42 () {58 vars in 1231 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/servers/detail?tenant_id=5e2e949182104c65a654c04496273e81 => generated 15 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:50:38.610999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:38.639622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'tenant_id': '5e2e949182104c65a654c04496273e81', 'deleted': False} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:38.680913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.681473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.681941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.687690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.691182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.692734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.792833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:50:38.956963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:38.957628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:38.958941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:38.965158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:38.981201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:38.987795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.015295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc9bc288-bab4-425a-97b4-ffbd9fac74de tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "PUT /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1358 microversion: 2.75 time: 0.485775 Oct 04 17:50:39.018385 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 207/430] 10.222.0.42 () {62 vars in 1297 bytes} [Tue Oct 4 17:50:38 2022] PUT /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1358 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:39.046779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.048433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:39.198055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.216556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.219891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.235583 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6602226e-5619-430a-810e-ca5df1bd8a80 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1358 microversion: 2.75 time: 0.194345 Oct 04 17:50:39.236967 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 208/431] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:50:39.262394 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33f0d70d-d63b-49a8-b516-4a3c8f7d4374 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5e2e949182104c65a654c04496273e81" status: 200 len: 4830 microversion: 2.1 time: 0.657375 Oct 04 17:50:39.275181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 224/432] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 17:50:38 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5e2e949182104c65a654c04496273e81 => generated 4830 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:39.296402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.306288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'tenant_id': '847fe84f2adc47c3b442eeb254ff5052', 'deleted': False} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:39.334783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.337942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.338472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.343881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.344304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.344804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.434078 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a36b4d0-34af-45f2-9255-7a3038bb7092 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=847fe84f2adc47c3b442eeb254ff5052" status: 200 len: 15 microversion: 2.1 time: 0.135199 Oct 04 17:50:39.454955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 209/433] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=847fe84f2adc47c3b442eeb254ff5052 => generated 15 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:50:39.460032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8401ba36-96ab-4512-b3c7-303ccf688d7e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.467110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8401ba36-96ab-4512-b3c7-303ccf688d7e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.010672 Oct 04 17:50:39.482680 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 225/434] 10.222.0.42 () {58 vars in 1189 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:39.497402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:39.503389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:39.511870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.514572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.517938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.519260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.519876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.520650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.735930 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ec8d0f8-909e-41ce-801b-3b6491672b07 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 0 microversion: 2.1 time: 0.243821 Oct 04 17:50:39.739566 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 210/435] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:39 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:39.749678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:39.767724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:39.768912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5e2e949182104c65a654c04496273e81'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:39.780675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.781710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.782411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:39.784037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:39.785244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:39.786032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.128527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:50:40.269297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:40.270098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:40.284822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.288068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.301506 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a95208c9-b653-4e7f-93a4-18bb7181575a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.557036 Oct 04 17:50:40.302712 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 226/436] 10.222.0.42 () {58 vars in 1150 bytes} [Tue Oct 4 17:50:39 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:40.310856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.315442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:40.317714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.318314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.318772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.319618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:40.335677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.336197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.337866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.341470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.342470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.344115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.641521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc180222-4de3-47cc-b1b9-eced523dc88c tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 0 microversion: 2.1 time: 0.329747 Oct 04 17:50:40.645209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 227/437] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:40 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:40.660819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:40.664987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:40.690308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.694734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.694948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:40.702867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:40.705130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:40.706183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.124169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.153274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.155985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:41.170323 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f71a3f2-8f79-4955-9dd6-95d7f98f4cbf tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1410 microversion: 2.75 time: 0.905596 Oct 04 17:50:41.171616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 211/438] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:40 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1410 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:50:41.208961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ac88945-8691-49ce-92cf-433f57818732 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1617 microversion: 2.1 time: 0.561141 Oct 04 17:50:41.230532 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 228/439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:40 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1617 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:41.249814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:41.250816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:41.259325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.260601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.262115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.263086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.264284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.264920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.749094 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c68d33f6-3710-4356-9589-e5721499677d tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1617 microversion: 2.1 time: 0.504085 Oct 04 17:50:41.759712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 212/440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:41 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1617 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:41.775534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:41.789992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'host': 'n-h2-831194-21', 'deleted': False} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:41.801881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.807315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.808719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:41.809907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:41.811346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:41.812148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.111607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:50:42.203847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:42.204506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:42.212892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.216254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.218308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.219224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.220859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.221998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.291738 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd1eb0c8-91ab-4199-8c15-3e28b2837491 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=n-h2-831194-21&all_tenants=1" status: 200 len: 989 microversion: 2.1 time: 0.522613 Oct 04 17:50:42.300784 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 229/441] 10.222.0.42 () {58 vars in 1192 bytes} [Tue Oct 4 17:50:41 2022] GET /compute/v2.1/servers?host=n-h2-831194-21&all_tenants=1 => generated 989 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:42.311473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:42.323480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:50:42.342201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.343018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.345216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.347156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.351305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.352101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.421342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:42.424281 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d6dc2b9-960b-4c7a-a1d6-c345a85158f8 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.085953 Oct 04 17:50:42.436363 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 230/442] 10.222.0.42 () {58 vars in 1196 bytes} [Tue Oct 4 17:50:42 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:42.440451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:42.441446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:42.446045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:42.458984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:42.461303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ddde59c2-b096-4c03-af2e-55fb8fcdf3c8 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1416 microversion: 2.75 time: 0.260630 Oct 04 17:50:42.463701 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 213/443] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:42 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1416 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:42.474322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.474945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.475575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.476503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.477141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.477684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.639481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1bd40dbf-d510-4968-b833-287b3f99cd0e tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 0 microversion: 2.1 time: 0.201484 Oct 04 17:50:42.643266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 231/444] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:42 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:42.648617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:42.651277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:42.676277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.676833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.677285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.679942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:42.680408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:42.686972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:42.909349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:42.909950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:42.910269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:42.910676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:42.911086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:43.067601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:43.101506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.115274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.116156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.116820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.117811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.118512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.119164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.194134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79706194-b1e9-4fb1-85fa-bf156d1ae452 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 1068 microversion: 2.1 time: 0.548604 Oct 04 17:50:43.196467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 214/445] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:50:42 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 1068 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:50:43.214571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.215488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.227881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.230458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.231245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.234710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.235420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.236352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.587318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c4b9899-fae1-4e3e-ab07-925af1420f6a tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1961840324", "ram": 512, "vcpus": 1, "disk": 10, "id": 769995084, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:43.697486 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c4b9899-fae1-4e3e-ab07-925af1420f6a tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.587446 Oct 04 17:50:43.699466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 232/446] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:43 2022] POST /compute/v2.1/flavors => generated 413 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:50:43.729052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:43.737361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:43.761715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.762188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.767990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.770303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:43.772215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:43.782355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:43.822715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:44.203935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.216548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-55d4b204-8737-47c3-a939-3e3d7c3557d1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 1.005552 Oct 04 17:50:44.217142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 215/447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:44.236045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.248914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.255893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.274471 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4fa48bff-7bad-46c1-9e3a-11387ee57907 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1437 microversion: 2.75 time: 0.571649 Oct 04 17:50:44.277928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 233/448] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:43 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1437 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:44.722142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-392d1feb-43f1-4c67-a16d-f82c82f27da9 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.735136 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-392d1feb-43f1-4c67-a16d-f82c82f27da9 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.455790 Oct 04 17:50:44.754036 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 234/449] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:44.764315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:44.780094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:44.812395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.813151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.814174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc4e5d32-f82f-4b39-a555-7aad92c54ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:44.814579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.815453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:44.818122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:44.818807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:44.831838 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-fc4e5d32-f82f-4b39-a555-7aad92c54ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] HTTP exception thrown: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc4e5d32-f82f-4b39-a555-7aad92c54ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Request method failure captured: Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJw_woWrt0OrrI9fHotBo6EYJD8ldeBw-dA6UgVcHKdVZflgjB78Lrshrde5muAKSc7feuMp7gLDSQe7v6ySEVgS99fSigwIoP3J0w_Q5i2j4d8vPVBZWGH2WO5bdjlCD0GRMyGT1kZjI4bPk40QsjsdbkB_JhpA9doELMVknPB69w Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:44.843874 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c1209fe60e8f4ea7a22a8fb54b56a4d4 Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:44.845678 n-d-831194-21 devstack@n-api.service[128850]: exception: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'flavor_id': '769995084', 'id': 'hw:cpu_thread_policy'} Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:44.846489 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc4e5d32-f82f-4b39-a555-7aad92c54ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Returning 404 to user: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:44.847999 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc4e5d32-f82f-4b39-a555-7aad92c54ae1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] 10.222.0.42 "GET /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.629619 Oct 04 17:50:44.853963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 216/450] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:50:44 2022] GET /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 636 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:44.862991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe4072e6-5cea-4c84-af6d-e0d00404fca1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:44.889746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe4072e6-5cea-4c84-af6d-e0d00404fca1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'c1209fe60e8f4ea7a22a8fb54b56a4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2af5b9278cd4eef9feeda4ffa4084ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe4072e6-5cea-4c84-af6d-e0d00404fca1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Request method failure captured: Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/flavors/769995084/os-extra_specs HTTP/1.1 Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 66 Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJw_woWrt0OrrI9fHotBo6EYJD8ldeBw-dA6UgVcHKdVZflgjB78Lrshrde5muAKSc7feuMp7gLDSQe7v6ySEVgS99fSigwIoP3J0w_Q5i2j4d8vPVBZWGH2WO5bdjlCD0GRMyGT1kZjI4bPk40QsjsdbkB_JhpA9doELMVknPB69w Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:44.891472 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c1209fe60e8f4ea7a22a8fb54b56a4d4 Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 04 17:50:44.892943 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'flavor_id': '769995084', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:44.893878 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 04 17:50:44.895140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:44.905639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe4072e6-5cea-4c84-af6d-e0d00404fca1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:44.908302 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe4072e6-5cea-4c84-af6d-e0d00404fca1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] 10.222.0.42 "POST /compute/v2.1/flavors/769995084/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.051862 Oct 04 17:50:44.909787 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 217/451] 10.222.0.42 () {60 vars in 1221 bytes} [Tue Oct 4 17:50:44 2022] POST /compute/v2.1/flavors/769995084/os-extra_specs => generated 124 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:44.923343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-162bb47a-21e8-4579-b9fb-06e499b9f19c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:45.044294 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-162bb47a-21e8-4579-b9fb-06e499b9f19c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/769995084/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.124808 Oct 04 17:50:45.050235 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 218/452] 10.222.0.42 () {60 vars in 1221 bytes} [Tue Oct 4 17:50:44 2022] POST /compute/v2.1/flavors/769995084/os-extra_specs => generated 66 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:45.055450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc8fdf71-e013-4582-b8ba-e8b6a75d2b89 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.055919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:45.056360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:45.056845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:45.056956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc8fdf71-e013-4582-b8ba-e8b6a75d2b89 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'c1209fe60e8f4ea7a22a8fb54b56a4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2af5b9278cd4eef9feeda4ffa4084ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.057255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc8fdf71-e013-4582-b8ba-e8b6a75d2b89 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Request method failure captured: Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJw_woWrt0OrrI9fHotBo6EYJD8ldeBw-dA6UgVcHKdVZflgjB78Lrshrde5muAKSc7feuMp7gLDSQe7v6ySEVgS99fSigwIoP3J0w_Q5i2j4d8vPVBZWGH2WO5bdjlCD0GRMyGT1kZjI4bPk40QsjsdbkB_JhpA9doELMVknPB69w Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:45.059287 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c1209fe60e8f4ea7a22a8fb54b56a4d4 Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:45.060479 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'flavor_id': '769995084', 'id': 'hw:numa_nodes'} Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:45.061223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.062661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc8fdf71-e013-4582-b8ba-e8b6a75d2b89 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:45.063793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:45.084148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc8fdf71-e013-4582-b8ba-e8b6a75d2b89 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] 10.222.0.42 "DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.026369 Oct 04 17:50:45.084148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 219/453] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:50:45 2022] DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:50:45.095585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d05a4bb-560f-48bd-8cbe-81643cff4d02 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:45.158936 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d05a4bb-560f-48bd-8cbe-81643cff4d02 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors/769995084/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.071656 Oct 04 17:50:45.160810 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 220/454] 10.222.0.42 () {60 vars in 1221 bytes} [Tue Oct 4 17:50:45 2022] POST /compute/v2.1/flavors/769995084/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:45.189016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06bb59cb-4cd4-449b-983e-1e61767147a1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:45.208350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:45.220897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.221395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.221849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.222598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.223050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.223473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.228935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06bb59cb-4cd4-449b-983e-1e61767147a1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'c1209fe60e8f4ea7a22a8fb54b56a4d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2af5b9278cd4eef9feeda4ffa4084ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06bb59cb-4cd4-449b-983e-1e61767147a1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Request method failure captured: Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 22 Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJw_woWrt0OrrI9fHotBo6EYJD8ldeBw-dA6UgVcHKdVZflgjB78Lrshrde5muAKSc7feuMp7gLDSQe7v6ySEVgS99fSigwIoP3J0w_Q5i2j4d8vPVBZWGH2WO5bdjlCD0GRMyGT1kZjI4bPk40QsjsdbkB_JhpA9doELMVknPB69w Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:45.243109 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2af5b9278cd4eef9feeda4ffa4084ee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2af5b9278cd4eef9feeda4ffa4084ee Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c1209fe60e8f4ea7a22a8fb54b56a4d4 Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: {"hw:numa_nodes": "1"} Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:45.244340 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'flavor_id': '769995084', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:50:45.245625 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 04 17:50:45.248152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.249729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06bb59cb-4cd4-449b-983e-1e61767147a1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:45.252357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06bb59cb-4cd4-449b-983e-1e61767147a1 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067 tempest-FlavorsExtraSpecsNegativeTestJSON-751243067-project] 10.222.0.42 "PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.081273 Oct 04 17:50:45.258695 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 221/455] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:45 2022] PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes => generated 124 bytes in 88 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:45.278393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.283263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:45.296110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.302416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.306617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.309789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.310928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.313455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.421544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.435374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.455362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.488592 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6e23161-3f73-4470-868d-b35d1a6497fb tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "POST /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3/action" status: 202 len: 1494 microversion: 2.75 time: 0.718826 Oct 04 17:50:45.494786 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 235/456] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:50:44 2022] POST /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3/action => generated 1494 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 17:50:45.516824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3b8f647-1d1b-4262-b62d-88771466d2d7 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.551396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e3b8f647-1d1b-4262-b62d-88771466d2d7 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] HTTP exception thrown: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3b8f647-1d1b-4262-b62d-88771466d2d7 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Request method failure captured: Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJylGyzLbfnR5D5KaNYVgn4kx538dyvDqYmRLaDB8LBH2LgPBe2y6nl0i7OL0oFGrd1kqYCsufu-bU2ZHEdcdNAdMB1E0VqpKhd9SBvjcNqeVdplohoBlkG2gdQ0M6PVzGn53-2PwzZRHxv-snf26LXsoz5N5zCXofFA-9ymCbIknM Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:45.556523 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 105600edf9614e819c59c93598fe71fe Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:45.557754 n-d-831194-21 devstack@n-api.service[128849]: exception: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'flavor_id': '769995084', 'id': 'hw:cpu_thread_policy'} Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:45.558439 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3b8f647-1d1b-4262-b62d-88771466d2d7 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Returning 404 to user: Flavor 769995084 has no extra specs with key hw:cpu_thread_policy. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:45.559715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e3b8f647-1d1b-4262-b62d-88771466d2d7 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 112 microversion: 2.1 time: 0.058819 Oct 04 17:50:45.569970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 17:50:45 2022] DELETE /compute/v2.1/flavors/769995084/os-extra_specs/hw:cpu_thread_policy => generated 112 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:50:45.578448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:45.579064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:45.602509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.603141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.605746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.606758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:45.608538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:45.609167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:45.786057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.809182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.816941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:45.832829 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cc92b7e-b54d-4395-b4e0-8e638fc13ca0 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.261675 Oct 04 17:50:45.842443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 237/458] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:45 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:45.858426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7e407a3-c0fd-48fa-908b-1e6aa7ee6257 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:45.873662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c7e407a3-c0fd-48fa-908b-1e6aa7ee6257 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7e407a3-c0fd-48fa-908b-1e6aa7ee6257 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Request method failure captured: Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 27 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJylGyzLbfnR5D5KaNYVgn4kx538dyvDqYmRLaDB8LBH2LgPBe2y6nl0i7OL0oFGrd1kqYCsufu-bU2ZHEdcdNAdMB1E0VqpKhd9SBvjcNqeVdplohoBlkG2gdQ0M6PVzGn53-2PwzZRHxv-snf26LXsoz5N5zCXofFA-9ymCbIknM Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:50:45.880369 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 105600edf9614e819c59c93598fe71fe Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: {"hw:cpu_policy": "shared"} Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:50:45.881696 n-d-831194-21 devstack@n-api.service[128849]: exception: Request body and URI mismatch Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'flavor_id': '769995084', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:45.882440 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:45.883541 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:45.883541 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:45.883541 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 04 17:50:45.883541 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:50:45.886495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7e407a3-c0fd-48fa-908b-1e6aa7ee6257 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:45.888310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7e407a3-c0fd-48fa-908b-1e6aa7ee6257 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.044303 Oct 04 17:50:45.893091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 238/459] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:45 2022] PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes => generated 73 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:50:46.079924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:46.088355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf3ad606-b0a6-4f9d-8169-02c9831e54f6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.827209 Oct 04 17:50:46.094516 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 222/460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:45 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:46.107610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-784ae506-6a08-4eb5-8610-11c5dfce2b7c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-784ae506-6a08-4eb5-8610-11c5dfce2b7c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Request method failure captured: Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 49 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJylGyzLbfnR5D5KaNYVgn4kx538dyvDqYmRLaDB8LBH2LgPBe2y6nl0i7OL0oFGrd1kqYCsufu-bU2ZHEdcdNAdMB1E0VqpKhd9SBvjcNqeVdplohoBlkG2gdQ0M6PVzGn53-2PwzZRHxv-snf26LXsoz5N5zCXofFA-9ymCbIknM Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:50:46.133201 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0f4b65902a0f4b369b100598b6c035b4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 0f4b65902a0f4b369b100598b6c035b4 Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 105600edf9614e819c59c93598fe71fe Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 04 17:50:46.134439 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'flavor_id': '769995084', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance: Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 04 17:50:46.135096 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.136441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 04 17:50:46.137635 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:46.142701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-784ae506-6a08-4eb5-8610-11c5dfce2b7c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:46.143789 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-784ae506-6a08-4eb5-8610-11c5dfce2b7c tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.046994 Oct 04 17:50:46.153315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 223/461] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 17:50:46 2022] PUT /compute/v2.1/flavors/769995084/os-extra_specs/hw:numa_nodes => generated 117 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:50:46.162341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-720ff7a1-9e31-4cfc-9669-e47d9dbbfa53 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.196707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:46.204986 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-720ff7a1-9e31-4cfc-9669-e47d9dbbfa53 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/769995084" status: 202 len: 0 microversion: 2.1 time: 0.047422 Oct 04 17:50:46.207917 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 224/462] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:50:46 2022] DELETE /compute/v2.1/flavors/769995084 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:46.219392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea1c62cf-98d0-46d9-abfc-5507f183aa4f tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.267417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea1c62cf-98d0-46d9-abfc-5507f183aa4f tempest-FlavorsExtraSpecsNegativeTestJSON-989167069 tempest-FlavorsExtraSpecsNegativeTestJSON-989167069-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052011 Oct 04 17:50:46.289509 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 225/463] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:46.366560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-de3cd0b5-d7a8-4207-b603-9755c6ab9d26 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.380859 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-de3cd0b5-d7a8-4207-b603-9755c6ab9d26 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.487682 Oct 04 17:50:46.391816 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 239/464] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:50:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:46.505227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Calling method '.version_select at 0x7fbdbe1f2550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.507872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.508571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.509215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.585226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.588750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.590453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.615742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.626838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.627497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.652038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-856f3e1c-7cd9-4eaa-b41a-6823fc257562 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.358642 Oct 04 17:50:46.655246 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 226/465] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:46.668868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Calling method '.version_select at 0x7fbdbe285280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.674775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.678798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.681530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.748285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c12069ce-7d66-4d9e-ad4b-cef6c41fead9 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1300642097", "id": 192406065, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:46.771759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.775316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.775780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.811885 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c12069ce-7d66-4d9e-ad4b-cef6c41fead9 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.400696 Oct 04 17:50:46.814557 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 240/466] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:46 2022] POST /compute/v2.1/flavors => generated 422 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:46.840949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e053e001-c52f-4852-a454-8e830ea7f03b tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.892280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.897987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e053e001-c52f-4852-a454-8e830ea7f03b tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.070431 Oct 04 17:50:46.898294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.898633 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 241/467] 10.222.0.42 () {58 vars in 1182 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:50:46.898766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.916489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:46.920914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:46.925091 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e53ab362-8574-44e5-9612-2678d671a38d tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-831194-21/servers" status: 200 len: 197 microversion: 2.1 time: 0.261114 Oct 04 17:50:46.935988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 227/468] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/os-hypervisors/n-h1-831194-21/servers => generated 197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:50:46.941267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.948255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.949220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc03c1f9-4c45-4f85-b1e6-375e21b7183a tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1063286934", "id": 1922826566, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:46.949688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:46.951533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:46.952965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:46.953574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.010054 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc03c1f9-4c45-4f85-b1e6-375e21b7183a tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.069019 Oct 04 17:50:47.011355 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 228/469] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:46 2022] POST /compute/v2.1/flavors => generated 425 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:47.029295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Calling method '.version_select at 0x7fbdbe0e6b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.036810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.037411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.037895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.093895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.103803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.105681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.146929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.147466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.147918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.159689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-335c00f8-3177-4eea-b763-7740e1a73887 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.144233 Oct 04 17:50:47.161609 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 229/470] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:47.168568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2046864596", "imageRef": "7d607ba8-c4ff-4ae2-8a16-e924727e9228", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:47.252339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:47.295804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.308473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.315619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.335202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34c696a1-4caf-4426-ba1e-8d039a9574da tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.431116 Oct 04 17:50:47.338815 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 242/471] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:46 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:47.345359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da57da9e-9ca4-4e52-b214-7744cf6e6190 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.367423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da57da9e-9ca4-4e52-b214-7744cf6e6190 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025801 Oct 04 17:50:47.367998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 243/472] 10.222.0.42 () {58 vars in 1182 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:50:47.392257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.395238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:47.410206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.412543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.414182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.415227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.418240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.421528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.753926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:47.764404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acb51140-d2ef-4b4b-b4a7-dae8687f683b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.385613 Oct 04 17:50:47.783500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 244/473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:47.789006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Calling method '.version_select at 0x7fbdbdf318b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:47.791403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.792077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.792968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.806921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:47.808373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:47.809186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:47.817569 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8d79922-174c-4da0-8fc1-42f41e32d865 tempest-HypervisorAdminUnderV252Test-352407138 tempest-HypervisorAdminUnderV252Test-352407138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/n-h1-831194-21/search" status: 200 len: 105 microversion: 2.1 time: 0.032434 Oct 04 17:50:47.820721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 245/474] 10.222.0.42 () {58 vars in 1212 bytes} [Tue Oct 4 17:50:47 2022] GET /compute/v2.1/os-hypervisors/n-h1-831194-21/search => generated 105 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:47.827219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c943b034-478b-4f42-9e7f-d32aba6b8b8a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Action: 'create', calling method: .version_select at 0x7fbdbdd84040>, body: {"keypair": {"name": "tempest-keypair-67455838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvVwwSiRYR3E8CE1F1MGu27/vDiOo/KrX2/GLkozbhFgY6akxH/L1SkVh8evvD0jtkNl9QXCE2Nv+/MawLyOpew9vot2iBEsLS7TpYXhwc6g4vlK1yUkumDXaAx4uWYWQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:47.878017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:SAVEPOINT=2,nova_api:INSERT=4,nova_api:RELEASE=2,nova_api:DELETE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:47.915305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c943b034-478b-4f42-9e7f-d32aba6b8b8a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:47.933041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c943b034-478b-4f42-9e7f-d32aba6b8b8a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for user 7cadc40c954a4934833da24a2ce6b293 and project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:47.986573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c943b034-478b-4f42-9e7f-d32aba6b8b8a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.164135 Oct 04 17:50:47.987559 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 246/475] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:50:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:47.993180 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] Request method failure captured: Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 143 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJzAxaU633kFdkkO_x1Nq10Aa-d1hO3gpUABk38mByjIaVla3fsrwuXiPsRqnPe8ucUXRVQJQnr9dwKWOT7aSF77sdbrWdBz3UKI_hzDZH4barG1n-uf3MENyPVHk_AXqYPyix42lBOQmzcNvWPwionXVNdakAztGc60gHDiUv62ZU Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c0bdc3abfcee4d52ad2d86afafc4f229 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FlavorsV2NegativeTest-1655438337 Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:47.995075 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c0bdc3abfcee4d52ad2d86afafc4f229"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0bdc3abfcee4d52ad2d86afafc4f229"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c0bdc3abfcee4d52ad2d86afafc4f229"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c0bdc3abfcee4d52ad2d86afafc4f229"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FlavorsV2NegativeTest-1655438337 Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c0bdc3abfcee4d52ad2d86afafc4f229 Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1655438337 Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FlavorsV2NegativeTest-1655438337-project Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c6981d69ae354ea3a8ac0af4ce007b24 Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FlavorsV2NegativeTest-1655438337-project Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-2046864596", "imageRef": "7d607ba8-c4ff-4ae2-8a16-e924727e9228", "flavorRef": "452"}} Oct 04 17:50:47.996556 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: exception: Flavor's memory is too small for requested image. Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-2046864596', 'imageRef': '7d607ba8-c4ff-4ae2-8a16-e924727e9228', 'flavorRef': '452'}}} Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:47.997708 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:47.999057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:48.000453 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c731c9b-65fe-459e-9502-5ed70aec96c7 tempest-FlavorsV2NegativeTest-1655438337 tempest-FlavorsV2NegativeTest-1655438337-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.833623 Oct 04 17:50:48.001446 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 230/476] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:47 2022] POST /compute/v2.1/servers => generated 93 bytes in 838 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:50:48.363993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:48.364606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:48.373947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.380172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.380868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.381765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.382424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.382998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.735181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:48.751014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:48.753007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:48.764982 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0cfbcf1-ff4f-4ca3-87ff-36df83987d11 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.404800 Oct 04 17:50:48.769033 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 247/477] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:48 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:48.800022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:48.800815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:48.812991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.813855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.814545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:48.815480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:48.820638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:48.824175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:49.203988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:49.370717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=18 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:49.705228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:49.722626 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75d46d6f-74a6-4736-b026-fa3ea2cc8429 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.934194 Oct 04 17:50:49.734361 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 231/478] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:48 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:49.797406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:49.798159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:49.817362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:49.817899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:49.818351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:49.819079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:49.819932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:49.820527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.145068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:50.161822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:50.163322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:50.178977 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b808e241-7588-40a0-b88c-a75622a60659 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.387609 Oct 04 17:50:50.183517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 248/479] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:49 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:50.755842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:50.756468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:50.764085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.764591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.765033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:50.771261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:50.772969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:50.775067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.183926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.203927 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a79f3c53-0c32-49c6-92ad-0190713b5cfe tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.451313 Oct 04 17:50:51.220124 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 232/480] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:50 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:51.225770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:51.235234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:51.261030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.262299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.263005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.265510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:51.266306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:51.266966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:51.310933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7672e66f-72c3-48cb-a896-91935ae14f9f tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Action: 'create', calling method: .version_select at 0x7fbdbdd58d30>, body: {"pool": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:51.364969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.376246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.378762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:51.384523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f8791bf-5971-4fb8-ab4d-0047942c90dd tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.162983 Oct 04 17:50:51.385733 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 233/481] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:51 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:52.235900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:52.236802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:52.247837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.248338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.248909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.249479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.259399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.260010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.369617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:52.676741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:52.689570 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9db13eee-3e5c-4180-a4e0-8ad641a09b07 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.460560 Oct 04 17:50:52.691376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 234/482] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:52 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:50:52.701760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:52.707589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:52.717797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.722739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.723418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:52.724452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:52.725125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:52.726085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.030216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.051440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.055153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:53.084605 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de8252b9-21fb-40cc-8b5c-0169ba190bc6 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.390424 Oct 04 17:50:53.097980 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 235/483] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:52 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:53.853735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd8f96a9-834b-41d2-8c0c-40e429ea0e46 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Calling method '.version_select at 0x7fbdbe1e1040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:53.922887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-bd8f96a9-834b-41d2-8c0c-40e429ea0e46 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd8f96a9-834b-41d2-8c0c-40e429ea0e46 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/28b7a229-02d5-4d6e-955b-00a38a2d7d80/metadata/os_distro HTTP/1.1 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:53.949658 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': '28b7a229-02d5-4d6e-955b-00a38a2d7d80', 'id': 'os_distro'} Oct 04 17:50:53.951529 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:53.952631 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 28b7a229-02d5-4d6e-955b-00a38a2d7d80 Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:53.954079 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 28b7a229-02d5-4d6e-955b-00a38a2d7d80 could not be found. Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:53.955487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:53.956941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd8f96a9-834b-41d2-8c0c-40e429ea0e46 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:53.959063 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd8f96a9-834b-41d2-8c0c-40e429ea0e46 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "DELETE /compute/v2.1/images/28b7a229-02d5-4d6e-955b-00a38a2d7d80/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.775096 Oct 04 17:50:53.959063 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 236/484] 10.222.0.42 () {58 vars in 1293 bytes} [Tue Oct 4 17:50:53 2022] DELETE /compute/v2.1/images/28b7a229-02d5-4d6e-955b-00a38a2d7d80/metadata/os_distro => generated 62 bytes in 777 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:53.967500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:53.968119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:53.988504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.989016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.989443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:53.996226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:53.996751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:53.997450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.357569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.367170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-699e8ad6-f182-4e0e-9fae-bb9b3b9e740b tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.407672 Oct 04 17:50:54.372120 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 237/485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:53 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:54.378722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e445fae-820f-4b9c-b748-07ef85e492ed tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Calling method '.version_select at 0x7fbdbe2d4d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.418973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5e445fae-820f-4b9c-b748-07ef85e492ed tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e445fae-820f-4b9c-b748-07ef85e492ed tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/images/212be09d-6f2f-4ad8-8361-78e898ee09cc/metadata/os_version HTTP/1.1 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:54.420863 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': '212be09d-6f2f-4ad8-8361-78e898ee09cc', 'id': 'os_version'} Oct 04 17:50:54.422450 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.423358 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 212be09d-6f2f-4ad8-8361-78e898ee09cc Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.424591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 212be09d-6f2f-4ad8-8361-78e898ee09cc could not be found. Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:54.426043 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.427391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e445fae-820f-4b9c-b748-07ef85e492ed tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:54.428689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e445fae-820f-4b9c-b748-07ef85e492ed tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "GET /compute/v2.1/images/212be09d-6f2f-4ad8-8361-78e898ee09cc/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.048736 Oct 04 17:50:54.428689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 238/486] 10.222.0.42 () {58 vars in 1293 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/images/212be09d-6f2f-4ad8-8361-78e898ee09cc/metadata/os_version => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:54.433581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.434224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:54.468834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.473323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.476738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.484175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:54.485373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:54.486994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:54.620199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.633384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.640678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:54.659157 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1884e633-43e8-47f6-8afd-2bf312005743 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.229427 Oct 04 17:50:54.659757 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 239/487] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:54.670179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f91e8cc2-8939-4dd3-87f7-587f503c048f tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Calling method '.version_select at 0x7fbdbe1e1ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:54.715354 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f91e8cc2-8939-4dd3-87f7-587f503c048f tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f91e8cc2-8939-4dd3-87f7-587f503c048f tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/images/96f84eb1-20ce-4713-a43c-ea0f32f39984/metadata HTTP/1.1 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:54.717755 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': '96f84eb1-20ce-4713-a43c-ea0f32f39984'} Oct 04 17:50:54.719288 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.720221 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 96f84eb1-20ce-4713-a43c-ea0f32f39984 Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.721390 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 96f84eb1-20ce-4713-a43c-ea0f32f39984 could not be found. Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:54.722673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:54.723930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.730120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f91e8cc2-8939-4dd3-87f7-587f503c048f tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:54.736155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f91e8cc2-8939-4dd3-87f7-587f503c048f tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "GET /compute/v2.1/images/96f84eb1-20ce-4713-a43c-ea0f32f39984/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068953 Oct 04 17:50:54.736908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 240/488] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:50:54 2022] GET /compute/v2.1/images/96f84eb1-20ce-4713-a43c-ea0f32f39984/metadata => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:54.764275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e65f008c-d580-4b67-9ece-da5ecf268250 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Action: 'update_all', calling method: .version_select at 0x7fbdbe0b6ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:54.803378 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e65f008c-d580-4b67-9ece-da5ecf268250 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e65f008c-d580-4b67-9ece-da5ecf268250 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/images/f3e0626e-8c3e-4375-a9a1-04e1d00f5d11/metadata HTTP/1.1 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 57 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:54.808713 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:54.810033 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': 'f3e0626e-8c3e-4375-a9a1-04e1d00f5d11', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.810982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f3e0626e-8c3e-4375-a9a1-04e1d00f5d11 Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.811966 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f3e0626e-8c3e-4375-a9a1-04e1d00f5d11 could not be found. Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:54.813062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:54.814119 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.815339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e65f008c-d580-4b67-9ece-da5ecf268250 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:54.815339 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e65f008c-d580-4b67-9ece-da5ecf268250 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "PUT /compute/v2.1/images/f3e0626e-8c3e-4375-a9a1-04e1d00f5d11/metadata" status: 404 len: 62 microversion: 2.1 time: 0.068489 Oct 04 17:50:54.815339 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 241/489] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 17:50:54 2022] PUT /compute/v2.1/images/f3e0626e-8c3e-4375-a9a1-04e1d00f5d11/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:50:54.836338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2af49e70-c879-4789-aca1-cb3b6195c2d1 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Action: 'update', calling method: .version_select at 0x7fbdbe0b6280>, body: {"meta": {"os_distro": "alt"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:54.883429 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2af49e70-c879-4789-aca1-cb3b6195c2d1 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2af49e70-c879-4789-aca1-cb3b6195c2d1 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/images/62b9957d-2929-4191-8afd-36a1c56ec743/metadata/os_distro HTTP/1.1 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 30 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:54.886483 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: {"meta": {"os_distro": "alt"}} Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:54.888147 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': '62b9957d-2929-4191-8afd-36a1c56ec743', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.889045 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62b9957d-2929-4191-8afd-36a1c56ec743 Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.890081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62b9957d-2929-4191-8afd-36a1c56ec743 could not be found. Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:54.891120 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:54.892170 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.895036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2af49e70-c879-4789-aca1-cb3b6195c2d1 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:54.896761 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2af49e70-c879-4789-aca1-cb3b6195c2d1 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "PUT /compute/v2.1/images/62b9957d-2929-4191-8afd-36a1c56ec743/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.072438 Oct 04 17:50:54.902645 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 242/490] 10.222.0.42 () {60 vars in 1310 bytes} [Tue Oct 4 17:50:54 2022] PUT /compute/v2.1/images/62b9957d-2929-4191-8afd-36a1c56ec743/metadata/os_distro => generated 62 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:54.909236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71c72b52-9336-46a0-8eb8-c6e0084e0363 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Action: 'create', calling method: .version_select at 0x7fbdbe3b9a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:54.937432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-71c72b52-9336-46a0-8eb8-c6e0084e0363 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] HTTP exception thrown: Image not found. Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71c72b52-9336-46a0-8eb8-c6e0084e0363 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Request method failure captured: Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/images/974aa8fc-f3b3-4134-a08b-73edbac74290/metadata HTTP/1.1 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 57 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJ9X3RyBsk8bxC76w_owPdnBBD6zqu04K4N9A12ejLKQtLGw1mvl9_tR0nvb7knUlxzS4y3YYv8zYBI8YMeV5mtr10Ts64g6UuYBOMXZqol1qp8WZyKsREq1KVx8o4U8tIZbuLE4RfFEtSLPSMxct98qSze21aOrZaEoS5Ak-ViyD8 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:50:54.940897 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1e36724d444c452b815b3f12c99757ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1e36724d444c452b815b3f12c99757ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1e36724d444c452b815b3f12c99757ff Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477 Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dcc4af220f254e7996917b9aaac64ffb Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1130974477-project Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:50:54.942239 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'image_id': '974aa8fc-f3b3-4134-a08b-73edbac74290', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.943092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 974aa8fc-f3b3-4134-a08b-73edbac74290 Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:50:54.944115 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 974aa8fc-f3b3-4134-a08b-73edbac74290 could not be found. Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:50:54.950687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:50:54.953048 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:50:54.957080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71c72b52-9336-46a0-8eb8-c6e0084e0363 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:50:54.957080 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71c72b52-9336-46a0-8eb8-c6e0084e0363 tempest-ImagesMetadataNegativeTestJSON-1130974477 tempest-ImagesMetadataNegativeTestJSON-1130974477-project] 10.222.0.42 "POST /compute/v2.1/images/974aa8fc-f3b3-4134-a08b-73edbac74290/metadata" status: 404 len: 62 microversion: 2.1 time: 0.039263 Oct 04 17:50:54.957080 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 243/491] 10.222.0.42 () {60 vars in 1281 bytes} [Tue Oct 4 17:50:54 2022] POST /compute/v2.1/images/974aa8fc-f3b3-4134-a08b-73edbac74290/metadata => generated 62 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:50:54.992898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-315345494", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "1922826566", "adminPass": "***", "networks": [{"uuid": "e970d4b6-75da-419f-9fd8-6c71bee20a90"}], "security_groups": [{"name": "tempest-securitygroup--1017908723"}], "key_name": "tempest-keypair-67455838", "user_data": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:55.176529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] validate_networks() for [('e970d4b6-75da-419f-9fd8-6c71bee20a90', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:50:55.580788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7672e66f-72c3-48cb-a896-91935ae14f9f tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.612122 Oct 04 17:50:55.581384 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 249/492] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:50:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:55.598660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:55.600090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:55.616263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.618134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.621394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.622471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:55.622952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:55.623382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:55.919569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:55.931180 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2cd15129-3733-43e2-b3b8-10578f9a528d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1472 microversion: 2.1 time: 0.339976 Oct 04 17:50:55.932405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 250/493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:55 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:55.941469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-105901d3-2b8b-4dbd-a4af-734f0747aa49 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbddad430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:56.450003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-105901d3-2b8b-4dbd-a4af-734f0747aa49 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/00365871-a267-42e6-92e0-7322eca2c207" status: 200 len: 141 microversion: 2.1 time: 0.515884 Oct 04 17:50:56.460420 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 251/494] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:50:55 2022] GET /compute/v2.1/os-floating-ips/00365871-a267-42e6-92e0-7322eca2c207 => generated 141 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:56.467042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:56.469274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:56.480176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.482309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.483143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.484725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:56.486132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:56.487830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:56.659262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:56.674792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:56.681287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:56.703867 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fe4c2f8-fc7d-429b-b848-4144f73d41ed tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.240968 Oct 04 17:50:56.706659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 252/495] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:56 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:56.742251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78a69940-2941-4feb-a227-3aae02b8bc54 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbddad0d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:56.972359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:50:56.974066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:50:56.974897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:50:56.975515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:50:56.976307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:50:57.003638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.007027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.009190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.015175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.016724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.017449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.053768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:50:57.061246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for user 7cadc40c954a4934833da24a2ce6b293 and project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:50:57.089672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:50:57.094184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:50:57.257794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4cb3d28-7a9b-4b54-9bbd-8de50b67ad92 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.268613 Oct 04 17:50:57.270003 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 244/496] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:50:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:50:57.284084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:57.285601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:57.303834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.308705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.312773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.314266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:57.315999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:57.318131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:57.703726 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78a69940-2941-4feb-a227-3aae02b8bc54 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.984626 Oct 04 17:50:57.706568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:57.715262 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 253/497] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 17:50:56 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:57.719849 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56a28d49-5d48-4a1f-8f86-5f36ce881189 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1478 microversion: 2.1 time: 0.446851 Oct 04 17:50:57.720009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae91e95a-d548-4d38-8dad-30324e118572 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:57.720591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae91e95a-d548-4d38-8dad-30324e118572 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:57.720708 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 245/498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:57 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1478 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:57.926833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae91e95a-d548-4d38-8dad-30324e118572 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:57.950128 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae91e95a-d548-4d38-8dad-30324e118572 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1262 microversion: 2.1 time: 0.234457 Oct 04 17:50:57.970588 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 254/499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:57 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1262 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:57.987104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a24144f-9fbd-440c-a51f-389c59a104bc tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbe671940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.305376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Calling method '.version_select at 0x7fbdbe0ba280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.308145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.308777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.309310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.339595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.346313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.347920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.382845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.383493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.384032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.394916 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b47ba440-9662-47ec-857e-6b48d753008e tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.672237 Oct 04 17:50:58.401542 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 246/500] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:50:57 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:58.406730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:58.414423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:58.427247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.433111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.433917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:58.434861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:58.435543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:58.436189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.017567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.031457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.033470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.041170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30aff86e-49d9-4c51-b30b-c23a1b42181d tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.638123 Oct 04 17:50:59.059320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 247/501] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:50:58 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:50:59.336806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d206b422-46c3-4e9d-acc3-2aa1682cc4c4 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1658608512", "id": 1652442531, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:59.399327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d206b422-46c3-4e9d-acc3-2aa1682cc4c4 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.355176 Oct 04 17:50:59.408356 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 248/502] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:50:59 2022] POST /compute/v2.1/flavors => generated 468 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:59.422350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Calling method '.version_select at 0x7fbdbe1e1160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:59.437086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.437715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.438194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.483576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:50:59.495995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a24144f-9fbd-440c-a51f-389c59a104bc tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/00365871-a267-42e6-92e0-7322eca2c207" status: 202 len: 0 microversion: 2.1 time: 1.524221 Oct 04 17:50:59.496984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 255/503] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:50:57 2022] DELETE /compute/v2.1/os-floating-ips/00365871-a267-42e6-92e0-7322eca2c207 => generated 0 bytes in 1526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:50:59.501970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:59.502827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:59.510814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.511687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.512558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.513678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.514342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.514944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.524689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.525186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.530332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.544824 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-caec692e-c7d9-4906-8519-c3b8db00afd9 tempest-HypervisorAdminV228Test-344345583 tempest-HypervisorAdminV228Test-344345583-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.135267 Oct 04 17:50:59.550683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 249/504] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 17:50:59 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:50:59.555595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:50:59.558642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:50:59.569055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.575004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.577251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.578202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.581065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.583998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.722205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.741009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-195da9e3-81f2-4c6f-9ea9-a685db16063c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1332 microversion: 2.1 time: 0.188637 Oct 04 17:50:59.746546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 250/505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:59 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1332 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:59.766090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:50:59.777171 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2db844be-599f-4f4e-9187-44bbaa43eec5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1464 microversion: 2.1 time: 0.278800 Oct 04 17:50:59.795216 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 256/506] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:50:59 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1464 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:50:59.800526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-unplugged", "status": "completed", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:50:59.813266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:50:59.814177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:50:59.814857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:50:59.834509 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] Creating event network-vif-unplugged:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:50:59.847061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-13e202c2-c1b1-450c-a55e-462163417a2a req-3a6daec1-d641-462b-aebc-3cd8137677e0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049859 Oct 04 17:50:59.848266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 257/507] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:50:59.857677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65d7fa77-08c8-461d-953c-d71f0f6f53c1 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Action: 'create', calling method: .version_select at 0x7fbdbe00c940>, body: {"pool": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:00.224864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13c7fd47-0a06-4052-8251-09eefddc19a4 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:00.235332 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13c7fd47-0a06-4052-8251-09eefddc19a4 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] 10.222.0.42 "GET /compute/v2.1/flavors/1652442531" status: 200 len: 468 microversion: 2.61 time: 0.486793 Oct 04 17:51:00.235886 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 251/508] 10.222.0.42 () {60 vars in 1199 bytes} [Tue Oct 4 17:50:59 2022] GET /compute/v2.1/flavors/1652442531 => generated 468 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:00.430498 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0000f40f-2fb5-4a14-87cd-b41e3519d85c tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.190759 Oct 04 17:51:00.431212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 252/509] 10.222.0.42 () {58 vars in 1128 bytes} [Tue Oct 4 17:51:00 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:51:00.439067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:00.439695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:00.449802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:00.450328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:00.451630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:00.452488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:00.453129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:00.453712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.224351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:01.238953 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a8009f29-c056-426e-be7b-d9ad02034d3f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1464 microversion: 2.1 time: 0.804900 Oct 04 17:51:01.243254 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 253/510] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:00 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1464 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:01.261952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:01.262944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:01.272451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.275216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.278475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.279353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.279937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.281551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.474863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:01.492875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:01.503782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:01.527855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-510e56bc-22e2-481a-8d06-017c4429b130 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.276148 Oct 04 17:51:01.529614 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 254/511] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:01 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:01.537657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60508b42-2e66-49f6-9472-c6660a24c8d5 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbf966a60>, body: {"flavor": {"description": "new"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:01.661611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60508b42-2e66-49f6-9472-c6660a24c8d5 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] 10.222.0.42 "PUT /compute/v2.1/flavors/1652442531" status: 200 len: 469 microversion: 2.61 time: 0.128645 Oct 04 17:51:01.666822 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 255/512] 10.222.0.42 () {62 vars in 1219 bytes} [Tue Oct 4 17:51:01 2022] PUT /compute/v2.1/flavors/1652442531 => generated 469 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:01.679109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a23f208-c97f-4b38-8b48-21b774432b99 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Calling method '.version_select at 0x7fbdbe01bd30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:01.739670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8a23f208-c97f-4b38-8b48-21b774432b99 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] HTTP exception thrown: Image not found. Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a23f208-c97f-4b38-8b48-21b774432b99 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Request method failure captured: Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKDyvw_SgV65w_mvRycdGaCyfITxXgX-01lHcwMaF7OS0qOT6thgDWUdhJWUcaS6thghBr1xE5cufZrLN5Xjt6nGszhOn35sHCjl6202fWawHOWjfN561yQzPJTrfMKgOXCx3Rhs_JxjnsmNrEZ62V273S4ZcBq7AZRpL8ASueLQIs Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:01.745004 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d20d41377c5416fb411847b61e15df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c6829dc3de874de4946521b0530f1fd9 Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '-1'} Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:01.746333 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.747565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:01.748743 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:51:01.750826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:01.752892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a23f208-c97f-4b38-8b48-21b774432b99 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:01.754438 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a23f208-c97f-4b38-8b48-21b774432b99 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.085037 Oct 04 17:51:01.755333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 256/513] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 17:51:01 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:51:01.767817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:01.768675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:01.798096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.798594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.799242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:01.799957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:01.800411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:01.800827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.128851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:02.149700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42e3ebb7-7e90-49c5-88c5-b1e5e82b35ad tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.393032 Oct 04 17:51:02.151254 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 257/514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:01 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:02.171571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:02.173813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.180463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.180964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.181471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.182948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.183265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.183790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.224397 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65d7fa77-08c8-461d-953c-d71f0f6f53c1 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.374481 Oct 04 17:51:02.225096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 258/515] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:50:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:02.232200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa0beb02-b061-4708-9527-ccad59fc8101 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.287973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:02.288687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:02.289337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:02.290060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:02.290740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:02.300107 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa0beb02-b061-4708-9527-ccad59fc8101 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 7157 microversion: 2.61 time: 0.070787 Oct 04 17:51:02.300892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 259/516] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/flavors/detail => generated 7157 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:02.318867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0ad9772-288b-40ec-b060-47369c431c80 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Calling method '.version_select at 0x7fbdbdf310d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.377704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f0ad9772-288b-40ec-b060-47369c431c80 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] HTTP exception thrown: Image not found. Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0ad9772-288b-40ec-b060-47369c431c80 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Request method failure captured: Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/images/1e7e12d4-946f-474b-8965-740021cddd3j HTTP/1.1 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKDyvw_SgV65w_mvRycdGaCyfITxXgX-01lHcwMaF7OS0qOT6thgDWUdhJWUcaS6thghBr1xE5cufZrLN5Xjt6nGszhOn35sHCjl6202fWawHOWjfN561yQzPJTrfMKgOXCx3Rhs_JxjnsmNrEZ62V273S4ZcBq7AZRpL8ASueLQIs Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:02.381667 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d20d41377c5416fb411847b61e15df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: c6829dc3de874de4946521b0530f1fd9 Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '1e7e12d4-946f-474b-8965-740021cddd3j'} Oct 04 17:51:02.383034 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1e7e12d4-946f-474b-8965-740021cddd3j to delete Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.383971 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e7e12d4-946f-474b-8965-740021cddd3j could not be found. Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:02.385443 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0ad9772-288b-40ec-b060-47369c431c80 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:02.386685 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0ad9772-288b-40ec-b060-47369c431c80 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/1e7e12d4-946f-474b-8965-740021cddd3j" status: 404 len: 62 microversion: 2.1 time: 0.080543 Oct 04 17:51:02.387545 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 260/517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:02 2022] DELETE /compute/v2.1/images/1e7e12d4-946f-474b-8965-740021cddd3j => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:51:02.400321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c6d0a37-da74-4a0f-a3f5-24e7cc13a767 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbddad430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.410557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.422332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:02.424156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.424278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.424706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.425418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.425901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.430570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.492186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b77ca964-8aca-474f-8127-f65439e35cc6 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 1068 microversion: 2.1 time: 0.339498 Oct 04 17:51:02.506256 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 258/518] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:02 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 1068 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:51:02.515866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-481a8dd0-0542-47db-836d-a97c4f2360e0 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.567816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-481a8dd0-0542-47db-836d-a97c4f2360e0 tempest-FlavorsV261TestJSON-300609514 tempest-FlavorsV261TestJSON-300609514-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 3684 microversion: 2.61 time: 0.060020 Oct 04 17:51:02.570531 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 259/519] 10.222.0.42 () {60 vars in 1166 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/flavors => generated 3684 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:02.589165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-829ce24f-9f63-4b51-9b93-4d90a89a8a50 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Calling method '.version_select at 0x7fbdbe2eb940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.612044 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-829ce24f-9f63-4b51-9b93-4d90a89a8a50 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] HTTP exception thrown: Image not found. Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-829ce24f-9f63-4b51-9b93-4d90a89a8a50 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Request method failure captured: Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/62e37f5c-7452-4447-920a-82ed1cb831341 HTTP/1.1 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKDyvw_SgV65w_mvRycdGaCyfITxXgX-01lHcwMaF7OS0qOT6thgDWUdhJWUcaS6thghBr1xE5cufZrLN5Xjt6nGszhOn35sHCjl6202fWawHOWjfN561yQzPJTrfMKgOXCx3Rhs_JxjnsmNrEZ62V273S4ZcBq7AZRpL8ASueLQIs Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:02.614042 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d20d41377c5416fb411847b61e15df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c6829dc3de874de4946521b0530f1fd9 Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '62e37f5c-7452-4447-920a-82ed1cb831341'} Oct 04 17:51:02.615486 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62e37f5c-7452-4447-920a-82ed1cb831341 to delete Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.616284 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62e37f5c-7452-4447-920a-82ed1cb831341 could not be found. Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:02.617378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-829ce24f-9f63-4b51-9b93-4d90a89a8a50 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:02.618528 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-829ce24f-9f63-4b51-9b93-4d90a89a8a50 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/62e37f5c-7452-4447-920a-82ed1cb831341" status: 404 len: 62 microversion: 2.1 time: 0.032306 Oct 04 17:51:02.627573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 260/520] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:02 2022] DELETE /compute/v2.1/images/62e37f5c-7452-4447-920a-82ed1cb831341 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:51:02.632550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:02.647601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:02.657295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.658368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.659205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:02.660281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:02.661719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:02.663362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.275869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.286006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c9e6ad05-b491-4ca0-9129-db8ccc78c520 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.657091 Oct 04 17:51:03.292748 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 261/521] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:02 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:03.313049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.313672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:03.329436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.329977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.330418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.331141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.331599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.332026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.531278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.547319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.548787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:03.560785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f477b344-bc99-43f3-8ecd-fb185e20a25b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.251370 Oct 04 17:51:03.561693 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 262/522] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:03 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:03.573025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b800d2e4-8696-49e9-815f-b95f3cf9d766 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.640767 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b800d2e4-8696-49e9-815f-b95f3cf9d766 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1652442531" status: 202 len: 0 microversion: 2.61 time: 0.077662 Oct 04 17:51:03.641616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 263/523] 10.222.0.42 () {60 vars in 1202 bytes} [Tue Oct 4 17:51:03 2022] DELETE /compute/v2.1/flavors/1652442531 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:03.646725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-966abc78-438e-475c-a2f6-46d5e51a12a2 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Calling method '.version_select at 0x7fbdbe01b0d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.702016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-966abc78-438e-475c-a2f6-46d5e51a12a2 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] HTTP exception thrown: Image not found. Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-966abc78-438e-475c-a2f6-46d5e51a12a2 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Request method failure captured: Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/tempest-invalid-1559523579 HTTP/1.1 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKDyvw_SgV65w_mvRycdGaCyfITxXgX-01lHcwMaF7OS0qOT6thgDWUdhJWUcaS6thghBr1xE5cufZrLN5Xjt6nGszhOn35sHCjl6202fWawHOWjfN561yQzPJTrfMKgOXCx3Rhs_JxjnsmNrEZ62V273S4ZcBq7AZRpL8ASueLQIs Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:03.703780 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d20d41377c5416fb411847b61e15df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c6829dc3de874de4946521b0530f1fd9 Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'tempest-invalid-1559523579'} Oct 04 17:51:03.705267 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1559523579 to delete Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:03.706268 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1559523579 could not be found. Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:03.707604 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-966abc78-438e-475c-a2f6-46d5e51a12a2 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:03.710697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-966abc78-438e-475c-a2f6-46d5e51a12a2 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/tempest-invalid-1559523579" status: 404 len: 62 microversion: 2.1 time: 0.062453 Oct 04 17:51:03.711756 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 264/524] 10.222.0.42 () {58 vars in 1206 bytes} [Tue Oct 4 17:51:03 2022] DELETE /compute/v2.1/images/tempest-invalid-1559523579 => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:51:03.728158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:03.728449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:03.755006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.755800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.756429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:03.757516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:03.759343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:03.763858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.046432 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c6d0a37-da74-4a0f-a3f5-24e7cc13a767 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81" status: 202 len: 0 microversion: 2.1 time: 1.661478 Oct 04 17:51:04.052730 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 261/525] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:51:02 2022] DELETE /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81 => generated 0 bytes in 1668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:51:04.061147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-plugged", "status": "completed", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:04.106644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.107701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.108307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.145278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] Creating event network-vif-plugged:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:51:04.152481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c1e4ec8c-4e15-426c-9c0b-da6f3c4a7cf9 req-cd8e6637-74e8-432b-a517-00536f994432 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098023 Oct 04 17:51:04.153517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 262/526] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:04.158754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a673b778-45f2-42f9-b0fc-986a1de2bc86 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.200855 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a673b778-45f2-42f9-b0fc-986a1de2bc86 tempest-FlavorsV261TestJSON-563537640 tempest-FlavorsV261TestJSON-563537640-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 6698 microversion: 2.61 time: 0.045449 Oct 04 17:51:04.201998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 263/527] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/flavors/detail => generated 6698 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:04.207101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e76bce4-e103-425f-8b0f-9f3e54ab9238 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Calling method '.version_select at 0x7fbdbddaddc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.251680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5e76bce4-e103-425f-8b0f-9f3e54ab9238 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] HTTP exception thrown: Image not found. Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e76bce4-e103-425f-8b0f-9f3e54ab9238 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Request method failure captured: Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/images/b22dcf24-f088-4679-8059-1fc69ddd0ae7 HTTP/1.1 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKDyvw_SgV65w_mvRycdGaCyfITxXgX-01lHcwMaF7OS0qOT6thgDWUdhJWUcaS6thghBr1xE5cufZrLN5Xjt6nGszhOn35sHCjl6202fWawHOWjfN561yQzPJTrfMKgOXCx3Rhs_JxjnsmNrEZ62V273S4ZcBq7AZRpL8ASueLQIs Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:04.253796 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d20d41377c5416fb411847b61e15df4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d20d41377c5416fb411847b61e15df4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8d20d41377c5416fb411847b61e15df4 Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-903278842 Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: c6829dc3de874de4946521b0530f1fd9 Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-903278842-project Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b22dcf24-f088-4679-8059-1fc69ddd0ae7'} Oct 04 17:51:04.255306 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b22dcf24-f088-4679-8059-1fc69ddd0ae7 to delete Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.256369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b22dcf24-f088-4679-8059-1fc69ddd0ae7 could not be found. Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:04.257714 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:51:04.259151 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.262293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e76bce4-e103-425f-8b0f-9f3e54ab9238 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:04.263352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e76bce4-e103-425f-8b0f-9f3e54ab9238 tempest-ImagesDeleteNegativeTestJSON-903278842 tempest-ImagesDeleteNegativeTestJSON-903278842-project] 10.222.0.42 "DELETE /compute/v2.1/images/b22dcf24-f088-4679-8059-1fc69ddd0ae7" status: 404 len: 62 microversion: 2.1 time: 0.060130 Oct 04 17:51:04.269454 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 264/528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:04 2022] DELETE /compute/v2.1/images/b22dcf24-f088-4679-8059-1fc69ddd0ae7 => generated 62 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:51:04.277700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbdeb9790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.363214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 05768c26-0828-4c98-a274-439a05b14f81 could not be found", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:51:04.364110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] HTTP exception thrown: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Request method failure captured: Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81 HTTP/1.1 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJ67ZjOgBfbC-LEgvBZUUAaU08cwlw9jDsZNNoCOgSbML5A5kF53mL1kHuYuBrCs5VS3VLxd2GtUJDRYCubv-B97b6LMHYWwCBGhAkDs422RvA5VPS892A5Urp1L9XiPiTogTocnJZjnWtiD-xnzSrcP11Mctkp3trYP4yNf_fJKaQ Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b8941fba26d84f6090bb8340900f3390 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:04.378076 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8941fba26d84f6090bb8340900f3390"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b8941fba26d84f6090bb8340900f3390 Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsTestJSON-1684699138-project Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 663e85a157c740b99295cacbb856b61a Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsTestJSON-1684699138-project Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: exception: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '05768c26-0828-4c98-a274-439a05b14f81'} Oct 04 17:51:04.379714 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:51:04.380655 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 05768c26-0828-4c98-a274-439a05b14f81 could not be found Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-14413ec0-f75b-4c09-9e37-7a0cd17441d3'] Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81. Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.382013 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:04.383451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:04.385409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.385409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.386621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Returning 404 to user: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:04.387734 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0c896e97-4ddc-4490-84f2-98ae27a94bc8 tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81" status: 404 len: 111 microversion: 2.1 time: 0.116925 Oct 04 17:51:04.388465 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 265/529] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:04.393610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.395169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:04.411916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.413970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.414803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.418370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.419293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.421194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.718061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:04.731979 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60f573af-24b8-4591-b322-ee9b627c4809 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.342299 Oct 04 17:51:04.765368 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 266/530] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:04.776034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93695d49-46d7-4f96-8944-4f3d2dc0c2f9", "tag": "b25c3a3c-cacb-4f40-82ad-133b6fa69f7d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:04.787940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.788687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.789361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.800665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:04.804467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] Creating event network-changed:b25c3a3c-cacb-4f40-82ad-133b6fa69f7d for instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 on n-h1-831194-21 Oct 04 17:51:04.815239 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1fbd0043-638d-4c1b-b7a3-29dcaf9c78aa req-bdfb7098-2b73-4d03-bd92-116b45966602 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047831 Oct 04 17:51:04.818807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 267/531] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:04.827838 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc147c5a-e661-4d41-b61b-1f9deec9305f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 1.112717 Oct 04 17:51:04.830752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 265/532] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:03 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:04.835133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Calling method '.version_select at 0x7fbdbdc18820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.852965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:04.855234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:04.885304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.886249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.890218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.895886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:04.896599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:04.898496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:04.943693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 05768c26-0828-4c98-a274-439a05b14f81 could not be found", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:51:04.944396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] HTTP exception thrown: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Request method failure captured: Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81 HTTP/1.1 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJ67ZjOgBfbC-LEgvBZUUAaU08cwlw9jDsZNNoCOgSbML5A5kF53mL1kHuYuBrCs5VS3VLxd2GtUJDRYCubv-B97b6LMHYWwCBGhAkDs422RvA5VPS892A5Urp1L9XiPiTogTocnJZjnWtiD-xnzSrcP11Mctkp3trYP4yNf_fJKaQ Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b8941fba26d84f6090bb8340900f3390 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:04.946335 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b8941fba26d84f6090bb8340900f3390"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b8941fba26d84f6090bb8340900f3390"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b8941fba26d84f6090bb8340900f3390 Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1684699138 Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsTestJSON-1684699138-project Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 663e85a157c740b99295cacbb856b61a Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsTestJSON-1684699138-project Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: exception: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '05768c26-0828-4c98-a274-439a05b14f81'} Oct 04 17:51:04.947613 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:51:04.948487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 05768c26-0828-4c98-a274-439a05b14f81 could not be found Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4477863f-ce74-4ed2-8e3e-6d1718dbad36'] Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81. Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.949551 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:04.950883 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:04.952078 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 Oct 04 17:51:04.952078 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:04.952078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] Returning 404 to user: Floating IP not found for ID 05768c26-0828-4c98-a274-439a05b14f81 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:04.952078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7413d906-07a3-4800-88d2-24c27b9314fe tempest-FloatingIPsTestJSON-1684699138 tempest-FloatingIPsTestJSON-1684699138-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81" status: 404 len: 111 microversion: 2.1 time: 0.128006 Oct 04 17:51:04.952078 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 268/533] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:51:04 2022] DELETE /compute/v2.1/os-floating-ips/05768c26-0828-4c98-a274-439a05b14f81 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:05.246508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:05.266852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:05.278144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:05.299991 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cef8d1c6-c29e-4e29-8123-5d80c5c24397 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.459943 Oct 04 17:51:05.306464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 266/534] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:04 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:05.771468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:05.773146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:05.788117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.788931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.789647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.796564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.797242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.800250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.858741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:05.861617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:05.879610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.880115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.880554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:05.881287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:05.881722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:05.882176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.168317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.176566 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8993ecfc-130d-41b3-8985-59b7af3d6ad7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.409665 Oct 04 17:51:06.177064 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 269/535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:05 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:06.340029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:06.340645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:06.355136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.355869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.356467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.357455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:06.358098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:06.358686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:06.470139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.481484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:06.488845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.491005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.500593 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d4cf376f-d7c8-480d-a89b-e3e773a6ee2f tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.165350 Oct 04 17:51:06.501346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 270/536] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:06.606380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:06.616522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1be92d48-6d68-4295-bb89-e9444ed73a0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.763088 Oct 04 17:51:06.625862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 267/537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:05 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:07.201440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.202215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:07.213542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:07.216042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:07.222111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.224533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.225153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:07.226700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.231779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.234485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:07.283517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b31b57f6-1c81-4bb8-8365-9d620d4df554 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Calling method '.version_select at 0x7fbdbdd09d30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.285474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b31b57f6-1c81-4bb8-8365-9d620d4df554 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '8e54f3dadffe48b48cba19978d8994be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e8020b21654e98a213cace0e38d6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b31b57f6-1c81-4bb8-8365-9d620d4df554 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Request method failure captured: Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKJ1t_7m5Of9P3fJ27OWxRKUdV782JkNZIgrM3hOfJU1Y8y8RhDnYTunTWljSJMfO2FHZ2WKt2XdR4xsi6XiclC_F-RIeSjo5lPBS4ScSPc9Io91VEzw-Ek4wtMZrBJ4WcxIvIdE39XpIeTa6jkAoUJXCZegamGWEBmkfK7aryS2kk Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:07.287729 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 8e54f3dadffe48b48cba19978d8994be Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:51:07.288996 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:51:07.289773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 04 17:51:07.291673 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.293554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b31b57f6-1c81-4bb8-8365-9d620d4df554 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:07.296741 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b31b57f6-1c81-4bb8-8365-9d620d4df554 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.548045 Oct 04 17:51:07.303994 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 271/538] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 17:51:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 560 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:07.322232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31ebc2eb-2187-481e-bd02-510da9a90840 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Calling method '.version_select at 0x7fbdbdc09a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.324439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31ebc2eb-2187-481e-bd02-510da9a90840 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '8e54f3dadffe48b48cba19978d8994be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e8020b21654e98a213cace0e38d6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31ebc2eb-2187-481e-bd02-510da9a90840 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Request method failure captured: Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKJ1t_7m5Of9P3fJ27OWxRKUdV782JkNZIgrM3hOfJU1Y8y8RhDnYTunTWljSJMfO2FHZ2WKt2XdR4xsi6XiclC_F-RIeSjo5lPBS4ScSPc9Io91VEzw-Ek4wtMZrBJ4WcxIvIdE39XpIeTa6jkAoUJXCZegamGWEBmkfK7aryS2kk Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:07.335760 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 8e54f3dadffe48b48cba19978d8994be Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:51:07.337392 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:51:07.339351 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 04 17:51:07.340926 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.342298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31ebc2eb-2187-481e-bd02-510da9a90840 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:07.342298 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31ebc2eb-2187-481e-bd02-510da9a90840 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034166 Oct 04 17:51:07.342298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 272/539] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:51:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:07.365103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd08b3b5-ef13-4416-a3cd-8cfe894ca181 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Calling method '.version_select at 0x7fbdbdd6faf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.372869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cd08b3b5-ef13-4416-a3cd-8cfe894ca181 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '8e54f3dadffe48b48cba19978d8994be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e8020b21654e98a213cace0e38d6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd08b3b5-ef13-4416-a3cd-8cfe894ca181 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Request method failure captured: Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKJ1t_7m5Of9P3fJ27OWxRKUdV782JkNZIgrM3hOfJU1Y8y8RhDnYTunTWljSJMfO2FHZ2WKt2XdR4xsi6XiclC_F-RIeSjo5lPBS4ScSPc9Io91VEzw-Ek4wtMZrBJ4WcxIvIdE39XpIeTa6jkAoUJXCZegamGWEBmkfK7aryS2kk Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:07.380188 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 8e54f3dadffe48b48cba19978d8994be Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: action_args: {} Oct 04 17:51:07.381520 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:51:07.382460 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 04 17:51:07.383747 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:07.386442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd08b3b5-ef13-4416-a3cd-8cfe894ca181 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:07.386442 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd08b3b5-ef13-4416-a3cd-8cfe894ca181 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.027082 Oct 04 17:51:07.393224 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 273/540] 10.222.0.42 () {58 vars in 1179 bytes} [Tue Oct 4 17:51:07 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:07.949241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:07.963703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Calling method '.version_select at 0x7fbdbdd09f70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:07.965964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.966672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.967356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:07.986532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:07.987787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:07.988451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.012498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.014417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.014866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.035047 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd989088-8d14-4d6d-96ad-32b355a3dd86 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.639217 Oct 04 17:51:08.036345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 274/541] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:51:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:08.046780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.049326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:08.058909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.059391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.061930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.064156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.064643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.065147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.192731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.209964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.212909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.221296 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c682621-38b6-4edf-8dde-74a68c1342fc tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.183757 Oct 04 17:51:08.222902 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 275/542] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:08.227091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.229017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.230186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:08.236501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.237297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.238013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.238969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.239778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.240429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.240786 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3133fcc3-2b86-400c-a5c8-aaae535f8bed tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 1.042403 Oct 04 17:51:08.254898 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 268/543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:07 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:08.256129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b67064a9-20ca-4b5e-8ad5-84f7c9b2f4b2 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Calling method '.version_select at 0x7fbdbe1e1b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.265449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b67064a9-20ca-4b5e-8ad5-84f7c9b2f4b2 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '8e54f3dadffe48b48cba19978d8994be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e8020b21654e98a213cace0e38d6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b67064a9-20ca-4b5e-8ad5-84f7c9b2f4b2 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Request method failure captured: Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKJ1t_7m5Of9P3fJ27OWxRKUdV782JkNZIgrM3hOfJU1Y8y8RhDnYTunTWljSJMfO2FHZ2WKt2XdR4xsi6XiclC_F-RIeSjo5lPBS4ScSPc9Io91VEzw-Ek4wtMZrBJ4WcxIvIdE39XpIeTa6jkAoUJXCZegamGWEBmkfK7aryS2kk Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:08.266768 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 8e54f3dadffe48b48cba19978d8994be Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1'} Oct 04 17:51:08.268056 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:51:08.268866 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 04 17:51:08.269982 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.272967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b67064a9-20ca-4b5e-8ad5-84f7c9b2f4b2 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:08.275299 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b67064a9-20ca-4b5e-8ad5-84f7c9b2f4b2 tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.028792 Oct 04 17:51:08.278266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 269/544] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:08.298649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad29e742-7b1b-4af4-ba55-968c576d3f4b tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Calling method '.version_select at 0x7fbdbe01b4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.301762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ad29e742-7b1b-4af4-ba55-968c576d3f4b tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] HTTP exception thrown: Hypervisor with ID '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' could not be found. Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad29e742-7b1b-4af4-ba55-968c576d3f4b tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Request method failure captured: Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hypervisors/7752ba5f-6fa0-4bfe-af2e-5813a451fa8d/uptime HTTP/1.1 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKKNvC8N6Itm5U_fS0_OxCynLPFKK0PEVEN0NZSy5h3MwZKPRVwQ_EW_O7DhlYADi_VAZvhW7ehd6bT-HOeTPw_eAldJews2VOUIAsevkGNRF9wXW_hLITAAvqo6zt3qCsTb9dv0wPniqgSocx0OgLXQVVxcEO4VvfeG4AOK1S1r_o Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: cca6a8f5a9094f7f86574898bf5a8cf1 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:51:08.312869 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: cca6a8f5a9094f7f86574898bf5a8cf1 Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 934690baaef045a4b98d470ee45df551 Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: exception: Hypervisor with ID '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' could not be found. Oct 04 17:51:08.314233 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d'} Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 17:51:08.314936 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' could not be found. Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.316182 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' could not be found. Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.317395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad29e742-7b1b-4af4-ba55-968c576d3f4b tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Returning 404 to user: Hypervisor with ID '7752ba5f-6fa0-4bfe-af2e-5813a451fa8d' could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:08.321482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad29e742-7b1b-4af4-ba55-968c576d3f4b tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/7752ba5f-6fa0-4bfe-af2e-5813a451fa8d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.035494 Oct 04 17:51:08.331353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 270/545] 10.222.0.42 () {58 vars in 1278 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/os-hypervisors/7752ba5f-6fa0-4bfe-af2e-5813a451fa8d/uptime => generated 123 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:08.339822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Calling method '.version_select at 0x7fbdbe2d4d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.343282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.343901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.344355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.364781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.365284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.365867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.380074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:08.380566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:08.381003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:08.388546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48339f24-b289-4760-9a4d-55bc05b77c34 tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.054854 Oct 04 17:51:08.389148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 271/546] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:08.403074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-228171af-55e3-44d2-8e26-6b830989046a tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Calling method '.version_select at 0x7fbdbe0b6e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.405919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-228171af-55e3-44d2-8e26-6b830989046a tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '8e54f3dadffe48b48cba19978d8994be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2e8020b21654e98a213cace0e38d6c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-228171af-55e3-44d2-8e26-6b830989046a tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Request method failure captured: Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKJ1t_7m5Of9P3fJ27OWxRKUdV782JkNZIgrM3hOfJU1Y8y8RhDnYTunTWljSJMfO2FHZ2WKt2XdR4xsi6XiclC_F-RIeSjo5lPBS4ScSPc9Io91VEzw-Ek4wtMZrBJ4WcxIvIdE39XpIeTa6jkAoUJXCZegamGWEBmkfK7aryS2kk Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:08.408517 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f2e8020b21654e98a213cace0e38d6c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f2e8020b21654e98a213cace0e38d6c2 Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-429620401 Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 8e54f3dadffe48b48cba19978d8994be Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-429620401-project Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1'} Oct 04 17:51:08.410094 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:51:08.411042 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 04 17:51:08.412371 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.415011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-228171af-55e3-44d2-8e26-6b830989046a tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:08.417028 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-228171af-55e3-44d2-8e26-6b830989046a tempest-HypervisorAdminNegativeTestJSON-429620401 tempest-HypervisorAdminNegativeTestJSON-429620401-project] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.018893 Oct 04 17:51:08.424571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 272/547] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:08.450659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04aa77ac-64f4-42c7-9659-cd4eb06fefba tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Calling method '.version_select at 0x7fbdbe0344c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:08.463588 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-04aa77ac-64f4-42c7-9659-cd4eb06fefba tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] HTTP exception thrown: Hypervisor with ID 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' could not be found. Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04aa77ac-64f4-42c7-9659-cd4eb06fefba tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Request method failure captured: Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-hypervisors/c70ddf35-e48a-473c-9277-4e4883d5a6e5 HTTP/1.1 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKKNvC8N6Itm5U_fS0_OxCynLPFKK0PEVEN0NZSy5h3MwZKPRVwQ_EW_O7DhlYADi_VAZvhW7ehd6bT-HOeTPw_eAldJews2VOUIAsevkGNRF9wXW_hLITAAvqo6zt3qCsTb9dv0wPniqgSocx0OgLXQVVxcEO4VvfeG4AOK1S1r_o Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: cca6a8f5a9094f7f86574898bf5a8cf1 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:51:08.477255 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_cca6a8f5a9094f7f86574898bf5a8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: cca6a8f5a9094f7f86574898bf5a8cf1 Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874 Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 934690baaef045a4b98d470ee45df551 Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: exception: Hypervisor with ID 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' could not be found. Oct 04 17:51:08.479096 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c70ddf35-e48a-473c-9277-4e4883d5a6e5'} Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 04 17:51:08.479787 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:51:08.482063 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' could not be found. Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' could not be found. Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04aa77ac-64f4-42c7-9659-cd4eb06fefba tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] Returning 404 to user: Hypervisor with ID 'c70ddf35-e48a-473c-9277-4e4883d5a6e5' could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:08.488006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04aa77ac-64f4-42c7-9659-cd4eb06fefba tempest-HypervisorAdminNegativeTestJSON-1751727874 tempest-HypervisorAdminNegativeTestJSON-1751727874-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/c70ddf35-e48a-473c-9277-4e4883d5a6e5" status: 404 len: 123 microversion: 2.1 time: 0.040777 Oct 04 17:51:08.492611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 273/548] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/os-hypervisors/c70ddf35-e48a-473c-9277-4e4883d5a6e5 => generated 123 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:08.750003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:08.762530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d8d385c-eb4f-47b3-9870-c2842007851d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.535769 Oct 04 17:51:08.763069 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 276/549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:08 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:09.257217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.257862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.272642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.273273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.289165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.289741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.290509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.292521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.292841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.293806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.294564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.295538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.296241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.296888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.297578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.298328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.462372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.471876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.477019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:09.488545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-762d96e2-b687-4f6a-844e-86467f276126 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.236764 Oct 04 17:51:09.510286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 274/550] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:09.790031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:09.790983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:09.802851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.803600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.805376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:09.806464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:09.809734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:09.810444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.262560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.279063 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3bdc9839-6562-4d9e-a07a-7e01e05c195e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 1.010246 Oct 04 17:51:10.280904 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 277/551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:10.523440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:10.524208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:10.536983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.539790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.540484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.542172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:10.543007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:10.543816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:10.560264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.572550 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18431bfa-c7b4-47d6-a6dd-1bdf05edf81d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.783901 Oct 04 17:51:10.573405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 275/552] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:09 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:10.654614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.668415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.673279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:10.689691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2be9c7fc-dc74-4c0f-a7f4-b1c204fabbe5 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1446 microversion: 2.75 time: 0.170256 Oct 04 17:51:10.690673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 278/553] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:10 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:11.305151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:11.306862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:11.326512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.327280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.327878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.328875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.329783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.330385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.382751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:11.598177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:11.600249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:11.612347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.612841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.618466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:11.621003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:11.624607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:11.625337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.220000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.252014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d110691-c33b-4efe-a355-aca6b292d697 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.659269 Oct 04 17:51:12.257734 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 279/554] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:11 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:12.262715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:12.263310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:12.281979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.282668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.283256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.284112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:12.286383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:12.286999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:12.313907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.336463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53e21317-7902-40cf-a1fc-11c76d667d72 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 1.036139 Oct 04 17:51:12.353854 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 276/555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:11 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:12.795956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.805286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.818111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:12.830293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93584c8a-06c4-42e6-8aaf-c31d35126a0b tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1464 microversion: 2.75 time: 0.571173 Oct 04 17:51:12.830982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 280/556] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:12 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1464 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:12.983491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93695d49-46d7-4f96-8944-4f3d2dc0c2f9", "name": "network-vif-plugged", "status": "completed", "tag": "b25c3a3c-cacb-4f40-82ad-133b6fa69f7d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.007926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.008395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.013893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.057992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] Creating event network-vif-plugged:b25c3a3c-cacb-4f40-82ad-133b6fa69f7d for instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 on n-h1-831194-21 Oct 04 17:51:13.087909 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-89cecd5d-9fcd-4a2e-b91c-57a7d9e9a42f req-a1d59924-4d2c-4f0d-851d-94df2f0a4b76 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108977 Oct 04 17:51:13.088557 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 281/557] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:13.195220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61fff24f-ca9f-4089-b257-cc8a39a2d30f tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Action: 'create', calling method: .version_select at 0x7fbdbe01bdc0>, body: {"keypair": {"name": "tempest-keypair-388451331", "type": "ssh", "user_id": "9c68b43cedd54f3a9fc12884568450ea", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWexkgF9Q2vseOJztAF/IoRjFsnTN8kSbTFl+5VXAGSCPxuPyuEktolRnRUlLILZ0y3qhoOuQS4C4d3+7P0/ctUe23PNBV1GGJF2wHd4uJiPRWcOqaege5cT/OVXB8F1Q=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.236328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-61fff24f-ca9f-4089-b257-cc8a39a2d30f tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:13.248372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-61fff24f-ca9f-4089-b257-cc8a39a2d30f tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for user 3ade81172c7b4413a5d923d4a7e6297b and project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:13.280218 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61fff24f-ca9f-4089-b257-cc8a39a2d30f tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.929241 Oct 04 17:51:13.281263 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 277/558] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 17:51:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 936 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:51:13.284967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.285721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.295226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.299974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.300435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.305923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.306944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.307375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.309747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8f463b7-dd74-4384-b389-e19beb4ca0b2 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Action: 'create', calling method: .version_select at 0x7fbdbe3b9a60>, body: {"keypair": {"name": "tempest-keypair-371243963", "type": "ssh", "user_id": "9c68b43cedd54f3a9fc12884568450ea", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWZqxHM/KCdk4yJeSViYtx1J0fFzm5vVLCoh51T4uS9SXSUzlocHe5K5I/JYU+x4PdqsbgaAPr3h7yaJ3mSTrLQGkly5fxxPMicMz+eOlS/WHbX8y9J0Kx5LPv5TZXOkg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.352335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e8f463b7-dd74-4384-b389-e19beb4ca0b2 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:13.389042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e8f463b7-dd74-4384-b389-e19beb4ca0b2 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for user 3ade81172c7b4413a5d923d4a7e6297b and project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:13.484408 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8f463b7-dd74-4384-b389-e19beb4ca0b2 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.179301 Oct 04 17:51:13.487133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 278/559] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 17:51:13 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 196 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:51:13.501819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.503826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.516690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.520071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.520758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.528317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.529204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.529987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.733874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:13.751906 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff2d2fab-f3b0-4ba4-8525-74785a6c51e1 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.473912 Oct 04 17:51:13.752653 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 282/560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:13.761591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82bef00d-d440-489a-821b-0b4e4e4eb195 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Calling method '.version_select at 0x7fbdbdc09ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.797709 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82bef00d-d440-489a-821b-0b4e4e4eb195 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-388451331?user_id=9c68b43cedd54f3a9fc12884568450ea" status: 200 len: 511 microversion: 2.10 time: 0.043382 Oct 04 17:51:13.808103 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 283/561] 10.222.0.42 () {60 vars in 1337 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-388451331?user_id=9c68b43cedd54f3a9fc12884568450ea => generated 511 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:13.816407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e965ff72-6a94-4c76-9349-9ae936bd286d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Action: 'create', calling method: .version_select at 0x7fbdbdc099d0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-252218107", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtkY4K6vA1khXcgieZ0e7jNGjCFt1VPv7oGqaHvHufxmM0rS1nOJnxImeNxVEc7Cp/MoX3kMZwR7bFsI/r2SasJx6s2WZhf5+gPvHWZacGSNLOYuUDwERbqD0e1muB3cg=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:13.845714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e965ff72-6a94-4c76-9349-9ae936bd286d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:13.864039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e965ff72-6a94-4c76-9349-9ae936bd286d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Getting quotas for user 3ade81172c7b4413a5d923d4a7e6297b and project 3db284c489b8424dab6e1f199b3ce51b. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:13.898797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e965ff72-6a94-4c76-9349-9ae936bd286d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.089505 Oct 04 17:51:13.899541 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 284/562] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 17:51:13 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 91 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:51:13.906174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:13.906534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:13.917459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.918244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.920334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:13.922899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:13.923624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:13.924277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.227346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.240793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.249668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.265822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:14.266469 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d49db52c-5247-433b-983a-57139e9f7b5a tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1452 microversion: 2.75 time: 0.361179 Oct 04 17:51:14.277862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 285/563] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1452 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:14.279339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-004c3921-eb6b-4126-a45b-0d20100fbfdc tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Calling method '.version_select at 0x7fbdbdc7c940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.291398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb172c79-ebff-4bd6-8f51-02a15beaa3f1 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.790120 Oct 04 17:51:14.291629 n-d-831194-21 devstack@n-api.service[128849]: WARNING oslo_db.sqlalchemy.utils [None req-004c3921-eb6b-4126-a45b-0d20100fbfdc tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 17:51:14.294616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 279/564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:13 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:14.302428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-004c3921-eb6b-4126-a45b-0d20100fbfdc tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "GET /compute/v2.1/os-keypairs?user_id=9c68b43cedd54f3a9fc12884568450ea" status: 200 len: 724 microversion: 2.10 time: 0.032623 Oct 04 17:51:14.307660 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 286/565] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/os-keypairs?user_id=9c68b43cedd54f3a9fc12884568450ea => generated 724 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:14.330945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63d87583-8595-4e85-8f29-5f465ae0a892 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Calling method '.version_select at 0x7fbdbdfcddc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.406290 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63d87583-8595-4e85-8f29-5f465ae0a892 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-252218107" status: 204 len: 0 microversion: 2.10 time: 0.088499 Oct 04 17:51:14.407825 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 280/566] 10.222.0.42 () {60 vars in 1322 bytes} [Tue Oct 4 17:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-252218107 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:51:14.421036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cfba20fb-4f77-4d47-9ed2-823dedf2e95d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Calling method '.version_select at 0x7fbdbdc09940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.526414 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cfba20fb-4f77-4d47-9ed2-823dedf2e95d tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-371243963?user_id=9c68b43cedd54f3a9fc12884568450ea" status: 204 len: 0 microversion: 2.10 time: 0.109668 Oct 04 17:51:14.530688 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 287/567] 10.222.0.42 () {60 vars in 1340 bytes} [Tue Oct 4 17:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-371243963?user_id=9c68b43cedd54f3a9fc12884568450ea => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:51:14.541257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22267e77-6d38-400b-bf45-441816ae6fe9 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] Calling method '.version_select at 0x7fbdbe034550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.603879 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22267e77-6d38-400b-bf45-441816ae6fe9 tempest-KeyPairsV210TestJSON-1873462271 tempest-KeyPairsV210TestJSON-1873462271-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388451331?user_id=9c68b43cedd54f3a9fc12884568450ea" status: 204 len: 0 microversion: 2.10 time: 0.068702 Oct 04 17:51:14.604977 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 281/568] 10.222.0.42 () {60 vars in 1340 bytes} [Tue Oct 4 17:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388451331?user_id=9c68b43cedd54f3a9fc12884568450ea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:51:14.779722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:14.780889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:14.804538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.808014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.810490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:14.813902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:14.815046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:14.831198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.299804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:15.300754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:15.324084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.326510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.327795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.330483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.331826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.334672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.410647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.424459 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0bf68a4-d90b-4eea-9902-b363f41b69de tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1388 microversion: 2.1 time: 0.645752 Oct 04 17:51:15.434658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 288/569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:14 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1388 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:15.440017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:15.441040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:15.452959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:15.455507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.456305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.456754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.467161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:15.467784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:15.468247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:15.611459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.629115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.633356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.654202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-165fc365-0671-47c6-8b31-9f3d2badfbce tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1437 microversion: 2.75 time: 0.358829 Oct 04 17:51:15.658236 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 282/570] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:15 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1437 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:15.938171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:15.951719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-989689be-1118-44b3-a0ff-14336d1b35a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.515322 Oct 04 17:51:15.954672 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 289/571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:15 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:16.357429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:16.362248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.393898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.394417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.405637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.406614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.407307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.408738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.452928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.453539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.466763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.467278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.467725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.468445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.468907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.475802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.568700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:16.569127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:16.569602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:16.570046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:16.570462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:16.706399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.719969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.720492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.721037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.721877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.722348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.722778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.883268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:16.901920 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23ebdae7-5c4a-4fbd-9951-f3188011cd48 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1587 microversion: 2.1 time: 0.450788 Oct 04 17:51:16.913866 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 290/572] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1587 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:16.931824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:16.932352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:16.939193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.940789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.942493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:16.943603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:16.944374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:16.945017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.058441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0bfc28e-0ef1-44e1-b19c-2962064e661c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131972 Oct 04 17:51:17.066316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 291/573] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:51:16 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:17.080939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.081933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.117341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.120216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.121792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.135589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.137375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.144771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.211310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:17.359278 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eee84f8c-8267-4699-aef3-a528b8bd5d39 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3/action" status: 202 len: 1942 microversion: 2.75 time: 1.670402 Oct 04 17:51:17.373931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 283/574] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:51:15 2022] POST /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3/action => generated 1942 bytes in 1680 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 17:51:17.902872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-437e683b-fe30-4ff9-ad77-2cbeda16cad9 tempest-InstanceUsageAuditLogTestJSON-1795596900 tempest-InstanceUsageAuditLogTestJSON-1795596900-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.948697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-437e683b-fe30-4ff9-ad77-2cbeda16cad9 tempest-InstanceUsageAuditLogTestJSON-1795596900 tempest-InstanceUsageAuditLogTestJSON-1795596900-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04 17:51:17" status: 200 len: 318 microversion: 2.1 time: 0.580775 Oct 04 17:51:17.949530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 284/575] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-04%2017%3A51%3A17 => generated 318 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:17.957599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:17.962847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:17.974778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.975521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.976131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:17.982803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:17.983804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:17.984403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.131830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:18.185981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:18.194022 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c258cba-8598-40d9-919b-060e2b830260 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.243192 Oct 04 17:51:18.194920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 285/576] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:18.214217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63097a6a-81ff-4090-85fc-474580eebf48 tempest-InstanceUsageAuditLogTestJSON-1795596900 tempest-InstanceUsageAuditLogTestJSON-1795596900-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:18.219019 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7ff1d39-74e2-4a65-baa6-7dd71909c472 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 1.141342 Oct 04 17:51:18.222568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 292/577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:17 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:18.272162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63097a6a-81ff-4090-85fc-474580eebf48 tempest-InstanceUsageAuditLogTestJSON-1795596900 tempest-InstanceUsageAuditLogTestJSON-1795596900-project-admin] 10.222.0.42 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.076067 Oct 04 17:51:18.273035 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 286/578] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 17:51:18 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:18.611180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Calling method '.version_select at 0x7fbdbdc7c160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:18.643827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.644321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.644761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.650944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:18.653988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:18.654724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:18.719481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f94d7287-d9ba-4688-bad0-aefb936e8f55 tempest-AbsoluteLimitsTestJSON-1343175453 tempest-AbsoluteLimitsTestJSON-1343175453-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.411038 Oct 04 17:51:18.721444 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 293/579] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Oct 4 17:51:18 2022] GET /compute/v2.1/limits => generated 511 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:19.226577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:19.227332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:19.245542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:19.246579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:19.260893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.263295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.264043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.268711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.270132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.271184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.271917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.273034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.277016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.279236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:19.284892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:19.285975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:19.505595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:19.556497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee27e0b3-cc0b-4c4c-ae20-e1faf2e69f3a tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.334700 Oct 04 17:51:19.561676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 287/580] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:19 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:19.962727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:19.971031 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b5d31a5-38f0-4638-84b4-8fe85b71a136 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.730281 Oct 04 17:51:19.986314 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 294/581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:19 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:20.595845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:20.597196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:20.606469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.607895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.608626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.610119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.610829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.613202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.736365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:20.737000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:20.751184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:20.752574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.753115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.753569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.755914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.757244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.758184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.794131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-080e516c-826d-4afe-a9b4-38188b634124 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.205003 Oct 04 17:51:20.810101 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 288/582] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:20 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:20.824849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93695d49-46d7-4f96-8944-4f3d2dc0c2f9", "tag": "b25c3a3c-cacb-4f40-82ad-133b6fa69f7d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:20.841417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:20.842433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:20.843032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:20.858442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] Creating event network-changed:b25c3a3c-cacb-4f40-82ad-133b6fa69f7d for instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 on n-h1-831194-21 Oct 04 17:51:20.864534 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05dd57a3-736a-4c41-80ca-39301c3a921c req-19440e0d-27ab-4f67-880d-633720fde9a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051281 Oct 04 17:51:20.865706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 289/583] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:20.998128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:20.998995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:21.003830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=5,nova_api:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:21.026060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.026559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.026996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.027708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.035485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.038010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.667114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:21.677998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ca36511-4214-4beb-91fc-1d52cad28628 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.686149 Oct 04 17:51:21.688792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 290/584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:20 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:21.828572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:21.829528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:21.838921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.841486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.845470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.846608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:21.847314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:21.847795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:21.855893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:21.874785 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df91e65a-9316-49d0-8755-07b1668529c5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 200 len: 1587 microversion: 2.1 time: 1.143574 Oct 04 17:51:21.878105 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 295/585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:20 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 1587 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:22.061091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:22.098173 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70482a9f-7139-43c4-b1f3-0d9243224996 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.274456 Oct 04 17:51:22.098958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 291/586] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:21 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:22.719632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:22.720270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:22.733659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.734610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.735739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.744876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:22.745467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:22.745945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:22.817416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:23.090952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:23.107971 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72470849-54a6-4482-b757-e114977433f8 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.398903 Oct 04 17:51:23.109161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 296/587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:22 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:23.137700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:23.138948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:23.150482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.151003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.151418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.152239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:23.152737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:23.153163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:23.282040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:23.345862 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6791df73-1a69-4275-a486-99277a562062 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.212475 Oct 04 17:51:23.347570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 292/588] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:23 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:24.013649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-764403577", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "80473809-bb12-479f-b8c4-34707cc9211b"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:24.112239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] validate_networks() for [('80473809-bb12-479f-b8c4-34707cc9211b', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:24.150485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:24.151742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:24.159419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.160225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.161061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.163269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.163921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.165318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.479339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:24.488032 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e4e1322-c0a7-4717-8f12-0250bf6a8420 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.343657 Oct 04 17:51:24.489389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 293/589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:24 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:24.495485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:24.496572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:24.511193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.512167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.512802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.513686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:24.514929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:24.515547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:24.628477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:24.633512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:24.661794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8401204-37e2-4b55-993c-6ca75311c0b9 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.170937 Oct 04 17:51:24.662552 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 294/590] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:24 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:25.520776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.522257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:25.540596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.541302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.543392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.546615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.547110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.547848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.676391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:25.677003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:25.677746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:25.678314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:25.678849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:25.712983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.715683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.716301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.717350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:25.718775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:25.723266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:25.787769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Getting quotas for project 6e5caff1110548d18e7b19b633a44bfb. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:25.813770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Getting quotas for user 7c50c159b7dd4d18a1fd8628ada499c8 and project 6e5caff1110548d18e7b19b633a44bfb. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:25.851935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:25.858179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:25.977921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acfe6ef5-0c43-41d3-9653-e3e0ebeb6da7 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.644419 Oct 04 17:51:25.980302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 297/591] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:25.986056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:25.989551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.000425 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52fa504b-ecde-43de-9144-99a06f33c1df tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.483498 Oct 04 17:51:26.002023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:26.018673 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 295/592] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:26.035601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.037253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f194887b-1c40-468c-9ace-d40222923e9e tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:26.038010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.039303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f194887b-1c40-468c-9ace-d40222923e9e tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:26.040852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.043868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:26.045907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:26.048645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:26.318097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f194887b-1c40-468c-9ace-d40222923e9e tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:26.331473 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f194887b-1c40-468c-9ace-d40222923e9e tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1215 microversion: 2.1 time: 0.309400 Oct 04 17:51:26.333051 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 296/593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:26 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1215 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:26.399204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:26.474685 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5edbfed-0c0b-44e5-a71e-b550549ceb78 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.492871 Oct 04 17:51:26.475841 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 298/594] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:25 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:26.726973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-157d2208-eba2-4995-9a48-60e066c3595d tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] Calling method '.version_select at 0x7fbdbdfcdf70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.035452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.036206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:27.049043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.054026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.055223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.056544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.057011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.057626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.183734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-157d2208-eba2-4995-9a48-60e066c3595d tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 5391 microversion: 2.1 time: 0.849504 Oct 04 17:51:27.189302 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 297/595] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:51:26 2022] GET /compute/v2.1/os-networks => generated 5391 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:27.195992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb27a91-c581-448c-8226-863315b4b72d tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] Calling method '.version_select at 0x7fbdbe01baf0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.603765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:27.619664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b9612a6-fe56-40bc-8247-cee584785c69 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.588011 Oct 04 17:51:27.621467 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 299/596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:27.639427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.640059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:27.655509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.656015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.656461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.657178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.657637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.658093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.797433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:27.815403 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8995849c-d11c-4da8-b4ba-0a9d7e8d11aa tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1267 microversion: 2.1 time: 0.186867 Oct 04 17:51:27.834960 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 300/597] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:27.841403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:27.848010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:27.865658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.866508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.867204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:27.869578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:27.870496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:27.871533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.028090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:28.080207 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14841624-810b-4976-bdcb-be4e85e3758e tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.244243 Oct 04 17:51:28.085163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 301/598] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:28.130051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cb27a91-c581-448c-8226-863315b4b72d tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks/4b08c814-5b8b-45b1-8ff6-fdc843dc9787" status: 200 len: 652 microversion: 2.1 time: 0.938029 Oct 04 17:51:28.131314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 298/599] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 17:51:27 2022] GET /compute/v2.1/os-networks/4b08c814-5b8b-45b1-8ff6-fdc843dc9787 => generated 652 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:28.141966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1dffd89f-f517-47e4-b3ac-ebca07de54ec tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] Calling method '.version_select at 0x7fbdbddad4c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.650881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.651634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:28.666631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.667112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.667547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.668263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.668775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.669173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.881689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1dffd89f-f517-47e4-b3ac-ebca07de54ec tempest-NetworksTest-42772149 tempest-NetworksTest-42772149-project-admin] 10.222.0.42 "GET /compute/v2.1/os-networks" status: 200 len: 6077 microversion: 2.1 time: 0.743797 Oct 04 17:51:28.889690 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 302/600] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/os-networks => generated 6077 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:28.898507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:28.901194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:28.919647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.920147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.920880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:28.922765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:28.927920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:28.928546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.031456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.045092 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-247f288b-6ebc-48d3-9a00-110e5d10cd7d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1273 microversion: 2.1 time: 0.152676 Oct 04 17:51:29.060274 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 303/601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1273 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:29.119072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:29.120689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:29.135221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.135913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.136473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.137346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:29.138531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:29.139074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:29.267064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:29.276663 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b5666a3-569c-465c-bcc4-a3cf5f61a352 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1473 microversion: 2.1 time: 0.632118 Oct 04 17:51:29.292068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 299/602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:28 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1473 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:29.353570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:29.404166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aec8cbe3-61ab-4bb1-84dd-a73b4c901b6d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.290570 Oct 04 17:51:29.408807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 304/603] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:29 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:30.072138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.073098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.093043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.093613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.094184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.094996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.097158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.097792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.268082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.284478 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04dea4fb-3e5f-4a13-9fb4-ba9c097f8d99 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1273 microversion: 2.1 time: 0.216805 Oct 04 17:51:30.290746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 300/604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:30.310503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.311131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.327708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.328465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.329058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.330171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.332272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.333068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.438417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:30.439286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:30.445526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.446584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.447188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.448061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:30.448670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:30.449247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:30.603462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:30.677072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e8a288e-2064-4153-b0e5-05b0f4f140bc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.242248 Oct 04 17:51:30.693859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 301/605] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:30.912355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:30.932171 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f68df0c6-1217-40e8-b541-6d2d1d3680b2 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1479 microversion: 2.1 time: 0.628206 Oct 04 17:51:30.933020 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 305/606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:30 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1479 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:31.316299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.316978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:31.326530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.327021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.333798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.334810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.335436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.336017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.713321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:31.714114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:31.727763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.728647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.731845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:31.732723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:31.733477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:31.734421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.061679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:32.081478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.124034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5bdf1d9b-1f2c-4d0b-a6fb-9529518c4fbf tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.805099 Oct 04 17:51:32.129872 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b74ae6b-bb99-4be7-82d8-88ae746ddb56 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.421346 Oct 04 17:51:32.130477 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 306/607] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:32.140670 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 302/608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:31 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:32.156027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:32.159137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:32.171675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.172529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.173118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.174472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:32.175253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:32.175688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:32.859905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:32.873592 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79097122-a6b6-46b9-a9f4-88c215a536f7 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1479 microversion: 2.1 time: 0.739829 Oct 04 17:51:32.881885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 307/609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:32 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1479 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:33.148255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.150108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.160395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.170694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.172002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.176466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.177247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.197147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.199330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.203273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.204785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.205445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.206116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.210733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.217281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.219375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.361993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:33.382169 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef1f2497-655e-4176-81e6-d8f7ca365fcc tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.219387 Oct 04 17:51:33.384201 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 308/610] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:33.437991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2682f88-57cf-4848-9184-0744ffef6858", "tag": "baab076e-c9cc-45b3-ae09-ef361e984cd3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:33.455570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.456438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.457030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.695345 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] Creating event network-changed:baab076e-c9cc-45b3-ae09-ef361e984cd3 for instance a2682f88-57cf-4848-9184-0744ffef6858 on n-h1-831194-21 Oct 04 17:51:33.701303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f02598b1-92d7-46bb-8a04-dee707539711 req-654f067d-e40d-42b9-bd7a-3f9ffe9b7eef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268339 Oct 04 17:51:33.701781 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 309/611] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:33.903110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:33.903782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:33.911164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.920020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.922002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:33.928143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:33.929104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:33.932179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.370105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:34.381437 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9415f039-1f6a-4eec-8d84-bc8484bed02d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1464 microversion: 2.1 time: 0.482511 Oct 04 17:51:34.396432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 310/612] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1464 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:34.438791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-unplugged", "status": "completed", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:34.468530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.470703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.471157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.503916 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] Creating event network-vif-unplugged:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:51:34.522308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-06244169-5f1f-46eb-9d0b-64aa2fc41dfa req-53a5487b-28aa-4cbb-860e-5aa0e9c20eeb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108331 Oct 04 17:51:34.525612 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 311/613] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:34.530690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:34.532069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:34.537655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:34.540648 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81d37cef-d33c-4ff3-9469-811cae5cfea6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 1.396248 Oct 04 17:51:34.541230 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 303/614] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:33 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:34.545610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:34.565422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:34.569225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.580722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.582039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.582527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.582813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.583019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.583301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.583454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.583741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.598318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.598967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.599616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.753325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1f6a6b6-adca-418e-b929-4b50556e2ef1 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 0 microversion: 2.1 time: 0.209051 Oct 04 17:51:34.755010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 304/615] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:34 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:51:34.769100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:34.771143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:34.783276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.784239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.784825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.785744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.786363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.787006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.824533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:34.825379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:34.827306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:34.828075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lazy-loading 'fault' on Instance uuid 445364bc-c274-4d90-b6b7-acd488b398e3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:34.919550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:34.998846 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e193d33a-0362-4d8f-87c3-11e0b6b3dc4d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.470635 Oct 04 17:51:34.999729 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 312/616] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:34 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:35.232181 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f9a25b65-5aca-4710-bfc8-5e3f88885096 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1600 microversion: 2.1 time: 0.472028 Oct 04 17:51:35.233976 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 305/617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:34 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1600 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:35.266583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:35.271174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.281212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.283107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.283726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.284639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.285263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.286085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.330205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.432894 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5668db1-f4ea-43fb-b9f9-e59de9b5ad01 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action" status: 202 len: 0 microversion: 2.1 time: 0.173008 Oct 04 17:51:35.449990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.450966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.457365 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 313/618] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:51:35 2022] POST /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:51:35.461304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.463417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.465037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.465976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.467088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.467707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.566497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:35.567137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:35.581701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.584060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.584557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.585321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:35.585800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:35.589611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:35.743771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.837243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:35.908580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:35.918228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0179b2de-4750-403b-9dd6-04e8a1483f0b tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.356799 Oct 04 17:51:35.926506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 314/619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:36.000512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ba21866-b819-41a5-bf73-843fe1234a22 tempest-ServersAdminTestJSON-1353250744 tempest-ServersAdminTestJSON-1353250744-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1617 microversion: 2.1 time: 0.557254 Oct 04 17:51:36.024413 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 306/620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:35 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1617 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:36.030199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.030821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.038092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.040749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.042272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.043301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.044760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.054034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.054720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.058888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.060631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.061327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.061958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.064239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.066507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.067874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.141918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:36.322992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=18 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:36.372711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:36.395454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-071f80ae-1541-4a0d-8166-2af9d60c02af tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 204 len: 0 microversion: 2.1 time: 0.369232 Oct 04 17:51:36.398099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 315/621] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:36 2022] DELETE /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:51:36.411052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.413569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.433659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.435173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.437379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.438755 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ffaca667-7a25-45bf-b141-3c667c845317 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.411560 Oct 04 17:51:36.439788 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 307/622] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:36.439972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.441707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.442242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.954290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:36.955498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:36.987980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.990171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.990837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:36.994586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:36.996413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:36.998059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.066125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:37.087419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-29359dc6-c2fb-47cb-b953-b9513fa4447e tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1469 microversion: 2.1 time: 0.684201 Oct 04 17:51:37.088432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 316/623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1469 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:37.489101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:37.493256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:37.503927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.504932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.505582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.510312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:37.511131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:37.514428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:37.627835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:37.642394 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90f1a2a2-eb39-4fad-96e7-035672d5f122 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.693171 Oct 04 17:51:37.643541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 308/624] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:36 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:37.798163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:37.862153 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1a31c84-e2a3-4515-b684-4ff7f558666f tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.391736 Oct 04 17:51:37.863488 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 317/625] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:37 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:37.935196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbdfabd30>, body: {"quota_set": {"ram": "5120"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:38.026493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.027221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.027802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.028681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.029442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.030053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.121476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.122168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.129428 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b40672e2-9e99-4497-9f3c-cf9413c45f00 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18" status: 200 len: 148 microversion: 2.57 time: 0.484583 Oct 04 17:51:38.130831 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 309/626] 10.222.0.42 () {62 vars in 1303 bytes} [Tue Oct 4 17:51:37 2022] PUT /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18 => generated 148 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:38.145406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.147457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.149178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.149371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Calling method '.version_select at 0x7fbdbe0b6ca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.158384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.159443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.165708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.291629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.292644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.294471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.295475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.296702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.297387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.342613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4ec4fa52-7343-4d24-936f-ae90f674cbce tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18/detail" status: 200 len: 463 microversion: 2.57 time: 0.202640 Oct 04 17:51:38.359576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 310/627] 10.222.0.42 () {60 vars in 1304 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18/detail => generated 463 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:38.648531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Action: 'update', calling method: .version_select at 0x7fbdbe1e11f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:38.787649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.788213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.788883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.790406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.790949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.791389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.834812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.835307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.835750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.837890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.838370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.838804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.925407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22711bc6-7943-4edf-b5a2-eed66f247638 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18?user_id=2eb956cde343485ebb01267463f5174c" status: 200 len: 148 microversion: 2.57 time: 0.281372 Oct 04 17:51:38.927356 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 311/628] 10.222.0.42 () {62 vars in 1384 bytes} [Tue Oct 4 17:51:38 2022] PUT /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18?user_id=2eb956cde343485ebb01267463f5174c => generated 148 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:51:38.932877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:38.933726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:38.940745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.941567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.942222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:38.943103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:38.944451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:38.945068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.128007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:39.137805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb1969af-9fce-4557-93b7-069b156468f3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.209121 Oct 04 17:51:39.138409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 312/629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:39.143040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-plugged", "status": "completed", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:39.154430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.155419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.155855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.172148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] Creating event network-vif-plugged:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:51:39.177660 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a96bdbde-8a50-4cb2-8365-d02916db29ac req-812b7624-2f3f-4e90-888c-7932da760551 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037827 Oct 04 17:51:39.178659 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 313/630] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:39.182128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:39.191990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7726075d-47a2-4a74-8084-1000a8b4edeb tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1469 microversion: 2.1 time: 1.081205 Oct 04 17:51:39.197886 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 318/631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:38 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1469 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:39.210271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:39.210987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:39.218568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.218938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.219549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.220426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:39.221081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:39.221687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:39.253878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-857b9e1d-f981-4f64-a464-4cd15f582dc5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbe034670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-777288863", "description": "tempest-description-28478402"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:39.448877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:39.465818 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-857b9e1d-f981-4f64-a464-4cd15f582dc5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.285926 Oct 04 17:51:39.482562 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 314/632] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:51:39 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:39.483703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdede73f-a76c-46b6-b16f-dfc4df0ac154 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] Calling method '.version_select at 0x7fbdbde95a60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:39.527811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8cb5dba3-50d4-4ee8-9a82-8df19690f014 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.333416 Oct 04 17:51:39.555069 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 319/633] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:39 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:39.569570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2fccafd-2c94-4e12-a97a-289031a530ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbe96ae50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-244498583", "description": "tempest-description-1792505408"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:39.686836 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdede73f-a76c-46b6-b16f-dfc4df0ac154 tempest-QuotasAdminTestV257-766049472 tempest-QuotasAdminTestV257-766049472-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18?user_id=2eb956cde343485ebb01267463f5174c" status: 200 len: 190 microversion: 2.57 time: 0.208732 Oct 04 17:51:39.687383 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 315/634] 10.222.0.42 () {60 vars in 1364 bytes} [Tue Oct 4 17:51:39 2022] GET /compute/v2.1/os-quota-sets/d7d91233243f442eb63d37c7dbc01e18?user_id=2eb956cde343485ebb01267463f5174c => generated 190 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:51:40.164573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.165818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.184178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:40.187773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.189648 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2fccafd-2c94-4e12-a97a-289031a530ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.629308 Oct 04 17:51:40.190803 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 320/635] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:51:39 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:40.191420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.194483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.196796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.200787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.202407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.233001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.237189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.283271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:40.295037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.297103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.299426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.306795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.307686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.311225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:40.312687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.504335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:40.522002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34304f0b-b653-489c-9b96-fcc0a6f78a11 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 200 len: 1298 microversion: 2.1 time: 0.302367 Oct 04 17:51:40.548753 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 321/636] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 1298 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:40.580229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a60a514-a031-4d09-a041-e73b1752db71", "name": "network-vif-deleted", "tag": "0ecf06b7-4ab2-489e-a83b-0db3120d4394"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:40.622139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.628852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.630705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.665698 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] Creating event network-vif-deleted:0ecf06b7-4ab2-489e-a83b-0db3120d4394 for instance 2a60a514-a031-4d09-a041-e73b1752db71 on n-h2-831194-21 Oct 04 17:51:40.681810 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-427b4c62-215c-4b00-a0f6-7cc413de4227 req-561a0731-885b-47b1-a35e-03376f753ead service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126913 Oct 04 17:51:40.687430 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 322/637] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:40.709619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:40.710798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:40.722837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.728005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.728730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.730702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:40.732864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:40.733471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:40.921417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:40.936540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:40.937351 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90dc1356-d288-4867-af4f-26086dedd044 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.778736 Oct 04 17:51:40.938415 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 316/638] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:40.945975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1697906949", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "fb899fe7-c3be-494d-8133-7d155961408c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:40.999691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6503944-5c86-426c-b25d-dc210ee0179d tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.310248 Oct 04 17:51:41.020239 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 323/639] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:40 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:41.070438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] validate_networks() for [('fb899fe7-c3be-494d-8133-7d155961408c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:41.548922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:41.549548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 2a60a514-a031-4d09-a041-e73b1752db71] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:41.561169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.562016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.564654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.566015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.568711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.570102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.612716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] HTTP exception thrown: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Request method failure captured: Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 HTTP/1.1 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJFGrUUKeGHrkONICveWY5ofixRx9bpD9TfYuWwhrUuhiS-_vykJ-bgFR8qWrTSC5s1z31ssSkfUMcYMoqyHZem79bHieTGRumtdQVr0fkSDjSKL-QuzfUKWC8LwNI9kLdgz2jsvJyfoQZIcJzp0Z2p2hhL8RB5U6Y3S77gM1JAToE Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:41.618480 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e2e949182104c65a654c04496273e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e2e949182104c65a654c04496273e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2bb5f950cb1544818f9329360b84865a Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. Oct 04 17:51:41.620092 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2a60a514-a031-4d09-a041-e73b1752db71'} Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:41.620812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. Oct 04 17:51:41.622414 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:41.623545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Returning 404 to user: Instance 2a60a514-a031-4d09-a041-e73b1752db71 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:41.623545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bee54aba-9ec6-4b75-bf31-3c5f309af081 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71" status: 404 len: 111 microversion: 2.1 time: 0.076853 Oct 04 17:51:41.626620 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 324/640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:41 2022] GET /compute/v2.1/servers/2a60a514-a031-4d09-a041-e73b1752db71 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:41.646170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:41.647360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:41.667573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.668861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.670734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.672059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.674101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.675850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.733796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:41.918533 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a363fb8-3290-4596-ab41-208a048fdd8f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 204 len: 0 microversion: 2.1 time: 0.285735 Oct 04 17:51:41.918533 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 325/641] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:41 2022] DELETE /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:41.933377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:41.934172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:41.948020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.950554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.951024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.953323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:41.953813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:41.955947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:41.978206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:41.979654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:41.980254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:41.980766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:41.981280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:42.002674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.003757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.006786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.007785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.008362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.010186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.058027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Getting quotas for project 20921fbfd4ce4723aa15435828360aca. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:42.070175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Getting quotas for user 6f5a31af56a3498599ccfcb0858f0e82 and project 20921fbfd4ce4723aa15435828360aca. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:42.108325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:42.117570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:42.245725 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ae3c085-58a4-4253-929f-f17b0f4dad93 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306345 Oct 04 17:51:42.253009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 317/642] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:42.259184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.260056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:42.267601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.268360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.270714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.271628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.272803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.274351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.339746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.358533 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94d36196-11ac-4e16-a6a0-8932701fb44d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1467 microversion: 2.1 time: 0.435374 Oct 04 17:51:42.359136 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 326/643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:41 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1467 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.371295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.371927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:42.392110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.392893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.393348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.394186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:42.394646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:42.395082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:42.398863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:42.863106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:42.908619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:42.926255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d74d4608-7a11-42b3-80de-d35217f4c8c4 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 0.664627 Oct 04 17:51:42.927273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 318/644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:42.932974 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ddfd87d-b482-41e9-b17b-d92d215f3e81 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1929 microversion: 2.75 time: 0.572734 Oct 04 17:51:42.933581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 327/645] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1929 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:42.937523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c66b1bf5-cadc-48e2-b0b3-e11788b7e11b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:42.940018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c66b1bf5-cadc-48e2-b0b3-e11788b7e11b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.112441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c66b1bf5-cadc-48e2-b0b3-e11788b7e11b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:43.121749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c66b1bf5-cadc-48e2-b0b3-e11788b7e11b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1216 microversion: 2.1 time: 0.193160 Oct 04 17:51:43.142313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 319/646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:42 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:43.386806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.387641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.405748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.406763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.407371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.408455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.411017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.411687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.953818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:43.954513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:43.965393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.966088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.969314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:43.970249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:43.970876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:43.971466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.190170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:44.202140 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e046a229-a73f-40ab-980a-d9642831bc3a tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1467 microversion: 2.1 time: 0.820784 Oct 04 17:51:44.203572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 328/647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1467 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:44.208543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.209375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.227323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.228066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.231258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.233514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.234118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.236305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.557409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:44.600035 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45d002ee-da42-4363-8066-f98dffd1d1b5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1935 microversion: 2.75 time: 0.395119 Oct 04 17:51:44.600676 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 329/648] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1935 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:44.610931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:44.619338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:44.631452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.634725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.635396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:44.638817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:44.644122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:44.644943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.026009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.034833 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0e5760b2-103b-4c7a-8402-19971c2e665a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 1.085274 Oct 04 17:51:45.039405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 320/649] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:43 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.131492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.142043 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3df0e4d-ef8a-4210-b0e7-3e98722c613c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1286 microversion: 2.1 time: 0.536587 Oct 04 17:51:45.147598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 330/650] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:44 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1286 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.226766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.227680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.241550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.243120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.245065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.246332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.252368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.255750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.268114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2682f88-57cf-4848-9184-0744ffef6858", "name": "network-vif-plugged", "status": "completed", "tag": "baab076e-c9cc-45b3-ae09-ef361e984cd3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:45.292720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.293604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.294269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.325223 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] Creating event network-vif-plugged:baab076e-c9cc-45b3-ae09-ef361e984cd3 for instance a2682f88-57cf-4848-9184-0744ffef6858 on n-h1-831194-21 Oct 04 17:51:45.338460 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-85d60af2-f027-4999-ab7f-ecccc9120e3c req-efb51de0-66c6-4852-8119-4ae4f564990b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073788 Oct 04 17:51:45.339781 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 331/651] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:51:45.423627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:45.450064 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d165442-c362-4e3e-acd1-c020880ec374 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1425 microversion: 2.1 time: 0.227667 Oct 04 17:51:45.473467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 321/652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1425 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:45.639476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:45.641435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:45.654941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.655865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.656560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:45.657506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:45.658262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:45.658919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.067784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.069885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.092537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:46.096252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.099255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.103519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.106764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.108430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.110620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.147683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-451b57f7-6983-4372-b4ac-d0866676f8c5 tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1935 microversion: 2.75 time: 0.504893 Oct 04 17:51:46.166764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 332/653] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:45 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1935 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:46.171946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.176172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.188837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.203197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.205339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.206482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.206757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.216114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.530710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:46.541953 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70d40415-8a62-4f77-b220-35a1e7ce8bd5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1274 microversion: 2.1 time: 0.374366 Oct 04 17:51:46.557003 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 333/654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1274 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:46.581398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65a1a47-2136-4ab6-9804-55fbec00b5a3", "name": "network-vif-deleted", "tag": "4722f639-4207-4bf2-86f8-4692d48cbb2e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:46.646382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.649879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.652288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.685270 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] Creating event network-vif-deleted:4722f639-4207-4bf2-86f8-4692d48cbb2e for instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 on n-h2-831194-21 Oct 04 17:51:46.712847 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d758d41d-8136-4dba-bbd8-715450d676c5 req-ffa66da3-8df5-433e-8fac-61553f7bd052 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133116 Oct 04 17:51:46.713804 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 334/655] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:46.757960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:46.759047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:46.790744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.794159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.794807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.795826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.796481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.799315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.868694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:46.869498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:46.871196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:46.871863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lazy-loading 'fault' on Instance uuid e65a1a47-2136-4ab6-9804-55fbec00b5a3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:47.128095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.144155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-736be17d-208f-4858-a5a3-217e0244bfca tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1315 microversion: 2.1 time: 1.079963 Oct 04 17:51:47.149548 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 322/656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:47.185451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.186087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.198749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.200362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.200818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.204073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.205436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.207179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.389668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] Lazy-loading 'services' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:47.446916 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e30c4dbc-51c9-48a6-9064-dc10b4837c4b tempest-ServersAdmin275Test-65734633 tempest-ServersAdmin275Test-65734633-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1920 microversion: 2.75 time: 0.265822 Oct 04 17:51:47.452370 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 323/657] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1920 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:47.463365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:47.497530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.498340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.501222 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c6957c4-a344-4183-95a4-ccb21209882d tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 200 len: 1303 microversion: 2.1 time: 0.780526 Oct 04 17:51:47.501853 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 335/658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:46 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 1303 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:47.513413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.514186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.514772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.515669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.516284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.516853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.572856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:47.589908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:47.605886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:47.641188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.642832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.645562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.650633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:47.654182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:47.657737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:47.871141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c2e83546-522a-4d35-96f0-8a0b286104ac tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "DELETE /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 204 len: 0 microversion: 2.75 time: 0.377496 Oct 04 17:51:47.872333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 324/659] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 17:51:47 2022] DELETE /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:51:48.114152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.131281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.133592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.134145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.134606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.135321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.135766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.136965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.139078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bbd26ec9-ebb6-4f01-9f4f-92c359e3c58b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1274 microversion: 2.1 time: 0.558228 Oct 04 17:51:48.139668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 336/660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1274 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.145349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.146255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.155230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.155950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.156551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.157460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.159012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.159619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.183013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f69bcfb5-4023-4162-83e4-b40e86b3e5d0 tempest-AZV2TestJSON-850114424 tempest-AZV2TestJSON-850114424-project] 10.222.0.42 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.309303 Oct 04 17:51:48.183872 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 325/661] 10.222.0.42 () {58 vars in 1164 bytes} [Tue Oct 4 17:51:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:51:48.189503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.190575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.209176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.209988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.210704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.211951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.215410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.216095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.354396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.374342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.375846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.391278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94b5bca9-4517-4534-95d5-8969fce1c887 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1443 microversion: 2.75 time: 0.250244 Oct 04 17:51:48.421620 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 337/662] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1443 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:48.531230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.531867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: e65a1a47-2136-4ab6-9804-55fbec00b5a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.543827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.544357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.544808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.548313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.548973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.549604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.560866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:48.574189 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4709f9bf-fb85-4951-9af5-9b55673a6ed0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1503 microversion: 2.1 time: 0.387236 Oct 04 17:51:48.577337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 326/663] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1503 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:48.600927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.603044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.609936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.610791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.611501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.612522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.612641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] HTTP exception thrown: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. Oct 04 17:51:48.613711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.614424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Request method failure captured: Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 HTTP/1.1 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJFGrUUKeGHrkONICveWY5ofixRx9bpD9TfYuWwhrUuhiS-_vykJ-bgFR8qWrTSC5s1z31ssSkfUMcYMoqyHZem79bHieTGRumtdQVr0fkSDjSKL-QuzfUKWC8LwNI9kLdgz2jsvJyfoQZIcJzp0Z2p2hhL8RB5U6Y3S77gM1JAToE Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:48.617660 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e2e949182104c65a654c04496273e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e2e949182104c65a654c04496273e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2bb5f950cb1544818f9329360b84865a Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. Oct 04 17:51:48.619147 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e65a1a47-2136-4ab6-9804-55fbec00b5a3'} Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:48.619903 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. Oct 04 17:51:48.621618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:48.622718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Returning 404 to user: Instance e65a1a47-2136-4ab6-9804-55fbec00b5a3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:48.624955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7be7b762-9ab6-4004-9341-067ba1e3272f tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3" status: 404 len: 111 microversion: 2.1 time: 0.095968 Oct 04 17:51:48.625954 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 338/664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/e65a1a47-2136-4ab6-9804-55fbec00b5a3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:48.635754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.636264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.652742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.653640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.654545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.655507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.657746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.661371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.681061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:48.733707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:48.860042 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a0a102c-cfc0-442a-8716-76463beecec0 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 204 len: 0 microversion: 2.1 time: 0.262766 Oct 04 17:51:48.867806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 327/665] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:48 2022] DELETE /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:48.878390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.879305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.934891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d9d1e4f8-bb0d-4b5b-a2a1-7690cd9db1a3 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "DELETE /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 204 len: 0 microversion: 2.1 time: 0.302178 Oct 04 17:51:48.943424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 339/666] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:48 2022] DELETE /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:51:48.950735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.952460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.953015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.956804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.958771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:48.960069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.960200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.962015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:48.981541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.982721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.983329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:48.987006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:48.987513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:48.988209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.267068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.283593 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e84d5311-0e75-493e-b09d-64bc8510f179 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1509 microversion: 2.1 time: 0.411403 Oct 04 17:51:49.287632 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 328/667] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1509 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.294306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.297713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:49.306382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.307249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.307916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.309524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.310270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.316500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.391486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.406551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-38284fa0-33dd-4113-8b23-bb807a8ae50c tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1470 microversion: 2.1 time: 0.454820 Oct 04 17:51:49.407320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 340/668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:48 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1470 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.425563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:49.426231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:49.444440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.450127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.450127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.450573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:49.450782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:49.451220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:49.635465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.644335 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82276378-f7ee-4adb-a451-c4a25f9142ae tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.355400 Oct 04 17:51:49.644924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 329/669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:49.702998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.713191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.719893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:49.733028 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb1534b5-c076-448b-8aff-ea5e76b75911 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1443 microversion: 2.75 time: 0.312135 Oct 04 17:51:49.733624 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 341/670] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:49 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1443 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:51:50.309324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.310564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.322000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.322775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.323394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.326658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.327345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.327959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.433232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.434140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.448232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.450733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.451434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.453083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.455441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.456065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.739745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:50.750471 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b025cc5-80eb-47ff-b5be-4fa05a33582d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1509 microversion: 2.1 time: 0.445024 Oct 04 17:51:50.751066 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 330/671] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:50.764754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:50.766296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:50.787453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.788583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.790105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.791607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:50.792468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:50.793935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:50.823261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:51.259205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.291250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f826c50-7eca-4160-b3dd-8c5b06677154 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.532188 Oct 04 17:51:51.295946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 331/672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:51.309817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:51.310499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:51.329288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.329788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.330257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.330976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.331434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.342648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.403963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.405159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.405788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.409508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lazy-loading 'fault' on Instance uuid 46ffc09d-70ac-485e-9ef0-4e967313f2f3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:51.476911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.495571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.504758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd4f4074aed4d4417a26570763f08632d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b456357702463285e32b96eb859f1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:51.515141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c78ba227-168e-4c69-8720-3caf1c419660 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 200 len: 1448 microversion: 2.75 time: 0.218082 Oct 04 17:51:51.515768 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 332/673] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 1448 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:51:51.780860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:51.781843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:51.792987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.795124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.798882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:51.802688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:51.805805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:51.808468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.011949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.025474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63529127-a40a-4127-9e08-e8b5ced89c26 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1467 microversion: 2.1 time: 0.248813 Oct 04 17:51:52.042931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 333/674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:51 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1467 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:51:52.186980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2682f88-57cf-4848-9184-0744ffef6858", "name": "network-vif-deleted", "tag": "baab076e-c9cc-45b3-ae09-ef361e984cd3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:52.247627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.248399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.253196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.301376 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] Creating event network-vif-deleted:baab076e-c9cc-45b3-ae09-ef361e984cd3 for instance a2682f88-57cf-4848-9184-0744ffef6858 on n-h1-831194-21 Oct 04 17:51:52.324340 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f6753ffc-e701-43f3-8aee-f99ec7421824 req-1ddefd16-8265-4eca-820f-de64dde382c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148410 Oct 04 17:51:52.328387 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 334/675] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:52.357630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.360118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.395117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.399306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.412356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.418918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.422199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.425005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.508039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:52.514391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:52.524354 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef0384e2-f46d-4649-b966-857cbb0c2968 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1470 microversion: 2.1 time: 2.095733 Oct 04 17:51:52.541367 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 342/676] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:50 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1470 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:52.555390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:52.556086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] [instance: 46ffc09d-70ac-485e-9ef0-4e967313f2f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:52.580326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.580832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.581280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.582038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:52.585142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:52.586466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:52.617411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] HTTP exception thrown: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Request method failure captured: Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 HTTP/1.1 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJpFGpy-am8QOZ3PDWxLqB3oYTEwGe_LqJpr7Izhg_TWWOkkxDfznoMzxdoK9br_wuRePMtYlNigDQXZM2RfBIkdsLKbzbXrU_UoqRQqAIKXYdDw9upOOkQNNxjgByJt2H1dZ16sbuUasiynTrtvEEZXXZyAX0qZh_KOcauqwm4nhI Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.75 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 64b456357702463285e32b96eb859f1a Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdmin275Test-766905890 Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:51:52.620465 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/64b456357702463285e32b96eb859f1a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64b456357702463285e32b96eb859f1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/64b456357702463285e32b96eb859f1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_64b456357702463285e32b96eb859f1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdmin275Test-766905890 Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 64b456357702463285e32b96eb859f1a Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdmin275Test-766905890 Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdmin275Test-766905890-project Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d4f4074aed4d4417a26570763f08632d Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdmin275Test-766905890-project Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. Oct 04 17:51:52.622487 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '46ffc09d-70ac-485e-9ef0-4e967313f2f3'} Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:52.623482 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. Oct 04 17:51:52.625011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:51:52.628936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] Returning 404 to user: Instance 46ffc09d-70ac-485e-9ef0-4e967313f2f3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:52.630830 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a85aa5be-2977-4bfa-b2db-d4c1623f5414 tempest-ServersAdmin275Test-766905890 tempest-ServersAdmin275Test-766905890-project] 10.222.0.42 "GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3" status: 404 len: 111 microversion: 2.75 time: 0.084954 Oct 04 17:51:52.631626 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 343/677] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/46ffc09d-70ac-485e-9ef0-4e967313f2f3 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:51:53.058138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.059465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:53.083418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.083418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.083418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.087236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.087867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.088425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.121550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=34 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:53.224710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.226784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.227482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.229465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lazy-loading 'fault' on Instance uuid a2682f88-57cf-4848-9184-0744ffef6858 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:53.248879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.267459 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7dca59be-62a9-47c9-8776-22d2b3e210ed tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.929554 Oct 04 17:51:53.269307 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 335/678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:52 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:53.373236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c50c159b7dd4d18a1fd8628ada499c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5caff1110548d18e7b19b633a44bfb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.386473 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1935a96b-c98c-4948-99bb-31070da5b0d6 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 200 len: 1305 microversion: 2.1 time: 0.336677 Oct 04 17:51:53.407473 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 344/679] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 1305 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:53.548844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:53.549467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:53.561477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.565160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.565690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.567823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:53.568312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:53.568753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:53.953566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:53.964383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e2951dc-0820-4b76-b460-ea9654f4b1f5 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1470 microversion: 2.1 time: 0.419404 Oct 04 17:51:53.968644 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 336/680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:53 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1470 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:54.298670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.305197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.312624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.313366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.314020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.315273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.315898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.316529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.418556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.419791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.426902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.427895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.428571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.430371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.431300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.432422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.453950 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 HTTP/1.1 Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.456001 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.457317 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a2682f88-57cf-4848-9184-0744ffef6858'} Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.458140 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.459304 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.463219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.464108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a94042a-1e69-424f-9e07-9ab43c06ed73 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 404 len: 111 microversion: 2.1 time: 0.049664 Oct 04 17:51:54.464681 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 337/681] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:54.474064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1351967874", "metadata": {"image_type": "test"}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:54.477024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.491955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.492819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.493436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.494471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.495307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.496151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.551330 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858/action HTTP/1.1 Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 112 Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.559330 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1351967874", "metadata": {"image_type": "test"}}} Oct 04 17:51:54.560693 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a2682f88-57cf-4848-9184-0744ffef6858', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1351967874', 'metadata': {'image_type': 'test'}}}} Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.561509 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.562731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.563922 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.563922 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.563922 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.563922 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.563922 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.565904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.567062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de3b436c-5f00-4c4b-a507-47c7ed0c63dc tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "POST /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858/action" status: 404 len: 111 microversion: 2.1 time: 0.097588 Oct 04 17:51:54.568379 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 338/682] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Oct 4 17:51:54 2022] POST /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858/action => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:54.588615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "445364bc-c274-4d90-b6b7-acd488b398e3", "name": "network-vif-deleted", "tag": "4e40f6c1-2d40-44bb-b448-5239f42980e4"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:54.621182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.621672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.622854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.666215 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] Creating event network-vif-deleted:4e40f6c1-2d40-44bb-b448-5239f42980e4 for instance 445364bc-c274-4d90-b6b7-acd488b398e3 on n-h2-831194-21 Oct 04 17:51:54.681806 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-88a974f5-a1d3-459e-9f34-9141b717e13b req-d9a8a4fd-06f5-4a5f-89ed-e1e4753bf65f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111644 Oct 04 17:51:54.684676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 339/683] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:54.710912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1660729178", "metadata": {"image_type": "test"}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:54.714037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Failed to fetch instance by id tempest-invalid-2108831921 {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 17:51:54.714583 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance tempest-invalid-2108831921 could not be found. Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/tempest-invalid-2108831921/action HTTP/1.1 Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 112 Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.716259 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1660729178", "metadata": {"image_type": "test"}}} Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.717617 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance tempest-invalid-2108831921 could not be found. Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'tempest-invalid-2108831921', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1660729178', 'metadata': {'image_type': 'test'}}}} Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2108831921 could not be found. Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.718499 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2108831921 could not be found. Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2108831921 could not be found. Oct 04 17:51:54.719658 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.720769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance tempest-invalid-2108831921 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.722342 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a677162a-03c4-4c3e-bb71-69214490f973 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "POST /compute/v2.1/servers/tempest-invalid-2108831921/action" status: 404 len: 101 microversion: 2.1 time: 0.032077 Oct 04 17:51:54.726498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 340/684] 10.222.0.42 () {60 vars in 1249 bytes} [Tue Oct 4 17:51:54 2022] POST /compute/v2.1/servers/tempest-invalid-2108831921/action => generated 101 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:54.736166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-117983701"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:54.739422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 17:51:54.748690 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 56 Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.750704 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-test-snap-117983701"}} Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.751987 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-117983701'}}} Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.752756 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.754454 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.757186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.758489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3aac90a-bf30-48dd-88de-58350ee4215a tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.027638 Oct 04 17:51:54.759252 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 341/685] 10.222.0.42 () {60 vars in 1275 bytes} [Tue Oct 4 17:51:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:51:54.791248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-919887772"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:54.794885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 17:51:54.804618 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 56 Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.806487 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-test-snap-919887772"}} Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.808155 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-919887772'}}} Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.808990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 04 17:51:54.810169 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.813928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.815528 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-933a4e3e-6b56-4ce1-814f-0668c33b698f tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.049099 Oct 04 17:51:54.817047 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 342/686] 10.222.0.42 () {60 vars in 1281 bytes} [Tue Oct 4 17:51:54 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:54.831930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.833250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.848840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.850203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.851718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.852887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.857643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.858453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.895563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 HTTP/1.1 Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.899748 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.901508 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a2682f88-57cf-4848-9184-0744ffef6858'} Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.902341 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.903456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.904609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.905266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-41010da8-d98c-4667-9575-be26e418dad3 tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 404 len: 111 microversion: 2.1 time: 0.077425 Oct 04 17:51:54.906373 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 343/687] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:54 2022] DELETE /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:54.919636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:54.920855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] [instance: a2682f88-57cf-4848-9184-0744ffef6858] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:54.936120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.936697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.937140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.939721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:54.940386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:54.941812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:54.976907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] HTTP exception thrown: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Request method failure captured: Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 HTTP/1.1 Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKay4GGPeAFOr0alCeBEUdNlFUMRGlFoByW1WVEC1NSeK4DnU-lTCVpl6Jhwwkj879ldeDrk9oo9e3-Hkah7SmZWq-q9Za_XnUd9fCodJ4ujhmyroStTl4SeMmHbbstaLPO4UW9SaqGI0tGqrpXSnr6HDi1pUL-wO8YHKCNIwOotvQ Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:54.978786 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_6e5caff1110548d18e7b19b633a44bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 6e5caff1110548d18e7b19b633a44bfb Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-260404414 Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7c50c159b7dd4d18a1fd8628ada499c8 Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesNegativeTestJSON-260404414-project Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.980054 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a2682f88-57cf-4848-9184-0744ffef6858'} Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:54.980821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. Oct 04 17:51:54.981960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:54.986101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] Returning 404 to user: Instance a2682f88-57cf-4848-9184-0744ffef6858 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:54.987720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47fbfee7-9a01-41ce-bd8e-d701f72a5f0d tempest-ImagesNegativeTestJSON-260404414 tempest-ImagesNegativeTestJSON-260404414-project] 10.222.0.42 "GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858" status: 404 len: 111 microversion: 2.1 time: 0.077508 Oct 04 17:51:54.995922 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 344/688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/a2682f88-57cf-4848-9184-0744ffef6858 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:55.002423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.003341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.015834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.017210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.017928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.019294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.019960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.020587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.096798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.097506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.098869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.102267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lazy-loading 'fault' on Instance uuid 445364bc-c274-4d90-b6b7-acd488b398e3 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:51:55.333931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.344911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdde2609-1307-46a9-aae6-f33a3d2d2eb1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.055656 Oct 04 17:51:55.360858 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 345/689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.373627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:55.374376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:55.387633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.388689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.389379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.390594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:55.391656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:55.392287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:55.435985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:51:55.571643 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c87ae131-b3a0-42a1-957e-d8d529af860d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 204 len: 0 microversion: 2.1 time: 0.204375 Oct 04 17:51:55.572735 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 346/690] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:51:55 2022] DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:51:55.725086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bb5f950cb1544818f9329360b84865a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2e949182104c65a654c04496273e81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:55.735607 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36586008-67e5-455a-aa2a-cae32b9556de tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 200 len: 1304 microversion: 2.1 time: 0.738210 Oct 04 17:51:55.751207 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 345/691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:54 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 1304 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:55.768757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-481348838", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "192406065", "adminPass": "***", "networks": [{"uuid": "e970d4b6-75da-419f-9fd8-6c71bee20a90"}], "security_groups": [{"name": "tempest-securitygroup--1017908723"}], "key_name": "tempest-keypair-67455838", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:56.373316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:56.374303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:56.390107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.394400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.394977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.406160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:56.409111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:56.409746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:56.813495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] validate_networks() for [('e970d4b6-75da-419f-9fd8-6c71bee20a90', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:51:57.128667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:57.141490 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-543eeaf4-b1af-4b0a-88ae-0fedffca1103 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.772169 Oct 04 17:51:57.146589 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 346/692] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:56 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:57.156733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:57.158171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] [instance: 445364bc-c274-4d90-b6b7-acd488b398e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:57.184225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.185330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.186618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.189160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.190184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.192302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.216003 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] HTTP exception thrown: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Request method failure captured: Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 HTTP/1.1 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJFGrUUKeGHrkONICveWY5ofixRx9bpD9TfYuWwhrUuhiS-_vykJ-bgFR8qWrTSC5s1z31ssSkfUMcYMoqyHZem79bHieTGRumtdQVr0fkSDjSKL-QuzfUKWC8LwNI9kLdgz2jsvJyfoQZIcJzp0Z2p2hhL8RB5U6Y3S77gM1JAToE Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:51:57.219006 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e2e949182104c65a654c04496273e81"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2e949182104c65a654c04496273e81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e2e949182104c65a654c04496273e81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5e2e949182104c65a654c04496273e81 Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminTestJSON-2128917256 Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2bb5f950cb1544818f9329360b84865a Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminTestJSON-2128917256-project Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. Oct 04 17:51:57.220408 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '445364bc-c274-4d90-b6b7-acd488b398e3'} Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:51:57.221141 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. Oct 04 17:51:57.222362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:51:57.224860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] Returning 404 to user: Instance 445364bc-c274-4d90-b6b7-acd488b398e3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:51:57.226144 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d011c796-6faf-4924-b04c-743b24768f57 tempest-ServersAdminTestJSON-2128917256 tempest-ServersAdminTestJSON-2128917256-project] 10.222.0.42 "GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3" status: 404 len: 111 microversion: 2.1 time: 0.076667 Oct 04 17:51:57.227233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 347/693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:57 2022] GET /compute/v2.1/servers/445364bc-c274-4d90-b6b7-acd488b398e3 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:51:57.258069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d811adac-4be7-4ec1-9923-223a9ef1383b", "tag": "6ef46e69-542b-44a8-98a9-5babf4d49774"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:51:57.298768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:57.301986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:57.303492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:57.353022 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] Creating event network-changed:6ef46e69-542b-44a8-98a9-5babf4d49774 for instance d811adac-4be7-4ec1-9923-223a9ef1383b on n-h2-831194-21 Oct 04 17:51:57.363659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5895b4cc-a1c8-4495-9997-47488fc30838 req-acb587d4-47bc-40a6-a1ef-c98c9a2437c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134403 Oct 04 17:51:57.369311 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 348/694] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:51:58.167383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=13 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:58.171922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:58.172644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:58.183399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.183900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.184346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.185158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:58.194494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:58.195563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:58.963977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:51:58.968938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:51:58.969888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:51:58.970528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:51:58.971164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:51:59.005675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.007580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.008139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.008943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:51:59.014488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:51:59.015135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:51:59.059058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:51:59.075698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Getting quotas for user 7cadc40c954a4934833da24a2ce6b293 and project 37ef99d9be464c5ab92974d0abdbebb2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:51:59.107293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:51:59.119124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:51:59.141274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:51:59.251362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d31693f3-40a6-4869-8846-3085be125a13 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.487623 Oct 04 17:51:59.252626 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 347/695] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:51:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 3490 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:51:59.264656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af3df2f5-2f28-4cd7-a3d4-22876edb80fa tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:51:59.265573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af3df2f5-2f28-4cd7-a3d4-22876edb80fa tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:51:59.349691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:59.358683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9fccbf8-eb44-47a9-bb5f-0bb1dfb803f4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.192351 Oct 04 17:51:59.359268 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 349/696] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:58 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:51:59.491691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af3df2f5-2f28-4cd7-a3d4-22876edb80fa tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:51:59.502102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af3df2f5-2f28-4cd7-a3d4-22876edb80fa tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1260 microversion: 2.1 time: 0.241579 Oct 04 17:51:59.519934 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 348/697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:51:59 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:00.384424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.385036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.394833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:00.397688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.398419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.400755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.401653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.410696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.411151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.528544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:00.529267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:00.548197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.548834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.549350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.550173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:00.550845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:00.551438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:00.791384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:00.815425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecb53014-f3f4-4925-b073-acf5347f00f5 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1256 microversion: 2.1 time: 0.292308 Oct 04 17:52:00.816443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 349/698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1256 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.788633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-61eca05e-f5c3-44b1-8944-85550f8711d2 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Action: 'create', calling method: .version_select at 0x7fbdbdd841f0>, body: {"keypair": {"name": "tempest-keypair-507527062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6G7gwH2z1Tm+5XCsXxZH7KFY3inZnILiRg2cOUUJ1MCZM5qsltvMgDZ4AThPfHBBGHmqZFmSrxsQqjoYix04w1spN0Dk+TDkXu/yrbUZ/n1Zbf+XzjST6hQnX1IVZUXg=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:01.800877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:01.815264 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6980cce6-c555-4dfa-a15a-0c6dd096a078 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.434762 Oct 04 17:52:01.816708 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 350/699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:00 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:01.830502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-61eca05e-f5c3-44b1-8944-85550f8711d2 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for project 8131bad014684bb0973ae16c4aad02d5. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:01.842697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:01.843836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:01.852421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.853445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.854146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.855224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:01.855907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:01.856486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:01.870212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-61eca05e-f5c3-44b1-8944-85550f8711d2 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for user deedb2b40cc946c18b21f6859166f286 and project 8131bad014684bb0973ae16c4aad02d5. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:01.945664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-61eca05e-f5c3-44b1-8944-85550f8711d2 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.590142 Oct 04 17:52:01.946348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 350/700] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:52:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:02.461295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:02.478780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-549ca454-94e3-4354-a8ae-6b94d9ad7bc4 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1318 microversion: 2.1 time: 0.639736 Oct 04 17:52:02.493470 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 351/701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:01 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:02.842268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:02.844091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:02.853736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.854732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.855490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:02.856837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:02.857600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:02.858310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.307972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93695d49-46d7-4f96-8944-4f3d2dc0c2f9", "name": "network-vif-deleted", "tag": "b25c3a3c-cacb-4f40-82ad-133b6fa69f7d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:03.363945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.365167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.366109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.404298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] Creating event network-vif-deleted:b25c3a3c-cacb-4f40-82ad-133b6fa69f7d for instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 on n-h1-831194-21 Oct 04 17:52:03.429212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6946bd37-504f-42ca-b7e2-65431d75e8c9 req-29297596-dee3-4991-ac40-53daa938a930 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136067 Oct 04 17:52:03.434049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 352/702] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:03.517222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:03.520531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:03.556776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.557930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.561198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.564654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:03.566709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:03.568241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:03.777584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:03.794908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a994e740-9501-4c21-8509-42c9e1ab7152 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.955985 Oct 04 17:52:03.797083 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 351/703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:02 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:03.947373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:03.956646 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0f188e1-cf86-4d99-beb3-465550078239 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1318 microversion: 2.1 time: 0.447549 Oct 04 17:52:03.970138 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 353/704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:03 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:04.724020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-447546540", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:04.824888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:04.825515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:04.833541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:04.843179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:04.843646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:04.844373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:04.844887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:04.858167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:04.881080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:05.380410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:05.381859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:05.382888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:05.383469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:05.384073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:05.404090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.406544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.407171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.409432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.410169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.412975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.470622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:05.485649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:05.523071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:05.533317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:05.673129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9429d8e-5c2d-4f80-97c7-0fad5d0c73c9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.449820 Oct 04 17:52:05.674688 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 352/705] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:05.687246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:05.691619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:05.711153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.711883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.715366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:05.715366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:05.715685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:05.716206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:06.406394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:06.421747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3133a6d6-4fff-4d96-b083-20ebc925a337 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.604950 Oct 04 17:52:06.424030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 354/706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:04 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:06.444743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c197a41c-2e15-4cf5-ba20-0c936cbeb51f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:06.447820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c197a41c-2e15-4cf5-ba20-0c936cbeb51f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:06.773603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c197a41c-2e15-4cf5-ba20-0c936cbeb51f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:06.788595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c197a41c-2e15-4cf5-ba20-0c936cbeb51f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1216 microversion: 2.1 time: 0.357256 Oct 04 17:52:06.789537 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 355/707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:06 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1216 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:07.166930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:07.180302 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-026cd147-8498-4718-b14b-1ce0112f1c81 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 1.503104 Oct 04 17:52:07.181124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 353/708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:05 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:07.452289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:07.453619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:07.466773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.469626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.470150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.473549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:07.475531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:07.476271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:07.530436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-174981119", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:07.651254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:09.087193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:09.096415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3b3cf36-0e06-4e03-a9a2-1796a7d0f51c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.649217 Oct 04 17:52:09.101350 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 354/709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:07 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:09.115930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.117356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.127074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.128027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.128693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.129703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.137678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.139609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.492182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:09.513183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e23a8bae-cb91-4b59-bfaf-42ea8773a2d4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1274 microversion: 2.1 time: 0.410240 Oct 04 17:52:09.513778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 355/710] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1274 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:09.525684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:09.528488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:09.542426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.542994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.551492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.552279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.552754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.554187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.780207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:09.781424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:09.782091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:09.782681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:09.783232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:09.810961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.818067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.821609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.823877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:09.824742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:09.826099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:09.891644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Getting quotas for project 93c4549aa06d44e5bc01ea13ce0af167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:09.909750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Getting quotas for user 3812f9a68f4641e19528d06742b362ae and project 93c4549aa06d44e5bc01ea13ce0af167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:09.935421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:09.938222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:10.044931 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-431823ac-d5f2-4e34-b07f-f147ddabd032 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.812270 Oct 04 17:52:10.046214 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 356/711] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:52:10.218843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ac0b494-2195-42ec-964c-44c72299be31 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Action: 'create', calling method: .version_select at 0x7fbdbde6aaf0>, body: {"keypair": {"name": "tempest-keypair-663678651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBINTwMruzf9EVa8vjPdZdjhAh2jinDbQO0gPBiYBiVNC/koLI1coHABR3ms1oWnP+lYCKMAvVuM0jcsml/zUUUpecPUZyy0+v/f4tG01a610vLSfFywXHV9FNvW8K7YIxw=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:10.265534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6ac0b494-2195-42ec-964c-44c72299be31 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for project 380038639de34db8ae85b4aeda7d02dc. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:10.276831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6ac0b494-2195-42ec-964c-44c72299be31 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for user 50c74962551945478e624d84fbe50d3a and project 380038639de34db8ae85b4aeda7d02dc. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:10.355386 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ac0b494-2195-42ec-964c-44c72299be31 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.307913 Oct 04 17:52:10.356337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 357/712] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:52:10 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:10.367037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ce0fff0-3d54-4c70-afb6-3dff08a2699d tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.371563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ce0fff0-3d54-4c70-afb6-3dff08a2699d tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:10.600659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:10.613088 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d61ca6a7-ee65-40e9-997b-522b764ea0d0 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 1.091542 Oct 04 17:52:10.633815 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 356/713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:09 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:10.643530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.644398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:10.652531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ce0fff0-3d54-4c70-afb6-3dff08a2699d tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:10.658439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.659181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.660488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.666058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.667019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.667626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.676633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ce0fff0-3d54-4c70-afb6-3dff08a2699d tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1221 microversion: 2.1 time: 0.319054 Oct 04 17:52:10.681481 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 358/714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1221 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:10.692116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:10.716920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:10.739240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.740172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.745045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:10.748901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:10.749650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:10.751454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.322928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:11.330745 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e363a514-33d5-4ad4-a2f4-51ecbf6b9642 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1274 microversion: 2.1 time: 0.646747 Oct 04 17:52:11.338575 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 359/715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1274 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:11.354527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0189e380-0cf1-48ac-a3f0-d85257bff8e8", "tag": "f7996638-fe7d-4a93-bbb6-4079da1c05ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:11.384602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.385428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.386122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.426977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:11.431991 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] Creating event network-changed:f7996638-fe7d-4a93-bbb6-4079da1c05ac for instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 on n-h1-831194-21 Oct 04 17:52:11.448585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-95716afc-e202-44fa-b80c-5938017c6343 req-996bf6b6-438d-4726-80cc-ef3ddb4d8b5c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108279 Oct 04 17:52:11.452091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 360/716] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:11.634364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d811adac-4be7-4ec1-9923-223a9ef1383b", "name": "network-vif-plugged", "status": "completed", "tag": "6ef46e69-542b-44a8-98a9-5babf4d49774"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:11.657040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.657040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.657040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.695983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] Creating event network-vif-plugged:6ef46e69-542b-44a8-98a9-5babf4d49774 for instance d811adac-4be7-4ec1-9923-223a9ef1383b on n-h2-831194-21 Oct 04 17:52:11.709720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a14159cd-bbc7-4dc9-8bf8-c49092c673d4 req-e365c48e-ffdd-4bf8-80fe-d9d5ce035f9f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077199 Oct 04 17:52:11.713867 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 361/717] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:11.728553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.730293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:11.743780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.744282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.744726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.751377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.752119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.754030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.887576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:11.905351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b45efb8-b55a-4ba4-9702-7d47f426c7d5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 1.268392 Oct 04 17:52:11.906434 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 357/718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:10 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:11.933646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:11.934604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:11.949477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.950376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.951042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:11.951974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:11.953077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:11.953499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.259325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:12.274859 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e96faa78-a103-4413-9146-a392a653ed6c tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1273 microversion: 2.1 time: 0.363950 Oct 04 17:52:12.277754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 358/719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1273 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:12.364392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:12.365347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:12.380206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.383664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.386993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.392375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.394507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.395128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.485555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:12.495203 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58efb205-e932-4c84-80b4-db94a5804fa7 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 0.777100 Oct 04 17:52:12.500685 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 362/720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:11 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:12.932978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:12.933600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:12.947862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.948694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.949166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:12.949957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:12.950422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:12.950852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.334897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:13.362006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ccc37f82-cebc-404a-bff2-8b8569321147 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1316 microversion: 2.1 time: 0.429285 Oct 04 17:52:13.364884 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 363/721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:12 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:13.370975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.378647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:13.396122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.397228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.398872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.402633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.403315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.404480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.733923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:13.749619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a394e822-cb20-4248-98eb-408b1657d791 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1279 microversion: 2.1 time: 0.382547 Oct 04 17:52:13.751082 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 364/722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1279 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.755345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:13.765415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-896c6c6b-9b16-4dea-a862-a319d744460e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 1.404867 Oct 04 17:52:13.781855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 359/723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:12 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:13.787158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:13.788352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-772708300", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "9468212d-5a59-4dfa-b7c2-970aea85b0ac"}], "security_groups": [{"name": "tempest-securitygroup--605183509"}], "key_name": "tempest-keypair-507527062", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:13.806794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:13.813141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.813902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.814503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:13.815370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:13.815977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:13.816590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.401732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] validate_networks() for [('9468212d-5a59-4dfa-b7c2-970aea85b0ac', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:14.454325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:14.473527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1cd0ce17-f61d-4a98-a483-5192a065abfc tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 0.701613 Oct 04 17:52:14.474348 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 365/724] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:13 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:14.489890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:14.491563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:14.501688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.502437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.503105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:14.506846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:14.507750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:14.509818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.444880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:15.509175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:15.601580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:15.619795 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3716702e-00c0-433d-a8bf-6767baec4536 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1505 microversion: 2.1 time: 1.144227 Oct 04 17:52:15.622047 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 366/725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:14 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1505 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:15.633850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:15.634628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:15.647461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.648113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.648777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.649594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.650146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.650640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.809783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:15.814888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:15.815624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:15.816141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:15.816663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:15.834060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.835009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.835603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.837635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:15.841202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:15.841915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:15.895071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for project 8131bad014684bb0973ae16c4aad02d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:15.909118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for user deedb2b40cc946c18b21f6859166f286 and project 8131bad014684bb0973ae16c4aad02d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:15.950255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:15.953722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:16.108636 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d59be830-3c25-4441-becf-03fcdfc77830 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.335304 Oct 04 17:52:16.109634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 360/726] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 2337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:16.116449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.117417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:16.128085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.134817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.135709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.136784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.140166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.142562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.709534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:16.730193 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1051596-fe09-46d6-b279-155ecf5e4557 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1321 microversion: 2.1 time: 1.103933 Oct 04 17:52:16.732944 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 367/727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:15 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1321 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:16.756765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:16.762117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:16.804737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:16.815324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acc45bf4-3035-4a82-a126-c9bf7f46a1d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.704350 Oct 04 17:52:16.815895 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 361/728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:16.830045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.830045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.830045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.830045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.833447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.838789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.868223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e11f48b-fbc6-4dad-a052-8de1fb5361d5", "tag": "4786d7fc-35b2-4b7a-acde-5b4e1a90a129"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:16.896178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:16.896893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:16.899453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:16.939922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:16.947784 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] Creating event network-changed:4786d7fc-35b2-4b7a-acde-5b4e1a90a129 for instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 on n-h1-831194-21 Oct 04 17:52:16.955565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5e97b223-8274-4e78-b8c8-d60290d56eeb req-4ba52582-e3b9-4d73-b2db-edad03c4cf1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095004 Oct 04 17:52:16.960030 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 362/729] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:16.979831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-777288863"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:16.981422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:17.001674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.002406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.003005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.006326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:17.009820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:17.010639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:17.512811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Adding security group 46450b6a-027b-4d5b-a13e-e0e728afb96d to port 6ef46e69-542b-44a8-98a9-5babf4d49774 Oct 04 17:52:17.989682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:18.010375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-393be10a-8a7c-45bf-98fb-4a3acf3c5917 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 1.274945 Oct 04 17:52:18.011442 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 368/730] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:16 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:18.336735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70529f30-c85b-43b9-85f1-2f0e53dc88fb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/action" status: 202 len: 0 microversion: 2.1 time: 1.371744 Oct 04 17:52:18.337508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 363/731] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:16 2022] POST /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/action => generated 0 bytes in 1373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:18.347450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:18.350519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:18.364064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.366418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.369057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.371027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.374055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.375427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.422582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2037343102", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ddc88b3c-c71e-4266-969e-2a17e558023b"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:18.569231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] validate_networks() for [('ddc88b3c-c71e-4266-969e-2a17e558023b', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:18.618184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:18.651523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e758de4-16d1-4d22-b29a-b3987167945c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1300 microversion: 2.1 time: 0.308825 Oct 04 17:52:18.657315 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 364/732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:18 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1300 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:18.690207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:18.696300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:18.735325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.735325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.735807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.737545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:18.742168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:18.742671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:18.994972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:19.007095 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36fe0ab8-50ba-4584-8098-7abff3fc5b01 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1321 microversion: 2.1 time: 0.345558 Oct 04 17:52:19.007687 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 365/733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:18 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1321 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:19.148595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-572525329", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:19.228639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:19.398988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:19.399505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:19.400798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:19.401289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:19.401722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:19.430124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.431231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.432338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.433470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.434926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.435696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.464454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:19.472555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for user ea6b89bd15d0468a920310645029d5d1 and project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:19.488326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:19.491159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:19.544615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90acd94f-d7d7-4f7e-8ec7-5955e4d93fcc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.531845 Oct 04 17:52:19.545741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:19.546447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:19.546930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:19.547421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:19.548052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:19.552504 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 369/734] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:19.557017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:19.557639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:19.564662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.565956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.567568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.568491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.569117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.569560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.570598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.571517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.572147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.582794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.583399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.584494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.609205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Getting quotas for project 482b3b1453764194bd840513ceba251f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:19.618410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Getting quotas for user 586c9ab1fba442168f995cfb2782c587 and project 482b3b1453764194bd840513ceba251f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:19.634623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:19.637341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:19.711428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-900edd4e-fa76-4a7c-b2c4-101a5fe818c9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702363 Oct 04 17:52:19.712608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 366/735] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:19.722672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2b33283-f592-4806-8920-dc88c4fb66fc", "tag": "12e109f5-4cee-4be6-8615-054870e6a388"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:19.748213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.750561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.751782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.772909 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] Creating event network-changed:12e109f5-4cee-4be6-8615-054870e6a388 for instance c2b33283-f592-4806-8920-dc88c4fb66fc on n-h2-831194-21 Oct 04 17:52:19.778746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-52115d45-e113-4ab5-90c9-79f14f5a16fe req-47f96ec5-b11c-4b0f-83df-41e908a66d7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064553 Oct 04 17:52:19.780013 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 367/736] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:19.785989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-244498583"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:19.787496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:19.791813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=87 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:19.798586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.799078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.799516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.800372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:19.800856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:19.801310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:19.984518 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Adding security group 0278f449-4052-4c11-ad32-58cf7fdb005c to port 6ef46e69-542b-44a8-98a9-5babf4d49774 Oct 04 17:52:20.097370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:20.110405 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a94b39a-565a-4a86-b385-dea3a4d7dd13 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.552784 Oct 04 17:52:20.129858 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 370/737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:19 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:20.129858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:20.129858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:20.142261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.142764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.143209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.143929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:20.144589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:20.145020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:20.714722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:20.735759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5d83a87-7496-46b5-885b-c77dbf41e10d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 0.614713 Oct 04 17:52:20.736666 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 371/738] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:20 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:20.756571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-18617010", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "eaffa6a4-d009-4181-996c-274b3e749fde"}], "security_groups": [{"name": "tempest-securitygroup--1360109046"}], "key_name": "tempest-keypair-663678651", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:21.064460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] validate_networks() for [('eaffa6a4-d009-4181-996c-274b3e749fde', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:21.328882 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c93fbf1-10b5-489a-8dd6-3332da9f56eb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/action" status: 202 len: 0 microversion: 2.1 time: 1.547494 Oct 04 17:52:21.330304 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 368/739] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:19 2022] POST /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/action => generated 0 bytes in 1550 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:21.338120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.338855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.346385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.348357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.349137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.350828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.351520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.352343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.429811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:21.439777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef27ef06-e240-41f4-b16a-34c629a2742b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1263 microversion: 2.1 time: 0.108088 Oct 04 17:52:21.449857 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 369/740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1263 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:21.449857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.449857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.458221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.459917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.460513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.461405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.462027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.462751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.606010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:21.620853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d513fe6-e9da-4b53-bd14-b4151fc01d02 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1298 microversion: 2.1 time: 0.177947 Oct 04 17:52:21.621714 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 370/741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:21.633619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.636459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.656187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.656688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.657119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.662740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.663530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.664128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.886465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:21.924640 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12569770-ad39-47cd-a6f9-aae961375b14 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1268 microversion: 2.1 time: 0.299945 Oct 04 17:52:21.926809 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 371/742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1268 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:21.943474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:21.944125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:21.978463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for project 380038639de34db8ae85b4aeda7d02dc. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:21.980121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:21.985921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:21.990538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:21.999253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.001550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.002035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.015806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for user 50c74962551945478e624d84fbe50d3a and project 380038639de34db8ae85b4aeda7d02dc. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:22.075688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:22.078578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:22.079108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:22.088127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:22.088532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:22.112994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.118490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.118978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.119765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.123630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.124103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.143524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:22.152563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for project 380038639de34db8ae85b4aeda7d02dc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:22.159553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Getting quotas for user 50c74962551945478e624d84fbe50d3a and project 380038639de34db8ae85b4aeda7d02dc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:22.180600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:22.186734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:22.284168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d199b9a6-6e81-4b67-a301-925bb8ff2a8e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.545203 Oct 04 17:52:22.285564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 372/743] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:20 2022] POST /compute/v2.1/servers => generated 409 bytes in 1548 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:22.292564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0189e380-0cf1-48ac-a3f0-d85257bff8e8", "name": "network-vif-plugged", "status": "completed", "tag": "f7996638-fe7d-4a93-bbb6-4079da1c05ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:22.320946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.321723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.322350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.352328 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] Creating event network-vif-plugged:f7996638-fe7d-4a93-bbb6-4079da1c05ac for instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 on n-h1-831194-21 Oct 04 17:52:22.362985 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-200e34fd-e7f5-4711-ab39-0bab6b2edfa6 req-72e7d1b9-3fdc-4eba-a405-c45c853914c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075871 Oct 04 17:52:22.367293 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 373/744] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:22.384762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:22.387210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:22.419582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.420263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.423007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.424469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.427462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.429452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.543099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:22.562074 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dbb7e3af-0c4a-4ea8-96b2-0a5336067226 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1321 microversion: 2.1 time: 0.632910 Oct 04 17:52:22.562671 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 372/745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:21 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:22.598875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:22.599630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:22.613265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.614153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.616176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.618010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:22.618690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:22.619376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:22.987283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.002083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a8dbadd-25a5-48c0-b838-b1724e663e9a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.630708 Oct 04 17:52:23.020086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 374/746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:22 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.044685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.051276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.077409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.078058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.078585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.079957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.080426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.080850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.271266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c690ca6c-a95a-4315-af8d-64788ed19e6c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.693863 Oct 04 17:52:23.284814 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 373/747] 10.222.0.42 () {58 vars in 1293 bytes} [Tue Oct 4 17:52:22 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b/os-security-groups => generated 1155 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.297762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d811adac-4be7-4ec1-9923-223a9ef1383b", "tag": "6ef46e69-542b-44a8-98a9-5babf4d49774"}, {"name": "network-changed", "server_uuid": "d811adac-4be7-4ec1-9923-223a9ef1383b", "tag": "6ef46e69-542b-44a8-98a9-5babf4d49774"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:23.312040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.313176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.314485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.338204 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Creating event network-changed:6ef46e69-542b-44a8-98a9-5babf4d49774 for instance d811adac-4be7-4ec1-9923-223a9ef1383b on n-h2-831194-21 Oct 04 17:52:23.339003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] Creating event network-changed:6ef46e69-542b-44a8-98a9-5babf4d49774 for instance d811adac-4be7-4ec1-9923-223a9ef1383b on n-h2-831194-21 Oct 04 17:52:23.341860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.344923 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-560f9ab5-4787-40fd-b0b0-81433f03c563 req-5ae2c4dd-71df-4be4-b1e9-11dba0a9b99f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058567 Oct 04 17:52:23.346084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 374/748] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:23.351162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-516477bf-05df-4e5d-aa23-d6895c19fb29 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1386 microversion: 2.1 time: 0.329057 Oct 04 17:52:23.351741 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 375/749] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1386 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.367861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.368967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.370730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.371352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.377241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.378362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.379016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.379894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.381046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.381630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.387616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.388116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.388553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.389263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.389710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.390161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.503345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.514351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb950b2e-17a0-434b-8b1f-c740dc4f88f5 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1279 microversion: 2.1 time: 0.165699 Oct 04 17:52:23.515199 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 375/750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1279 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.521409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.523359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.531380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.532130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.532746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.533855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.534607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.535434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.559078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.569841 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef7bb24a-17da-43e7-95f0-65a25da907f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1269 microversion: 2.1 time: 0.216908 Oct 04 17:52:23.583323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 376/751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1269 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.590454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:23.591168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:23.597537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.598077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.598691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.599842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:23.600609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:23.601354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:23.907269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:23.929559 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d505ab2-69e2-4e59-949d-d42fdca13b36 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.412975 Oct 04 17:52:23.931247 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 376/752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:23.945867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b219e5d-3fb6-42d9-9e23-014624c83c8d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdd84e50>, body: {"security_group": {"name": " tempest-securitygroup -1879934636 ", "description": "tempest-description-498675034"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:24.133285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:24.144838 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e634f37-00da-4378-8491-757cd1cc4d98 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1274 microversion: 2.1 time: 0.560947 Oct 04 17:52:24.147241 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 377/753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:23 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1274 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.164159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.166640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:24.193512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.194729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.195180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.198648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.199495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.199842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.566198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:24.585262 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfdb5e7e-30fc-4124-81fe-2448b760a51f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1321 microversion: 2.1 time: 0.431205 Oct 04 17:52:24.586752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 378/754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:24 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:24.596749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:24.600353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:24.614728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.616603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.618089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:24.619402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:24.620366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:24.621150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.183222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.198002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b298a32-d26a-43db-8c4b-9cdcde0af403 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.609717 Oct 04 17:52:25.199032 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 379/755] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:24 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:25.205659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.206636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.216910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.217406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.218079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.218964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.219573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.220035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.225043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:25.227634 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b219e5d-3fb6-42d9-9e23-014624c83c8d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.294969 Oct 04 17:52:25.229158 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 377/756] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:23 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:25.233850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b33283-f592-4806-8920-dc88c4fb66fc", "name": "network-vif-plugged", "status": "completed", "tag": "12e109f5-4cee-4be6-8615-054870e6a388"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:25.244667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.245654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.246337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.259506 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] Creating event network-vif-plugged:12e109f5-4cee-4be6-8615-054870e6a388 for instance c2b33283-f592-4806-8920-dc88c4fb66fc on n-h2-831194-21 Oct 04 17:52:25.265120 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-114d0e03-524c-4cd4-8dfa-0ae58eba369c req-5a8eef28-13bb-430e-8774-6a6786bda560 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034635 Oct 04 17:52:25.266267 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 378/757] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:25.274248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.275271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.283657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.284355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.285030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.285998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.287776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.288397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.445811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.454490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80533e84-114b-4af3-bb91-4ab5e3d14f3e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1333 microversion: 2.1 time: 0.186816 Oct 04 17:52:25.455381 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 379/758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1333 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:25.461412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.462695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.469045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.469931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.470586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.471637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.472777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.472777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.800128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.810762 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-641ab530-4259-41ae-9485-337b3bb7cad5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.353944 Oct 04 17:52:25.822695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:25.826363 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 380/759] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:25.838802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c33383a7-9b29-400c-a3b1-6357febbb267 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1585 microversion: 2.1 time: 0.638279 Oct 04 17:52:25.839028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.841290 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1585 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:25.843827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.850418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eec3b80-8ffb-4118-82d2-40e6a0bb51d8", "tag": "1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:25.866444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.867371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.868022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.868978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.869653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.870560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.873905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.875528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.876170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.891551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] Creating event network-changed:1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df for instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 on n-h1-831194-21 Oct 04 17:52:25.897765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e0c7c1eb-16f6-45a6-93d2-ee9aaa3b620c req-9195f61a-9898-4daa-852c-06e11be1b710 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054118 Oct 04 17:52:25.900015 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 381/761] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:25.909925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:25.910922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:25.918488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.919113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.919543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:25.920247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:25.920702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:25.921126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.116353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.135864 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ac2e52b-532d-42c6-b9ed-97816b61f24a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.305038 Oct 04 17:52:26.137067 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 381/762] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.141578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6adc14a5-8cbe-49f6-9ee5-5c40293fa643 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdd58160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.241682 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6adc14a5-8cbe-49f6-9ee5-5c40293fa643 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132" status: 200 len: 223 microversion: 2.1 time: 0.103017 Oct 04 17:52:26.248424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 382/763] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 => generated 223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:26.253345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.255308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.256440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.263522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15363053-cd32-4f0a-bdf5-a3b6a2e2faec tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.360258 Oct 04 17:52:26.264747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 382/764] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:25 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.268532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.269045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.269916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.270621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.271212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.271345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.271832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.272372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.279002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.280106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.280944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.281923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.282841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.283501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.423623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e3d6565c-32fb-4fba-876b-41ad3bd30d0a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157553 Oct 04 17:52:26.425386 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 383/765] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8/os-interface => generated 284 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:26.433522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeafbed5-09c2-4b4f-8a29-08ca36addfdf", "tag": "c8bb7279-f62f-4197-8b17-515763de394c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:26.444597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.445354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.446024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.460089 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] Creating event network-changed:c8bb7279-f62f-4197-8b17-515763de394c for instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf on n-h2-831194-21 Oct 04 17:52:26.465682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-184e1062-8ef1-4383-9835-bf8ebc32b8c1 req-e6ad087c-4aad-4787-a44f-e5ae27bcc07a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037328 Oct 04 17:52:26.466683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 384/766] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:26.471909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.472905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.480926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.481594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.482060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.482763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.483217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.483640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.558379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.567309 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-530d19a4-d5c4-4bef-8821-4c22d30362cb tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1321 microversion: 2.1 time: 0.320031 Oct 04 17:52:26.568731 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 383/767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.573885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f8fdd47-6d7b-463b-9f8f-b238dd91f838 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdd95d30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.889067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:26.915750 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-951ae084-a131-4c74-9414-9f5595dfbc12 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.447635 Oct 04 17:52:26.918748 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 385/768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:26.945209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:26.948179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:26.970736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.971542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.973567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:26.974612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:26.975245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:26.976647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.210957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f8fdd47-6d7b-463b-9f8f-b238dd91f838 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132" status: 202 len: 0 microversion: 2.1 time: 0.640764 Oct 04 17:52:27.215222 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 384/769] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:52:26 2022] DELETE /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:27.227230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.228160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:27.250087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.250651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.251414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.252256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.252791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.253481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.588138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:27.596965 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31d74f31-81ee-472b-9c6f-91026c1d7286 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.380581 Oct 04 17:52:27.610376 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 385/770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.621492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.622234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:27.631238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.632536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.632981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.633936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.634402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.634826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.639532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:27.889629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:27.903599 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a407e55-5035-49cd-bb31-293996f64c9c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.981210 Oct 04 17:52:27.904658 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 386/771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:26 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.929319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe0ba280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.957342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:27.967273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-40f78fdc-9315-4f9d-a2f9-fae34a410723 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.355254 Oct 04 17:52:27.968053 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 386/772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:27.976939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:27.977924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:27.986418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.987293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.987962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:27.988904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:27.989593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:27.991341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.047684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:52:28.048884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group 30c2883d-c420-4109-a78d-caba6901e132 not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:52:28.049016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.049016 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 HTTP/1.1 Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:52:28.055632 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.057100 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '30c2883d-c420-4109-a78d-caba6901e132'} Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:28.058000 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:52:28.059253 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.063983 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-8f380ba2-d63a-449b-b23a-e4a13c69052e'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c0bc716d-1f89-462c-8610-1a29f3f5ba24 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132" status: 404 len: 194 microversion: 2.1 time: 0.134301 Oct 04 17:52:28.066820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 387/773] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:28.072187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e11f48b-fbc6-4dad-a052-8de1fb5361d5", "name": "network-vif-plugged", "status": "completed", "tag": "4786d7fc-35b2-4b7a-acde-5b4e1a90a129"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:28.093948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.094578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.095080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.112666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] Creating event network-vif-plugged:4786d7fc-35b2-4b7a-acde-5b4e1a90a129 for instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 on n-h1-831194-21 Oct 04 17:52:28.119142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ee007f6d-c190-4a1e-a98e-57046f9a9a77 req-6afe3452-b246-487f-8c65-ed9e17146fc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058833 Oct 04 17:52:28.120507 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 388/774] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:28.127811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.128599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.136487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.137329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.138039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.138988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.139744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.140387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.306188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.318683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-128b770b-8dcf-4fcf-a69f-15f708d5d4ce tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.348278 Oct 04 17:52:28.319286 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 387/775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:27 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.332267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.333439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.340689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.341495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.342333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.343152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.343699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.344853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.639897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.649338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4d7913a-1d09-4d87-a41d-8a7b7cfae433 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1316 microversion: 2.1 time: 0.321503 Oct 04 17:52:28.649948 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 388/776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.655043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f313c433-9170-48b6-8cfe-f27c05d7ef22 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdd09af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1194998332", "description": "tempest-description-729358793"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:28.798389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:28.807870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5929aa82-7631-4b3b-85f7-185637a0d505 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1470 microversion: 2.1 time: 0.685133 Oct 04 17:52:28.808441 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 389/777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1470 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:28.813356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:28.824757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.825622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.826286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.839909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] Creating event network-changed:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:52:28.847157 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3bbf6206-3baf-408f-8cb3-64b540f745f8 req-38878d7b-c9a7-4c53-9809-ec011e53a246 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036275 Oct 04 17:52:28.848382 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 390/778] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:28.856327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:28.857081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:28.865614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.866210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.866954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:28.867827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:28.868247 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f313c433-9170-48b6-8cfe-f27c05d7ef22 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.216914 Oct 04 17:52:28.868598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:28.868992 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 389/779] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:28 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:28.869389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.004390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:29.005592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] [instance: 9944577a-fa7e-43e1-8279-20878f90b95c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.011431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] HTTP exception thrown: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Request method failure captured: Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/9944577a-fa7e-43e1-8279-20878f90b95c/action HTTP/1.1 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLGJjRkwb88EvFBWjFG3CrtLXNxGbiVck9RFtFmPS2TdmdAJn1JMKvdY5crHfHKL7L56IeVe4gzmyu0pzbk5O4B7udhy-KJa7sD8Tkdmbj6M3f7HU603QYzBQDawvep3Qq3kwxM6LwTHU5Wv2q2X4Fx4D0BRwrAxSbypziKGSR2Etk Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:52:29.013322 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f7a537dc10474af082574d96afe05c4c Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: {"migrate": {}} Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:52:29.014738 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9944577a-fa7e-43e1-8279-20878f90b95c', 'body': {'migrate': {}}} Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:29.015601 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. Oct 04 17:52:29.017177 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:29.018928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Returning 404 to user: Instance 9944577a-fa7e-43e1-8279-20878f90b95c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:29.018928 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f421d188-a2d5-4f53-a3ee-37a8cdae1297 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/9944577a-fa7e-43e1-8279-20878f90b95c/action" status: 404 len: 111 microversion: 2.1 time: 0.144713 Oct 04 17:52:29.018928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 390/780] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:28 2022] POST /compute/v2.1/servers/9944577a-fa7e-43e1-8279-20878f90b95c/action => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:29.021735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a03bd3e2-6686-4c08-b3e7-408bba9837b1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdd95160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-588883518", "description": "tempest-description-869074219"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:29.393159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a03bd3e2-6686-4c08-b3e7-408bba9837b1 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.376801 Oct 04 17:52:29.403674 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 391/781] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:29 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:29.409162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.410137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.431194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.432240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.433059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.433965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.434495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.434994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.485525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:29.495295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6419b3f-1d32-43d5-a5b0-f543eb44b7e5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.645315 Oct 04 17:52:29.496148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 391/782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:28 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.501497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.502355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.513407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.514272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.514721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.516414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.516912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.517343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.578762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:29.587927 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55b65c41-c0a0-48b1-82bb-7ae52b5280c2 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.182730 Oct 04 17:52:29.588770 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 392/783] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.594276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1330174667", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:29.604446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:29.627563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:29.663913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:29.919648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:29.930094 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa35f9a6-e924-41f9-9786-14fe50219d00 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.432087 Oct 04 17:52:29.948427 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 392/784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:29.955020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:29.955630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:29.964493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.964957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:29.965366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.965638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:29.966173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.966490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:29.967073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:29.967452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.968306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:29.968924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.969508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.990360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.991142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:29.994012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:29.997596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:29.998237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.001609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.032131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Getting quotas for project 93c4549aa06d44e5bc01ea13ce0af167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:30.039931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Getting quotas for user 3812f9a68f4641e19528d06742b362ae and project 93c4549aa06d44e5bc01ea13ce0af167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:30.058387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:30.061817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:30.132716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b7f4ba5-7221-41a9-89ea-a7358b34b707 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542613 Oct 04 17:52:30.133760 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 393/785] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:30.139768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f582ea2e-bf37-42e6-b762-37fbd3947487 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdf31040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-416038867", "description": "tempest-description-432111002"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:30.300834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.311530 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98e1019d-4b5b-4076-9e44-ca47a9d15eac tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.361384 Oct 04 17:52:30.312214 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 393/786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:29 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.325986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.325986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.327875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.328371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.328945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.330831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.330831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.330831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.455863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f582ea2e-bf37-42e6-b762-37fbd3947487 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.320532 Oct 04 17:52:30.457099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 394/787] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:30 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.465265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.466256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.483302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.487148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.488684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.490894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.492788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.494508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.698562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.711222 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ae4ddac-2e91-445b-b0f7-0ba27b41fc95 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1466 microversion: 2.1 time: 0.397483 Oct 04 17:52:30.712691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 394/788] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1466 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.729674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0189e380-0cf1-48ac-a3f0-d85257bff8e8", "tag": "f7996638-fe7d-4a93-bbb6-4079da1c05ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:30.766416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:30.766906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:30.767353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:30.798792 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] Creating event network-changed:f7996638-fe7d-4a93-bbb6-4079da1c05ac for instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 on n-h1-831194-21 Oct 04 17:52:30.813613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:30.831263 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1684ef62-b30f-45f4-b906-02e024739ad2 req-b6c1f0f7-b19c-4bb3-86db-9e0517970dcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110548 Oct 04 17:52:30.831951 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 395/789] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:30.842040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a293697-8fdc-47c8-a5cd-f2340b847472 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1585 microversion: 2.1 time: 0.374699 Oct 04 17:52:30.843039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 395/790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1585 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:30.873072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b26606bf-b224-46be-b29f-168d81bf6da6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:30.873810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b26606bf-b224-46be-b29f-168d81bf6da6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:30.886041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-769312b0-1545-4c13-9319-83f276929a44 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdd09ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.061500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b26606bf-b224-46be-b29f-168d81bf6da6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.074478 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b26606bf-b224-46be-b29f-168d81bf6da6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1222 microversion: 2.1 time: 0.234333 Oct 04 17:52:31.092122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 396/791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1222 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.110778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.115583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.125584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.126971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.127606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.128623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.129282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.129762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.408616 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-769312b0-1545-4c13-9319-83f276929a44 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1828 microversion: 2.1 time: 0.542523 Oct 04 17:52:31.410014 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 396/792] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:52:30 2022] GET /compute/v2.1/os-security-groups => generated 1828 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.428541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.430245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.439005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.439725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.440351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.442024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.443210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.443905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.630452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.642903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-560b5aa8-b798-48e4-b4f8-bca7701685e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.548841 Oct 04 17:52:31.643868 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 397/793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.732190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.741649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e5c4d25-0351-4622-9e0d-e438c6cf1795 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.319221 Oct 04 17:52:31.742613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 397/794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.749730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.750820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.758915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.759848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.760527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.761523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.762229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.762963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.856215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.857492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.872314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.872836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.873440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.874173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.875034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.875807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.926064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:31.934436 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17889fb8-db37-406b-9a20-bb848b080689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.190296 Oct 04 17:52:31.935233 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 398/795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:31.954390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:31.955466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:31.966800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.968057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.968766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:31.969963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:31.971642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:31.973975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.135632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:32.157761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:32.166863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f959e01a-e5f0-4647-a444-ed3b4cc2003d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.230405 Oct 04 17:52:32.167445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 399/796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.172190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33385a4f-5472-4db7-84ec-d53375821367 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdb43040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.263757 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8852f60f-8499-4d5b-80df-bceed9c78f60 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1619 microversion: 2.1 time: 0.617399 Oct 04 17:52:32.265038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 398/797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:31 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1619 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.275345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.276554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.288422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.289429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.289930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.291345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.291989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.292528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.364476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:32.372731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-11425cb5-f58d-473d-9404-014cfaf55b74 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1274 microversion: 2.1 time: 0.106009 Oct 04 17:52:32.377908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 399/798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:32.378535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: .version_select at 0x7fbdbde39ca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1183798913", "policies": ["affinity"]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:32.407589 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33385a4f-5472-4db7-84ec-d53375821367 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19" status: 202 len: 0 microversion: 2.1 time: 0.236492 Oct 04 17:52:32.411947 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 400/799] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:52:32 2022] DELETE /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:32.416545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:32.425176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdc09ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.433889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:32.473424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:52:32.475463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group e069fb1d-9b18-4ab2-8836-16a81112ea19 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:52:32.476267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.476267 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19 HTTP/1.1 Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:52:32.479818 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.481206 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e069fb1d-9b18-4ab2-8836-16a81112ea19'} Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:32.482044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:52:32.483332 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.484474 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-c5688344-b769-4784-98ed-9c8a78871d4a'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0e6a133d-e4d8-4110-b7f0-0b318af82551 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19" status: 404 len: 194 microversion: 2.1 time: 0.066892 Oct 04 17:52:32.485716 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 401/800] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19 => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:32.492518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8737683d-8030-42d3-b684-ca73391fe2a7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe469040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.518356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:32.526219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:32.545733 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-917b03b7-5420-4c22-8851-5004ec2ccd86 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.170722 Oct 04 17:52:32.556322 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 400/801] 10.222.0.42 () {60 vars in 1174 bytes} [Tue Oct 4 17:52:32 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:32.561976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eec3b80-8ffb-4118-82d2-40e6a0bb51d8", "name": "network-vif-plugged", "status": "completed", "tag": "1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:32.575770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.575770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.575991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.588870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] Creating event network-vif-plugged:1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df for instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 on n-h1-831194-21 Oct 04 17:52:32.595002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1c5e4c20-2387-4589-97cd-54834114f2a4 req-3509f46d-f9f6-4510-8f6e-7e84c9b1766f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037044 Oct 04 17:52:32.596924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 401/802] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:32.668184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.669121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.680584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.682018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.683717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.687873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.688655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.689099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.823669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8737683d-8030-42d3-b684-ca73391fe2a7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9" status: 202 len: 0 microversion: 2.1 time: 0.337308 Oct 04 17:52:32.825607 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 402/803] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:52:32 2022] DELETE /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:32.831606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:32.832234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:32.840492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.841465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.841930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:32.842987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:32.844456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:32.845055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.036874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:33.046292 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ddedd28d-f915-4135-a9a8-2244f9d40ec1 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.219407 Oct 04 17:52:33.046883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 403/804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:33.057502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-54254548", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "03c71245-b7bf-457f-be82-1815e51c4075"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:33.121752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:33.307301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:33.315734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d849d86-13ea-4eba-aa2d-a9c45d8e7e0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.652286 Oct 04 17:52:33.316527 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 402/805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:32 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:33.332525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdd72040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.347156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:33.347576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:33.348046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:33.348457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:33.349857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:33.375345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.375828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.376261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.376984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.377436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.377878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.389472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:52:33.390097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group bc82c18c-789a-4e04-a354-3a6e507de8d9 not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:52:33.390626 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.390626 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9 HTTP/1.1 Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:52:33.393810 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.395196 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'bc82c18c-789a-4e04-a354-3a6e507de8d9'} Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:33.396808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:52:33.397945 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.399014 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-387d77b0-151f-4ced-b749-282c1b8a0828'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cad02004-297b-4563-9911-36aa5f026364 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9" status: 404 len: 194 microversion: 2.1 time: 0.077603 Oct 04 17:52:33.400235 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 403/806] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:52:33 2022] GET /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:33.402529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3", "tag": "86cd2ab4-af1e-441f-b195-b10d26c71dd8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:33.409380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:33.413740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.414248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.414676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.415362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:33.425521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] Creating event network-changed:86cd2ab4-af1e-441f-b195-b10d26c71dd8 for instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 on n-h1-831194-21 Oct 04 17:52:33.430398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 2 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:33.430681 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e7e8cebb-d637-49c2-87f3-f172698cd200 req-e59f1996-52c1-4104-8106-efb18de50ee1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032919 Oct 04 17:52:33.431456 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 404/807] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:33.433445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:33.436575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.437271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:33.440305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:33.444047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.444736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.445356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.446268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.446883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.447692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.480129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128849) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 04 17:52:33.502297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:33.507764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:33.547242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:33.561095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:33.566733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:33.582583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=0a1c4eeb-7706-4a4a-b2d0-77a334e490cc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:33.641631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:33.648622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:33.691008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:33.697853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:33.737021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d43ed15-4a60-429d-8915-a8c277e53faf tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.683342 Oct 04 17:52:33.737648 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 404/808] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 685 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 17:52:33.743432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.744043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:33.751650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.752337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.752958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.753819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.754451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.755985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.873179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:33.878153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:33.885616 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-abef00cf-3a86-48c2-b4b1-dcf79aea5c3c tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.452766 Oct 04 17:52:33.906230 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 405/809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:33 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:33.909880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:33.912379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.913079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:33.920078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.920699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.920794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b938392d-f287-4139-a121-bbd356a79169 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.182097 Oct 04 17:52:33.921207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:33.923004 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 405/810] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:33 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:33.928899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31b58476-c0bd-4a32-9d07-9bba6c39f13a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe97b160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:33.935605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:33.936349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:33.937141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.077766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.094353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-829c8dd4-f7f7-48b5-bce4-4902042a2af6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1280 microversion: 2.1 time: 0.186247 Oct 04 17:52:34.095964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 406/811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:33 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.115970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.126298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.127097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Searching by: {'deleted': False, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:52:34.146634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.147133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.147576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.148317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.148780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.149608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.184728 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31b58476-c0bd-4a32-9d07-9bba6c39f13a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a" status: 202 len: 0 microversion: 2.1 time: 0.260991 Oct 04 17:52:34.185516 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 406/812] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:52:33 2022] DELETE /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:34.190727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.191385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.205496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.206535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.206994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.207714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.208815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.209318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.272914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:52:34.410730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2fbac71-cf37-4619-856f-db5f0146c71c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 999 microversion: 2.1 time: 0.313064 Oct 04 17:52:34.419533 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 407/813] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers => generated 999 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:34.419533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbde09d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.424088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.433610 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f05ae403-fbb2-458e-8659-d084c631b0a6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.246903 Oct 04 17:52:34.437876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 407/814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.441192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.441964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.456134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.457783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.459275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.460222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.460871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.461485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.493521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:52:34.494166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group b7517373-8dee-48a9-b15c-99376c40ac1a not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:52:34.494747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.494747 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a HTTP/1.1 Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:52:34.497049 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.498387 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b7517373-8dee-48a9-b15c-99376c40ac1a'} Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:34.499558 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:52:34.500846 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.502984 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-613b2055-6ee4-4b9b-9add-046361cf74cb'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0513b093-6b89-448a-b9a3-39ca5f3949f3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a" status: 404 len: 194 microversion: 2.1 time: 0.084574 Oct 04 17:52:34.506779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 408/815] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a => generated 194 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:34.508135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d83351d-f59c-4450-8e89-0b9ee35f3c11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.508135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d83351d-f59c-4450-8e89-0b9ee35f3c11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.641536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d83351d-f59c-4450-8e89-0b9ee35f3c11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.644506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=41 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:34.653638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d83351d-f59c-4450-8e89-0b9ee35f3c11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1217 microversion: 2.1 time: 0.150448 Oct 04 17:52:34.654443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 409/816] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.659322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5f55b94-1797-4138-aec6-ebc9e6882677 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe3ed160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.708963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:34.721596 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f089a65f-8a9f-4ea9-9b3d-29a711ff8803 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.285790 Oct 04 17:52:34.729429 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 408/817] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:34.913074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:34.913712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:34.920966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.921468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.921942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:34.922736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:34.923217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:34.923649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.170925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.195583 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b800d9b5-b173-4265-9118-2bc84d95d9c5 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1365 microversion: 2.1 time: 0.287329 Oct 04 17:52:35.196825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 409/818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:35.217868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.217868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.227031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.227702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.228146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.228960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.229572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.230084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.340228 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5f55b94-1797-4138-aec6-ebc9e6882677 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.684349 Oct 04 17:52:35.340799 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 410/819] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:52:34 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.346610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeafbed5-09c2-4b4f-8a29-08ca36addfdf", "name": "network-vif-plugged", "status": "completed", "tag": "c8bb7279-f62f-4197-8b17-515763de394c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:35.368655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.369690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.371476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.389148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] Creating event network-vif-plugged:c8bb7279-f62f-4197-8b17-515763de394c for instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf on n-h2-831194-21 Oct 04 17:52:35.398290 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b2eab975-df8e-4d26-b226-b88d6a221c7f req-3e3dd99c-cdf1-4a68-855c-cec53d658a3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055099 Oct 04 17:52:35.400030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 411/820] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:35.409629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.411827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.419596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.422304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.422804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.423239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.423946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.424403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.424823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.430061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1ef9e2c-2747-4f8a-85b1-3c09526625c7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.231161 Oct 04 17:52:35.438674 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 410/821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.444678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-851f0199-2101-4f5a-9954-de2a9c43b986 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdf31670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-72293365", "description": "tempest-description-523946034"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:35.720597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-851f0199-2101-4f5a-9954-de2a9c43b986 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.280519 Oct 04 17:52:35.730187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 411/822] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:35 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:35.730545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.730744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.730744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.737806 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4dbc3f5a-652c-4b4a-a767-6412750626a6 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.335840 Oct 04 17:52:35.738499 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 412/823] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.746295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.746997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.749926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.750610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.751050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.751763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.752215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.752862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.761261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.762104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.762781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.763491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.763994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.764428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.842422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.850443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb2abfd1-30cb-4561-8511-ae9fc8186d23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1213 microversion: 2.1 time: 0.109376 Oct 04 17:52:35.866308 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 413/824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1213 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.866308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90a0e792-440e-453a-a651-9058bce48431 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbe2d4d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1291632064", "description": "tempest-description-1321525470"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:35.909670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:35.918596 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d61ae6f5-df1a-4a92-be79-34f171fe67bb tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.195719 Oct 04 17:52:35.928084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 412/825] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:35.933329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:35.934553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:35.970844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.971060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.971675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:35.972699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:35.973138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:35.974259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.245292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.251641 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90a0e792-440e-453a-a651-9058bce48431 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.399578 Oct 04 17:52:36.253158 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 414/826] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:52:35 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:36.271551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6774b64b-e1d4-4401-8372-6e877607c7eb", "tag": "b25a28bd-0b62-45a5-8435-e380699aa49a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:36.273619 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28ef86fa-dbfa-4144-ad09-90e27a28ecc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1311 microversion: 2.1 time: 0.344288 Oct 04 17:52:36.274637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 413/827] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:35 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:36.297845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.309308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.311567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.312171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.314099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.327629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.328134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.328576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.329305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.329767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.330238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.350179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:36.529372 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] Creating event network-changed:b25a28bd-0b62-45a5-8435-e380699aa49a for instance 6774b64b-e1d4-4401-8372-6e877607c7eb on n-h2-831194-21 Oct 04 17:52:36.534298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-39aa8682-65c1-4b11-ab9c-7952fba1e2c1 req-ca4c1db1-07cf-4099-a872-7af3644ff043 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.279255 Oct 04 17:52:36.535197 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 415/828] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:36.540875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-559262314", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "fb899fe7-c3be-494d-8133-7d155961408c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:36.573478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.588267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1e7e3fe-624a-47f9-9d48-d809402ab04b tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1556 microversion: 2.1 time: 0.312140 Oct 04 17:52:36.592772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 414/829] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1556 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:36.599128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.600396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.608952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] validate_networks() for [('fb899fe7-c3be-494d-8133-7d155961408c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:36.614578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.614578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.615542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.616411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.618151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.618705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.768879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:36.784077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70deba88-674c-49e0-9abd-8b0eb591d142 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.190475 Oct 04 17:52:36.784668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 415/830] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:36.789239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.789960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.795686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.796627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.797069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.797761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.798513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.798983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.892853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59325ab6-28e6-4912-aace-dc915c82f75a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106945 Oct 04 17:52:36.895201 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 416/831] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:36.903677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:36.904753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:36.914889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.915754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.916600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:36.918506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:36.919258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:36.919881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.199105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.208808 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a69d1724-315c-4fa0-8582-9b4d1f5a6631 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.310757 Oct 04 17:52:37.216754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 417/832] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:36 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.216754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.216754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.226493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.226995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.227436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.228789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.229257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.229685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.308692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.319781 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b62114e-a329-41bc-a0ca-066edb931bf7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1275 microversion: 2.1 time: 0.108426 Oct 04 17:52:37.330717 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 418/833] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1275 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.340087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.341420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.347769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.348877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.349323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.350243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.350848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.351813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.675093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:37.685253 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b2791cb-d8d1-4d10-a1e6-38c259e4a78c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.351705 Oct 04 17:52:37.685253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 419/834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:37.689334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:37.690136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:37.696389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.696999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.697539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:37.698386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:37.698935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:37.699462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.023422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:38.024153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:38.024467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:38.025062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:38.026230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:38.046077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.047949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.049328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.050355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.051472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.052135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.163876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:38.168000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Getting quotas for project 20921fbfd4ce4723aa15435828360aca. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:38.175691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-371b8736-5453-4414-adfa-1c3ebc511def tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1495 microversion: 2.1 time: 0.490127 Oct 04 17:52:38.185920 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 420/835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:37 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1495 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:38.186815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Getting quotas for user 6f5a31af56a3498599ccfcb0858f0e82 and project 20921fbfd4ce4723aa15435828360aca. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:38.191183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-plugged", "status": "completed", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:38.211162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:38.213582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:38.213755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.214114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.214561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.235321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] Creating event network-vif-plugged:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:52:38.257568 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-da22604e-7937-43ec-8f27-733b35677248 req-76234df7-c81c-49ff-bece-cd14cdf3b9a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077213 Oct 04 17:52:38.262855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 421/836] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:38.278530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:38.279556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:38.290398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-195b94c3-1319-43c6-be71-199b94ac31be tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.753370 Oct 04 17:52:38.294179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.300287 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 416/837] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:52:38.304183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.309536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.315390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.316383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.320085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.643850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:38.644750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:38.653014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.653743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.654698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.655681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.656342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.657023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.727602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:38.738263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a1d850c-308b-4145-a295-de961e6844b1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.471247 Oct 04 17:52:38.748060 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 422/838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:38 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:38.755698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:38.756785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:38.767798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.773182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.773967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:38.774906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:38.775542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:38.776193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.055038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6fb00e1a-6be7-4f63-9179-394235c77300 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1648 microversion: 2.1 time: 0.751926 Oct 04 17:52:39.055857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 417/839] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:38 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1648 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.061025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.061713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.066215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.080301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c675f79-33a2-47a1-96db-db0c3345b1af tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.330596 Oct 04 17:52:39.082001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.083059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.083711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.083843 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 423/840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:38 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.084704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.085320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.085914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.092417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.093110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.121846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.122369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.122819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.123543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.127638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.128272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.220448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.233386 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00a603ed-9083-4156-8fad-94aef3751198 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1219 microversion: 2.1 time: 0.171928 Oct 04 17:52:39.234059 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 418/841] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1219 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.251891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.252521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.259199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.259848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.260605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.261597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.262241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.262831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.388822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.400585 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f4be77a-d13f-4694-b666-e020db0b33e6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.315470 Oct 04 17:52:39.401506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 424/842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.406953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.407564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.416380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.417305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.417981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.419491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.420213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.420841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.674001 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d7f5edb-95c8-420b-bca9-648e3bfc59f8 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1648 microversion: 2.1 time: 0.271148 Oct 04 17:52:39.677537 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 425/843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1648 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.686718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eec3b80-8ffb-4118-82d2-40e6a0bb51d8", "tag": "1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:39.700775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.701323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.702196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.718086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] Creating event network-changed:1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df for instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 on n-h1-831194-21 Oct 04 17:52:39.724672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1bd9abf3-4a6d-4ecf-9d9c-fd38c1ce6fc6 req-704e9da4-c3c6-4e6e-b4ff-5cc1a1bb86ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043967 Oct 04 17:52:39.728925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 426/844] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:39.736567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.742995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.743501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.743963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.744737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.745618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.746270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.788708 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9dbf4b9c-da61-4077-b628-1efb86f54546 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.055338 Oct 04 17:52:39.790026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 427/845] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:39.806258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:39.807083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.815071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.816282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.817335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.818274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.819351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.821908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.830630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:39.838511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-01bf0feb-fd46-4b89-8446-44954b930aab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.603414 Oct 04 17:52:39.839086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 419/846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:39.854702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": true, "disk_over_commit": false}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:39.857483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:39.863477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.864652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.865286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.866189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:39.866805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:39.867221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:39.976179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lazy-loading 'flavor' on Instance uuid eeafbed5-09c2-4b4f-8a29-08ca36addfdf {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:40.001987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.017421 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dba7b0d3-a182-4641-87ee-8eea40c5e290 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1316 microversion: 2.1 time: 0.220733 Oct 04 17:52:40.019798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 428/847] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:39 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:40.048877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128850) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:52:40.107518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.108281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.117931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.118520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.119333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.119675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.120392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.120826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.314404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.334550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-175c403e-2b2a-42bf-b94a-6a29d28bd2fa tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.230830 Oct 04 17:52:40.335273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 429/848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:40.350469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.351401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.359846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.360539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.361797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.362705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.363186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.364471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.462328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.470505 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07ade893-02bc-497f-85d5-659030389dfb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1267 microversion: 2.1 time: 0.133385 Oct 04 17:52:40.471337 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 430/849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1267 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:40.477048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3", "name": "network-vif-plugged", "status": "completed", "tag": "86cd2ab4-af1e-441f-b195-b10d26c71dd8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:40.509269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.509953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.511433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.532683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] Creating event network-vif-plugged:86cd2ab4-af1e-441f-b195-b10d26c71dd8 for instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 on n-h1-831194-21 Oct 04 17:52:40.544080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3c15e669-dee3-4845-a656-742505d7d920 req-6b51782c-1ab0-4125-9b16-cb2aa5a493b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071091 Oct 04 17:52:40.544921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 431/850] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:40.551231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.552454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.574564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.575257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.575728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.576442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.576910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.577361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.924049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:40.937731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6449a3d4-5db5-49ad-9c4c-933e73ce777d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.391423 Oct 04 17:52:40.938648 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 432/851] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:40.944415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:40.944982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:40.960930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.962022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.962797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:40.964116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:40.965140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:40.965874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.179408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:41.181868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:41.189439 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c64be86b-b906-4ec2-96f9-103a8a11344f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1401 microversion: 2.1 time: 0.249818 Oct 04 17:52:41.205231 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 433/852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:40 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1401 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:41.205231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.205231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.205231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.205908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.205908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.205908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.205908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.206230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.351330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:41.360412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33f42fe5-a886-4729-99d5-095a87a97dbe tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1465 microversion: 2.1 time: 0.168915 Oct 04 17:52:41.361311 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 434/853] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1465 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:41.370382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a1c4eeb-7706-4a4a-b2d0-77a334e490cc", "tag": "52dee37a-3676-4954-a30f-4ad237b55f1c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:41.382876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.383399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.383850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.397704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] Creating event network-changed:52dee37a-3676-4954-a30f-4ad237b55f1c for instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc on n-h1-831194-21 Oct 04 17:52:41.402424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7d02eaa2-a4db-4bf8-9996-fe182a884adf req-e93ee8be-f43a-42ae-9f09-061e82104eca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039709 Oct 04 17:52:41.403031 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 435/854] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:41.408237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:41.408957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.416332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.416824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.417273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.418024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.418534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.418918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.581062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:41.589385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a89e6c9e-6228-4dd0-8c11-444a9f7d2347 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.185204 Oct 04 17:52:41.590281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 436/855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:41.607934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2067198785", "metadata": {"image_type": "test"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:41.613379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:41.621616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:41.624121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.624682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.625164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.626077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:41.626702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:41.627202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:41.674226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Getting quotas for project 482b3b1453764194bd840513ceba251f. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:41.683630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Getting quotas for user 586c9ab1fba442168f995cfb2782c587 and project 482b3b1453764194bd840513ceba251f. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:41.968051 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fdda97b7-bf7b-4bc0-9eaa-84b91c366cb8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "POST /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b/action" status: 202 len: 0 microversion: 2.1 time: 0.370515 Oct 04 17:52:41.970971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 437/856] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:41 2022] POST /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:52:41.997507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.002975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:42.034318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.034996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.035887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.036846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.037974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.038200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.185402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:42.195358 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59d156e3-8d5b-4d3d-8906-8a47fac9a2dd tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1273 microversion: 2.1 time: 0.221854 Oct 04 17:52:42.205870 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 438/857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:41 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1273 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:42.205870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.205870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:42.227600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.228753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.230119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.235704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.236438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.237008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.610555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:42.629688 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff41e458-ce2e-482a-b0ad-e670763e8a45 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.431145 Oct 04 17:52:42.645929 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 439/858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:42 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:42.645929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-810a452e-c5b3-4f03-8977-0c3618264a07 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb09280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.706746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-810a452e-c5b3-4f03-8977-0c3618264a07 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.074447 Oct 04 17:52:42.709901 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 440/859] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:42 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:42.714543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:42.715328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:42.725100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.725606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.726137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:42.726793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:42.727258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:42.727694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.111271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.120876 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4e73387-225c-464f-a5bf-42e79c77f353 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1588 microversion: 2.1 time: 0.411851 Oct 04 17:52:43.121700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 441/860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:42 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1588 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.126526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.127235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.134405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.135188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.135837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.136763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.137420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.138308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.232327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1dbc0f5-8356-4613-aa86-9eafa4654b8e tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf/action" status: 202 len: 0 microversion: 2.1 time: 3.381131 Oct 04 17:52:43.236418 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 420/861] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:39 2022] POST /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf/action => generated 0 bytes in 3383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:43.239431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.239929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.249961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.250461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.250901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.251819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.252268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.253213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.367932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.383998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5df90500-8a21-4a12-b923-14f5e3a1dfd6 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149365 Oct 04 17:52:43.385125 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 421/862] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:43.391970 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5753ff7-404e-4301-be13-597ff95a223e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.268903 Oct 04 17:52:43.397419 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 442/863] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.401312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.402193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.409042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.409665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.423018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.423611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.425312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.427234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.428065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.428937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.430734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.431325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.431928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.432951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.433784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.434626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.705687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=28 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:43.726819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.735244 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f1e1935-c58b-4259-bab7-79f1a9e7b783 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.348927 Oct 04 17:52:43.736046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 422/864] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.741913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75e69b98-1b15-4b2c-998f-d7a7d2119f41", "tag": "8eccd1db-8c16-49f0-87a5-ca529a4d2a59"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:43.753071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.753855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.754657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.771619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] Creating event network-changed:8eccd1db-8c16-49f0-87a5-ca529a4d2a59 for instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 on n-h1-831194-21 Oct 04 17:52:43.777962 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c0cba879-9596-49d0-9509-3350227e30a6 req-e5f0bca2-8035-493e-a8ca-704defef54ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040527 Oct 04 17:52:43.778577 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 423/865] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:43.784185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.784997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:43.791955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.792438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.793074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.793929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:43.794388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:43.794811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:43.881087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:43.890105 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98640b3b-6fe0-4088-87ad-c2f6e614ac4b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.491108 Oct 04 17:52:43.890689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 443/866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:43.896671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43fd0289-50e6-4091-8cea-4c4bde34c914 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb09280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:43.961267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43fd0289-50e6-4091-8cea-4c4bde34c914 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.067429 Oct 04 17:52:43.962286 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 444/867] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:44.294536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2886aaa8-9130-449e-9072-febdf7f136c1", "tag": "70f78269-fa46-4503-842c-884126928285"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:44.308517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.309217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.310028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.322895 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] Creating event network-changed:70f78269-fa46-4503-842c-884126928285 for instance 2886aaa8-9130-449e-9072-febdf7f136c1 on n-h2-831194-21 Oct 04 17:52:44.328127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-217cbb39-16db-484e-ab16-158061097c6d req-54508126-5505-46cd-96be-931f3d07e235 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039220 Oct 04 17:52:44.329104 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 445/868] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:44.366349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:44.375062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75db4079-e9c9-4867-9175-100a8eb3df63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.595109 Oct 04 17:52:44.375637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 424/869] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:43 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:44.421693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:44.422717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:44.434171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.434854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.435293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.435996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.436604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.437032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.678952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:44.689197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31b35e41-5cab-4bbc-ae5e-c1cda9123885 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.270820 Oct 04 17:52:44.691378 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 446/870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:44 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:44.761220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:44.761856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:44.769204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.770774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.771391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.772290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.772949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.773541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.796547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6774b64b-e1d4-4401-8372-6e877607c7eb", "name": "network-vif-plugged", "status": "completed", "tag": "b25a28bd-0b62-45a5-8435-e380699aa49a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:44.814005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.818531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.819200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.847495 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] Creating event network-vif-plugged:b25a28bd-0b62-45a5-8435-e380699aa49a for instance 6774b64b-e1d4-4401-8372-6e877607c7eb on n-h2-831194-21 Oct 04 17:52:44.853995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-19608a52-b12d-4fa6-b5df-5b1f7add06bc req-b9e93388-5377-444f-a0e9-458ac9cb823b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060678 Oct 04 17:52:44.855665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 447/871] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:44.917153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:44.918144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:44.927319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.928222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.928844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:44.936480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:44.938022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:44.938581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.044695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.063646 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92789878-4e93-4823-a211-7a4089d50382 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.306502 Oct 04 17:52:45.064249 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 425/872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:44 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:45.081940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db299b5d-a7d9-4001-bae1-07e10505e5d5 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe0340d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.113753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.124493 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-710152c1-9d2c-4d22-a1f6-06189603ff6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.211832 Oct 04 17:52:45.125737 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 448/873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:44 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:45.145527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db299b5d-a7d9-4001-bae1-07e10505e5d5 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.078549 Oct 04 17:52:45.146146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 426/874] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:45.328963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.329690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:45.335952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.336437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.336870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.337566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.338050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.338471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.402077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.402077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:45.408394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.408969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.409585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.410674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.411236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.411609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.480917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.489769 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d8ae619-c5df-4901-864e-943fbe02802c tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1588 microversion: 2.1 time: 0.164547 Oct 04 17:52:45.490509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 449/875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1588 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:45.549506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.557788 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8005a611-d3cd-4ded-9253-ca23fa85998e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.160703 Oct 04 17:52:45.558389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 427/876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:45.714483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:45.715412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:45.721776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.722542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.723689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.724663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.725116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.725748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.800888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3", "tag": "86cd2ab4-af1e-441f-b195-b10d26c71dd8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:45.813724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:45.814455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:45.815059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:45.819541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:45.828322 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] Creating event network-changed:86cd2ab4-af1e-441f-b195-b10d26c71dd8 for instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 on n-h1-831194-21 Oct 04 17:52:45.834448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9546179c-99ef-4c6a-9275-04c0bbda26fc req-8a449951-ba50-4f2a-a596-38ad11d982fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042036 Oct 04 17:52:45.835570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 428/877] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:45.873044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:45.886675 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc7fae38-40fd-4b40-bc12-b00e26ad0abe tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.177661 Oct 04 17:52:45.899086 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 450/878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:45 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.090476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.091494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.113864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.116023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.116670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.117803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.118487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.119168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.150005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.151452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.169575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.169857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.170315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.171033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.171493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.171938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.470676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.479466 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c0f08d4-4ece-4946-b49b-f1f2b0c9690f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.334544 Oct 04 17:52:46.494382 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 451/879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:46.502294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa84ec87-7427-42ac-b27a-a1e704c3879c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd95670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.554391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa84ec87-7427-42ac-b27a-a1e704c3879c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.057877 Oct 04 17:52:46.555506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 452/880] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.582684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.583565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.590586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.591406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.592637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.593591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.594301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.594979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.622653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:46.835446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.838380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:46.846350 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01852bdc-260a-4e40-a72c-0735d100e676 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.268007 Oct 04 17:52:46.850400 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 453/881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.851729 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-941fc653-da5e-4b1a-86f1-4745f5c189de tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.765311 Oct 04 17:52:46.870348 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 429/882] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:46.920359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:46.921783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:46.930787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.932116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.933568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:46.935322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:46.936500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:46.937339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.120273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:47.132775 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-353d8883-0549-4fb1-830a-52a27119c6d0 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1322 microversion: 2.1 time: 0.218959 Oct 04 17:52:47.141331 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 454/883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:46 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:47.508384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.509046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.516152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.516679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.517130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.517865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.518328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.518759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.570869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a36aafcf-2468-4f83-8a50-445707e93ed6 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb2cf70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.621737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a36aafcf-2468-4f83-8a50-445707e93ed6 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.055523 Oct 04 17:52:47.622614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 455/884] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:47.872854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.873474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.880979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.881728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.882362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.883077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.883698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.884139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.919534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:47.929031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-374b762e-fb14-4749-8e71-2f6914f887a4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.425389 Oct 04 17:52:47.929614 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 430/885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:47.934709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:47.935532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:47.942676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.943237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.943686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:47.944583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:47.945060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:47.945486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.096174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:48.106919 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8277dbdb-9024-4ac5-abfa-92a2ce7adee1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.238227 Oct 04 17:52:48.107913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 456/886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:48.113657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeafbed5-09c2-4b4f-8a29-08ca36addfdf", "name": "network-vif-unplugged", "status": "completed", "tag": "c8bb7279-f62f-4197-8b17-515763de394c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:48.116581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:48.136541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.137318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.137866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.152086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] Creating event network-vif-unplugged:c8bb7279-f62f-4197-8b17-515763de394c for instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf on n-h2-831194-21 Oct 04 17:52:48.158094 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1518c9c6-500e-4b2d-a076-78810f616db0 req-3f8b785b-37c5-4eaa-85be-8a52b852237c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048820 Oct 04 17:52:48.159110 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 457/887] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:48.167277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.168763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:48.177645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.179624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.180178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.181340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.182424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.183285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.204983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:48.367545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:48.375160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:48.381060 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-219167f7-a7b1-4c35-95f3-759a00429b92 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.450068 Oct 04 17:52:48.383892 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 431/888] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:47 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:48.394073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75a1cfb5-7a3e-4fba-ac83-db390b20f7d2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1471 microversion: 2.1 time: 0.223937 Oct 04 17:52:48.395377 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 458/889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:48 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:48.421733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:48.422865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:48.429918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.430749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.431343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.432204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.432834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.433431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.458776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lazy-loading 'flavor' on Instance uuid 6774b64b-e1d4-4401-8372-6e877607c7eb {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:48.548903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49e2f1c4-1ab2-4570-a313-0afac0677cc3 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb/action" status: 202 len: 0 microversion: 2.1 time: 0.130898 Oct 04 17:52:48.550072 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 432/890] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:48 2022] POST /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:48.560111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.561166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:48.573071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.574249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.576443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.578705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.579494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.581321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.585086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c4eeb-7706-4a4a-b2d0-77a334e490cc", "name": "network-vif-plugged", "status": "completed", "tag": "52dee37a-3676-4954-a30f-4ad237b55f1c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:48.611227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.612654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.616806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.649030 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] Creating event network-vif-plugged:52dee37a-3676-4954-a30f-4ad237b55f1c for instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc on n-h1-831194-21 Oct 04 17:52:48.662620 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05117040-b7ce-4516-b6c2-7909fd2778e6 req-aeb9afd1-ce30-4660-80d7-92637044db49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092567 Oct 04 17:52:48.663855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 433/891] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:48.672794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f6a27b8-ce72-423a-8afc-d0c07ac8a04f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe2d41f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.752132 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f6a27b8-ce72-423a-8afc-d0c07ac8a04f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.086756 Oct 04 17:52:48.761288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 434/892] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:48 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:48.953892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:48.955696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:48.967080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.972926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.994919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:48.997154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:48.997811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:48.998468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.057185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6043318-4a0e-4e54-a6b0-adf82c793485 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1632 microversion: 2.1 time: 0.498033 Oct 04 17:52:49.058163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 459/893] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:48 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1632 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:49.135961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:49.138159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:49.146292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.147622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.148851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.150604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.163577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.164257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.187784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:49.197775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d757dee2-1d3e-47ff-ae88-efae350e3eeb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.247969 Oct 04 17:52:49.198713 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 435/894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:48 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:49.424337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:49.424961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:49.443618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.444807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.444807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.445267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:49.446316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:49.446897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:49.495035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:49.512022 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7556d13a-6c32-492d-a505-17c9006bf32e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.377498 Oct 04 17:52:49.513092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 460/895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:49 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:49.623200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:49.632373 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d2a86e5-d355-47c7-bc1b-b9643a717174 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.216242 Oct 04 17:52:49.634546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 436/896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:49 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:49.768004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-abdf9f1f-8541-4181-8ca3-0cec7c87f21b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdc2db80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:49.784220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:49.820976 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-abdf9f1f-8541-4181-8ca3-0cec7c87f21b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.056658 Oct 04 17:52:49.821693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 461/897] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:49 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:50.090091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.091215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.102990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.103766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.104197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.105074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.105700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.106308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.193900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eeafbed5-09c2-4b4f-8a29-08ca36addfdf", "tag": "c8bb7279-f62f-4197-8b17-515763de394c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:50.205432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.206605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.208223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.240144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] Creating event network-changed:c8bb7279-f62f-4197-8b17-515763de394c for instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf on n-h2-831194-21 Oct 04 17:52:50.246932 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7fbc3388-cb45-4ba4-9296-ad6814b5246d req-38dfc145-674c-4899-b69f-48cd78356cc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060565 Oct 04 17:52:50.248271 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 462/898] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:50.255545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.260813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.270223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.271203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.272488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.273627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.274469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.275169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.315474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27b29a3f-dd20-4fdd-a2ae-b64cdbda40a9 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1615 microversion: 2.1 time: 0.229705 Oct 04 17:52:50.319259 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 437/899] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1615 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:50.343576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:50.344467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.355592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.360805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.361436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.362713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.363215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.363652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.540160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:50.549541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-823ec6af-fed0-4ec6-8d05-b4e75f3c30f9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.299856 Oct 04 17:52:50.553634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 463/900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:50.567987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.569346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.577586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] HTTP exception thrown: Cannot 'migrate' instance 6774b64b-e1d4-4401-8372-6e877607c7eb while it is in vm_state suspended Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Request method failure captured: Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb/action HTTP/1.1 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 15 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLGJjRkwb88EvFBWjFG3CrtLXNxGbiVck9RFtFmPS2TdmdAJn1JMKvdY5crHfHKL7L56IeVe4gzmyu0pzbk5O4B7udhy-KJa7sD8Tkdmbj6M3f7HU603QYzBQDawvep3Qq3kwxM6LwTHU5Wv2q2X4Fx4D0BRwrAxSbypziKGSR2Etk Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:52:50.580448 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f7a537dc10474af082574d96afe05c4c Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: {"migrate": {}} Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:52:50.582756 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot 'migrate' instance 6774b64b-e1d4-4401-8372-6e877607c7eb while it is in vm_state suspended Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6774b64b-e1d4-4401-8372-6e877607c7eb', 'body': {'migrate': {}}} Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb in vm_state suspended. Cannot resize while the instance is in this state. Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.583620 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 6774b64b-e1d4-4401-8372-6e877607c7eb while it is in vm_state suspended Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.585244 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.586773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:50.586773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:50.586773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 6774b64b-e1d4-4401-8372-6e877607c7eb while it is in vm_state suspended Oct 04 17:52:50.586773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.587298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Returning 409 to user: Cannot 'migrate' instance 6774b64b-e1d4-4401-8372-6e877607c7eb while it is in vm_state suspended {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:50.588625 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de7c04f5-a316-4703-b444-a460369c769f tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb/action" status: 409 len: 148 microversion: 2.1 time: 0.249555 Oct 04 17:52:50.591194 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 438/901] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:50 2022] POST /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb/action => generated 148 bytes in 253 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:52:50.594001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.594504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.594942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.598346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.600195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.603622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.606372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c256996-e6f6-4eb0-8f48-9f69737a9a18 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c256996-e6f6-4eb0-8f48-9f69737a9a18 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Request method failure captured: Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action HTTP/1.1 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 39 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLGJjRkwb88EvFBWjFG3CrtLXNxGbiVck9RFtFmPS2TdmdAJn1JMKvdY5crHfHKL7L56IeVe4gzmyu0pzbk5O4B7udhy-KJa7sD8Tkdmbj6M3f7HU603QYzBQDawvep3Qq3kwxM6LwTHU5Wv2q2X4Fx4D0BRwrAxSbypziKGSR2Etk Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:52:50.616292 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f7a537dc10474af082574d96afe05c4c Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: {"os-resetState": {"state": "invalid"}} Oct 04 17:52:50.621198 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c2b33283-f592-4806-8920-dc88c4fb66fc', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.622223 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:52:50.624364 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 04 17:52:50.625528 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.625528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c256996-e6f6-4eb0-8f48-9f69737a9a18 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:50.625528 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c256996-e6f6-4eb0-8f48-9f69737a9a18 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action" status: 400 len: 144 microversion: 2.1 time: 0.021600 Oct 04 17:52:50.628924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 439/902] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:50 2022] POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action => generated 144 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:52:50.641725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f2f6e67-26c3-4ab5-890b-3b378e824b6b tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f2f6e67-26c3-4ab5-890b-3b378e824b6b tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Request method failure captured: Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action HTTP/1.1 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 31 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLGJjRkwb88EvFBWjFG3CrtLXNxGbiVck9RFtFmPS2TdmdAJn1JMKvdY5crHfHKL7L56IeVe4gzmyu0pzbk5O4B7udhy-KJa7sD8Tkdmbj6M3f7HU603QYzBQDawvep3Qq3kwxM6LwTHU5Wv2q2X4Fx4D0BRwrAxSbypziKGSR2Etk Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:52:50.646859 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f7a537dc10474af082574d96afe05c4c Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: {"os-resetState": {"state": 1}} Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:52:50.648276 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c2b33283-f592-4806-8920-dc88c4fb66fc', 'body': {'os-resetState': {'state': 1}}} Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 1 Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:50.649081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 04 17:52:50.650442 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.652927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f2f6e67-26c3-4ab5-890b-3b378e824b6b tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:50.652927 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f2f6e67-26c3-4ab5-890b-3b378e824b6b tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action" status: 400 len: 120 microversion: 2.1 time: 0.012295 Oct 04 17:52:50.652927 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 440/903] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:50 2022] POST /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc/action => generated 120 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:52:50.663333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:50.665970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Failed to fetch instance by id 999 {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 17:52:50.666633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Request method failure captured: Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 37 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLGJjRkwb88EvFBWjFG3CrtLXNxGbiVck9RFtFmPS2TdmdAJn1JMKvdY5crHfHKL7L56IeVe4gzmyu0pzbk5O4B7udhy-KJa7sD8Tkdmbj6M3f7HU603QYzBQDawvep3Qq3kwxM6LwTHU5Wv2q2X4Fx4D0BRwrAxSbypziKGSR2Etk Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:52:50.668468 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c4c02d20c0af41478fef4f1c6c4a6387"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c4c02d20c0af41478fef4f1c6c4a6387 Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1847765597 Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f7a537dc10474af082574d96afe05c4c Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1847765597-project-admin Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: {"os-resetState": {"state": "error"}} Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:52:50.670064 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 999 could not be found. Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:52:50.671125 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:50.672539 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0850655d-111d-44e5-994a-c4ec5abc1983 tempest-ServersAdminNegativeTestJSON-1847765597 tempest-ServersAdminNegativeTestJSON-1847765597-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.014223 Oct 04 17:52:50.674416 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 441/904] 10.222.0.42 () {60 vars in 1179 bytes} [Tue Oct 4 17:52:50 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:52:50.681219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.682356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.688993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.689663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.690194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.691001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.691602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.692561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.836752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:50.845496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b96a5f29-0603-45ec-b247-63f761e8c8c7 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.289693 Oct 04 17:52:50.849636 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 464/905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:50.855983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:50.856899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:50.865047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.866315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.866781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.869487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:50.870391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:50.871134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:50.909666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:51.040059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3dd27bb4-8e1c-4a1d-bb09-94fb6ba13bef tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 204 len: 0 microversion: 2.1 time: 0.187213 Oct 04 17:52:51.041544 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 465/906] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:50 2022] DELETE /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:51.048872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-plugged", "status": "completed", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:51.064071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.064563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.065232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.080951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] Creating event network-vif-plugged:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:52:51.088034 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-80b4f5bd-1486-418c-89b6-172f2c6b46f8 req-1d6f310e-9e9d-4fd2-9f0d-fd96dbb02779 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044509 Oct 04 17:52:51.089076 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 466/907] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:51.090085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:51.096487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b123a8a-e99e-4958-a65e-dffd7bdb8594 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb2c5e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.101503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d8f35179-ee83-44a3-bf30-ad690f39ec80 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.426391 Oct 04 17:52:51.103223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 442/908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:50 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:51.108734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.109605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:51.120035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.120658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.121188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.122043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.122756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.123245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.184890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b123a8a-e99e-4958-a65e-dffd7bdb8594 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.091947 Oct 04 17:52:51.193203 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 467/909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:51.302924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:51.312230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14b54420-3c5f-4ee9-9caf-d4b1cbafa5ce tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1468 microversion: 2.1 time: 0.207771 Oct 04 17:52:51.313180 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 443/910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1468 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:51.580043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.580772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:51.587658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.588263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.588696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.589404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.589921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.590349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.751080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:51.760528 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc0ebb81-660e-4362-b6cb-d74a93698989 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.184323 Oct 04 17:52:51.761545 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 468/911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:51.874543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:51.875455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:51.882254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.882929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.883545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:51.884423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:51.884876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:51.885480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.043331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:52.053380 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-25f7efd3-48e8-469b-b74d-4a6c3f74fd1f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.183214 Oct 04 17:52:52.055011 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 444/912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:51 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:52.126308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.126935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.134426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.134923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.135368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.136078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.136712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.137145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.200305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97e49975-6cdf-4cfb-82c6-e8cf1cb93b67 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe2e5dc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.263422 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97e49975-6cdf-4cfb-82c6-e8cf1cb93b67 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.063930 Oct 04 17:52:52.265752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 445/913] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:52.294192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:52.307901 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-276492bc-1ce8-46e5-8355-1dea6db6d81c tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.185443 Oct 04 17:52:52.308744 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 469/914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:52.339351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.339973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.346921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.348335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.348818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.349623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.350225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.350658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.511204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:52.519981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b5dc3c7-6c0a-4ef4-bf74-af5767c7483e tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1468 microversion: 2.1 time: 0.184353 Oct 04 17:52:52.520432 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 446/915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1468 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:52.784048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:52.784649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:52.791723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.792444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.792960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:52.804868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:52.805275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:52.806543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.013988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:53.027594 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c30eadba-2e89-40fd-b470-6b6230dff56b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.247274 Oct 04 17:52:53.028389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 470/916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:52 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:53.080123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.081136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:53.088733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.089600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.090288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.091246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.091816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.092440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.104876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e69b98-1b15-4b2c-998f-d7a7d2119f41", "name": "network-vif-plugged", "status": "completed", "tag": "8eccd1db-8c16-49f0-87a5-ca529a4d2a59"}, {"server_uuid": "2886aaa8-9130-449e-9072-febdf7f136c1", "name": "network-vif-plugged", "status": "completed", "tag": "70f78269-fa46-4503-842c-884126928285"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:53.126069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.126562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.127008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.144770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Creating event network-vif-plugged:8eccd1db-8c16-49f0-87a5-ca529a4d2a59 for instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 on n-h1-831194-21 Oct 04 17:52:53.145290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] Creating event network-vif-plugged:70f78269-fa46-4503-842c-884126928285 for instance 2886aaa8-9130-449e-9072-febdf7f136c1 on n-h2-831194-21 Oct 04 17:52:53.153531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-abff4189-ac0a-45ad-bd8d-199df902dbb0 req-a39b9b14-5717-4829-9f69-bbfa68d3d545 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052272 Oct 04 17:52:53.154756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 471/917] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:53.280063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-508c69ee-7144-4740-91e6-e612814858c4 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd841f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.309358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:53.319593 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-798df6a3-aed6-43a6-a50d-7da2940312d8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.242694 Oct 04 17:52:53.321050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 447/918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:53 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:53.341526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-508c69ee-7144-4740-91e6-e612814858c4 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.065598 Oct 04 17:52:53.342520 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 472/919] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:53 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:53.343577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.344210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:53.358956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.359460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.359900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.360619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.361075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.361497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.552553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:53.553422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:53.560142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.560657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.561106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.561846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:53.562314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:53.562750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:53.622045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:53.633572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0efcba7d-5505-46db-b3a0-7f5cea481c5d tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.298840 Oct 04 17:52:53.640376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 448/920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:53 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:53.732098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:53.743597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54475137-872b-4376-94a4-61df33ce8810 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1468 microversion: 2.1 time: 0.194753 Oct 04 17:52:53.745897 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 473/921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:53 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1468 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:54.053022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.053734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:54.064370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.066987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.069011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.069780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.070375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.071381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.121217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6774b64b-e1d4-4401-8372-6e877607c7eb", "name": "network-vif-deleted", "tag": "b25a28bd-0b62-45a5-8435-e380699aa49a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:54.138166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.138662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.142117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.168052 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] Creating event network-vif-deleted:b25a28bd-0b62-45a5-8435-e380699aa49a for instance 6774b64b-e1d4-4401-8372-6e877607c7eb on n-h2-831194-21 Oct 04 17:52:54.173978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0440b919-abf6-4ed7-a91d-ae623d5e90d7 req-e21f66e3-40f0-458e-b1ef-9b9f3cf8f061 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056603 Oct 04 17:52:54.175179 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 474/922] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:54.271441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.275421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:54.291741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b30f8e8-ae3f-439e-9bf8-f37460950219 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.243662 Oct 04 17:52:54.293113 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 449/923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.345282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.346050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:54.355687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.356125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.356562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.357261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.357713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.358157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.359465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-177674b1-97d2-4d46-8e5b-0597c23311fd tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdbf4dc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.414935 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-177674b1-97d2-4d46-8e5b-0597c23311fd tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.060600 Oct 04 17:52:54.416233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 450/924] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.551271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.555975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:54.564891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93e82c84-ab0f-4ad3-b148-27bc166cfb63 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1317 microversion: 2.1 time: 0.223941 Oct 04 17:52:54.565854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 475/925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1317 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.657234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.658163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:54.666219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.667190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.667781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.668668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.669269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.669870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.766574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:54.767478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:54.778506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.783731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.784702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.786638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.787372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.788012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.837787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.844022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:54.844782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:54.845231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:54.845690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lazy-loading 'fault' on Instance uuid 6774b64b-e1d4-4401-8372-6e877607c7eb {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:54.846890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b7212fb-eb66-4917-9b9c-b202542d4a9f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1315 microversion: 2.1 time: 0.193812 Oct 04 17:52:54.847892 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 451/926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:54.901003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:54.911021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45211738-6517-48cd-aae0-1466e95f9d75 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1312 microversion: 2.1 time: 0.147774 Oct 04 17:52:54.911874 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 476/927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:54 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:55.318648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.320431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.330333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.331140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.332062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.332853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.333347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.346175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.432814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f02c9f4e-b250-49d8-b6dc-bdf896ee6445 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdab3e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.507904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f02c9f4e-b250-49d8-b6dc-bdf896ee6445 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.079373 Oct 04 17:52:55.528950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 477/928] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:55.643825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.643825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.643825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.643825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.644562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.644562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.644562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.644562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.732756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:55.748600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83091d6f-ed5c-454b-9bb4-038e770e9f58 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.431676 Oct 04 17:52:55.758543 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 452/929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:55.864813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:55.874770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.875077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c7e580a-a1fd-4dd6-8e0b-f14bcfd3743c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1467 microversion: 2.1 time: 0.284283 Oct 04 17:52:55.875391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.885327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.885860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.886314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.887512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.887512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.887978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.890607 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 478/930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1467 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:55.909379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:55.911296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:55.925380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.926631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.927110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:55.927865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:55.930838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:55.931373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.135746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.147745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20af4cd9-079e-440e-8cb1-fa974b03f0fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 200 len: 1467 microversion: 2.1 time: 0.242880 Oct 04 17:52:56.148743 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 479/931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 1467 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.153500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.154200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:56.163652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.164172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.164664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.165443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.166022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.166520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.207429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.208275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.208781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.209303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lazy-loading 'fault' on Instance uuid 6774b64b-e1d4-4401-8372-6e877607c7eb {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:52:56.220630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.230109 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a01f9bff-9a8c-4054-b63c-5ce6b5a89b16 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1503 microversion: 2.1 time: 0.359416 Oct 04 17:52:56.234516 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 453/932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:55 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:52:56.245753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.256575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.257821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Searching by: {'reservation_id': 'r-56qxzlkv', 'deleted': False, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:52:56.263663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.264291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.264779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.265638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.266285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.266946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.283433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.304410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-560677b5-dd6f-4199-bbe9-e17293fe9131 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 200 len: 1312 microversion: 2.1 time: 0.153459 Oct 04 17:52:56.305943 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 480/933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.311686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-72293365"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:56.312291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:56.329440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.330078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.330423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.331151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.331733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.332267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.456223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:52:56.529968 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Adding security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c to port 70f78269-fa46-4503-842c-884126928285 Oct 04 17:52:56.558816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:56.569076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.570039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.570494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.856817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17de4e90-e430-4ebe-962b-1d7d23ffb688 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-56qxzlkv" status: 200 len: 2927 microversion: 2.1 time: 0.620964 Oct 04 17:52:56.857495 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 454/934] 10.222.0.42 () {58 vars in 1197 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/servers/detail?reservation_id=r-56qxzlkv => generated 2927 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.863526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3ff091c-1140-41d8-9fce-f42969dac4aa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe3338b0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.915555 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3ff091c-1140-41d8-9fce-f42969dac4aa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.057041 Oct 04 17:52:56.921226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 455/935] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:56.928611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:56.929174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:56.940416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:56.943693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.946280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.946801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:56.951623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:56.952196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:56.952725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.011409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5239479a-b058-40d5-8bf7-94f6a90df53f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action" status: 202 len: 0 microversion: 2.1 time: 0.703465 Oct 04 17:52:57.012750 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 481/936] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:56 2022] POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:57.019221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.055124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_groups [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Querying cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) for 2 instances {{(pid=128849) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 17:52:57.056981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.058692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.059256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.133229 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7990c52-e76d-434c-8a68-96f631a72e11 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/03c71245-b7bf-457f-be82-1815e51c4075" status: 200 len: 266 microversion: 2.1 time: 0.118389 Oct 04 17:52:57.141125 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 482/937] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/os-server-groups/03c71245-b7bf-457f-be82-1815e51c4075 => generated 266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:57.148934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdf31670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.228577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:57.236649 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c215949e-ae7a-4249-bdb9-ba9acb643b1f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.314235 Oct 04 17:52:57.237423 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 456/938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:56 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:57.260556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2886aaa8-9130-449e-9072-febdf7f136c1", "tag": "70f78269-fa46-4503-842c-884126928285"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:57.271060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.271558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.271980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.285470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] Creating event network-changed:70f78269-fa46-4503-842c-884126928285 for instance 2886aaa8-9130-449e-9072-febdf7f136c1 on n-h2-831194-21 Oct 04 17:52:57.288623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use.", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:52:57.290148 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.290148 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.291701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b67a5456-6c45-4c47-85d0-cb372e5129a1 req-7922759a-4398-4858-9d6d-71a72d1cdf8b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034910 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c HTTP/1.1 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:52:57.292691 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: exception: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.294384 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b5ee2be1-e93e-4465-9cf9-b4d51cec972c'} Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:57.295773 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.297297 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.298751 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 400 to user: Security Group b5ee2be1-e93e-4465-9cf9-b4d51cec972c in use. Oct 04 17:52:57.301321 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-8bcf629d-2251-4656-bbeb-0c42bb8d3d69'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:57.302240 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 457/939] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:57.302336 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75bc00b0-718a-42fa-88c6-104b2a2d7374 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c" status: 400 len: 185 microversion: 2.1 time: 0.158690 Oct 04 17:52:57.302336 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 483/940] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:52:57 2022] DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c => generated 185 bytes in 163 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:52:57.305453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.306335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.309390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:57.313203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.313704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.314188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.314900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.315358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.316442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.319505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.334530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.335039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.335491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.336239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.336671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.344356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.497554 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33218ce8-527d-402f-adcc-92f32b528609 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action" status: 202 len: 0 microversion: 2.1 time: 0.195173 Oct 04 17:52:57.499360 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 484/941] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:52:57 2022] POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:52:57.509601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.510617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: 6774b64b-e1d4-4401-8372-6e877607c7eb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.518187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.519581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.520225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.521201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.521843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.522795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.551918 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] HTTP exception thrown: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Request method failure captured: Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb HTTP/1.1 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLF5QSlSp34_lyQAY8Cnqn7y-o5HmdMfGTL98TXskMFcqr-P0LJY1dVwjLKauGr12ktlUWV24352tfC_EOOFiMTNzUD56m4JIUsLeb-swrvEHp0l59LD_3ZHBcMA4f_1gaic_rXp_TYs21roQGIma3cVH3kDPuX5Z8Vehx9dDRBF4M Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 93c4549aa06d44e5bc01ea13ce0af167 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:52:57.554445 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 93c4549aa06d44e5bc01ea13ce0af167 Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminNegativeTestJSON-164483590-project Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3812f9a68f4641e19528d06742b362ae Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminNegativeTestJSON-164483590-project Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. Oct 04 17:52:57.555990 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '6774b64b-e1d4-4401-8372-6e877607c7eb'} Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:52:57.556988 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. Oct 04 17:52:57.558487 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:52:57.560884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Returning 404 to user: Instance 6774b64b-e1d4-4401-8372-6e877607c7eb could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:52:57.562299 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-085a635b-afda-46a1-a324-4f246270224f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb" status: 404 len: 111 microversion: 2.1 time: 0.061616 Oct 04 17:52:57.567199 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 485/942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/servers/6774b64b-e1d4-4401-8372-6e877607c7eb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:52:57.573230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.574152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.579729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:52:57.583450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.584201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.584816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.586319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.587282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.587939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.711292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8aec42ef-b0c9-461e-ad8d-c47f7a3c4484 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 200 len: 1620 microversion: 2.1 time: 0.414761 Oct 04 17:52:57.715657 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 458/943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 1620 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:57.730105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.730105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.747468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.748120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.748667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.749498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.750095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.750620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.793786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:57.807468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:52:57.807971 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c43ee793-9820-4142-af3e-4129e3311daa tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1572 microversion: 2.1 time: 0.238862 Oct 04 17:52:57.809564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 486/944] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1572 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:57.815212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:57.817679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:57.825920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.827276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.827883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.828792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:57.829406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:57.830360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:57.977648 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-45f25762-41ed-481c-b4a5-e4afb5cbf3f8 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 204 len: 0 microversion: 2.1 time: 0.260389 Oct 04 17:52:57.983881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 459/945] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:52:57 2022] DELETE /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:52:57.991660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11b10f47-2e3f-4904-9dfc-47a5522a1ef9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd72d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.023782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03f55366-4744-4d9c-8259-7676d1309ace tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 200 len: 1620 microversion: 2.1 time: 0.212927 Oct 04 17:52:58.024646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 487/946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 1620 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:58.029123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.029907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.046949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.046949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.046949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.046949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.047326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.047326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.061560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-11b10f47-2e3f-4904-9dfc-47a5522a1ef9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.075900 Oct 04 17:52:58.062378 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 460/947] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:57 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:58.067000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: .version_select at 0x7fbdbe034670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1587129073", "policies": ["anti-affinity"]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:58.095275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.110236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:58.191865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.202106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:58.222445 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e7269d8e-6c15-46d7-9bb3-c0b1533b1076 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.158781 Oct 04 17:52:58.223571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 461/948] 10.222.0.42 () {60 vars in 1174 bytes} [Tue Oct 4 17:52:58 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:58.246019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:58.255574 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3a5413c-dd60-4918-b42a-a2b754b4367f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1476 microversion: 2.1 time: 0.229974 Oct 04 17:52:58.265517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.266451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.275435 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 488/949] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:58 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:58.275670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.276069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.276447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.280910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.281376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.281811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.287138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1928163636", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "249e5257-650c-463b-9c13-33ebb9551c51"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:52:58.375429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:52:58.473898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:58.482974 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e463509-a163-4be4-b992-782d242967e8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1505 microversion: 2.1 time: 0.221998 Oct 04 17:52:58.494100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 462/950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:58 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:58.665033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:52:58.666245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:52:58.668497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:52:58.669549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:52:58.670403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:52:58.689200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.689942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.690481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.691314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.691846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.692341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.714626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.720871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:58.736652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 2 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:52:58.740179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:58.818695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.824871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:58.837618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:58.841401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:58.850247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.851301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.851942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.853146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:58.853882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:58.854546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:58.877159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.884542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:58.901922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=5b41563a-8ab1-4067-a385-5eb03bb6c725,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:52:58.961754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:58.968582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:59.054694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:52:59.061851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:52:59.096939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.109101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ed1e1e4-52bc-4de5-bd9f-26162d340a90 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.831486 Oct 04 17:52:59.113013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-735c75a3-116d-4b39-901f-538dc2ce1b0e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1572 microversion: 2.1 time: 0.279573 Oct 04 17:52:59.115474 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 463/951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:58 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1572 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.126333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e999705-6d1c-473a-9172-ceaa6f7cdf65 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe1d94c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.126491 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 489/952] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:52:58 2022] POST /compute/v2.1/servers => generated 32 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 17:52:59.134770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.140273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.141047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Searching by: {'deleted': False, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:52:59.158339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.158840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.159274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.160953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.161420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.161865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.191784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e999705-6d1c-473a-9172-ceaa6f7cdf65 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.076509 Oct 04 17:52:59.193098 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 464/953] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.264012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:52:59.296520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.297526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.305763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.306641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.307671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.308870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.309436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.310127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.354697 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-171a55b4-5aa7-4c32-8598-c71a3bf0c73c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1661 microversion: 2.1 time: 0.227070 Oct 04 17:52:59.355617 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 490/954] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers => generated 1661 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.382171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cbe79cba-801a-4955-ab74-f037d24571fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.382795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cbe79cba-801a-4955-ab74-f037d24571fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.461885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cbe79cba-801a-4955-ab74-f037d24571fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.471768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cbe79cba-801a-4955-ab74-f037d24571fc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1219 microversion: 2.1 time: 0.098276 Oct 04 17:52:59.473255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 491/955] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.498155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.506868 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3643c1ef-11b1-483c-911c-43547311ceb2 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1476 microversion: 2.1 time: 0.215571 Oct 04 17:52:59.509153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.509766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.516089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.516549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.516956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.527911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.528422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.529069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.529186 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 465/956] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1476 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.708949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:52:59.720453 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ccf4116-1532-40a2-a274-ba8100aa1b0a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1495 microversion: 2.1 time: 0.215537 Oct 04 17:52:59.724490 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 492/957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1495 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:52:59.747080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2e3aa0a-c4cc-4d2d-a492-4df0b9f7128c tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '.version_select at 0x7fbdbdc25430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.751067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2e3aa0a-c4cc-4d2d-a492-4df0b9f7128c tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.752500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2e3aa0a-c4cc-4d2d-a492-4df0b9f7128c tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.753253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2e3aa0a-c4cc-4d2d-a492-4df0b9f7128c tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.779085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2e3aa0a-c4cc-4d2d-a492-4df0b9f7128c tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.035798 Oct 04 17:52:59.779764 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 466/958] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:52:59.796443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:52:59.797540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:52:59.805103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.806015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.806699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.807625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:52:59.808341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:52:59.809032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:52:59.960594 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df497100-6fe7-4d57-b8b8-03df99e7003f tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1648 microversion: 2.1 time: 0.169138 Oct 04 17:52:59.977862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 493/959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:52:59 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1648 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:00.051097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-32185380", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ddc88b3c-c71e-4266-969e-2a17e558023b"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:00.154170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:00.154170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:00.167586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.168095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.168531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.170237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:00.170733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:00.171125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] validate_networks() for [('ddc88b3c-c71e-4266-969e-2a17e558023b', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:00.171645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:00.930970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:00.946196 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c48f21a5-7b8d-4a69-8cea-ba3667bf0ad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1572 microversion: 2.1 time: 0.806726 Oct 04 17:53:00.948262 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 494/960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:00 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1572 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:00.965984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da54c2a0-5d9e-4224-b21d-3f2b2ad83d10 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdab38b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.020769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:01.021201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:01.021673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:01.022109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:01.022721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:01.046390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.046877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.048025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.053007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.054847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.055295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.087283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da54c2a0-5d9e-4224-b21d-3f2b2ad83d10 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1424 microversion: 2.1 time: 0.124910 Oct 04 17:53:01.087930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 495/961] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:00 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1424 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:01.097867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:01.104830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for user ea6b89bd15d0468a920310645029d5d1 and project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:01.120348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.122290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:01.124817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:01.125601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:01.137483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.138027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.138991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.139720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.140686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.141129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.180109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:01.185509 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd0eab07-9270-4deb-a5d8-0fe3ea7c0f9e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138246 Oct 04 17:53:01.187185 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 467/962] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:01.210687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.211338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:01.227169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.227937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.228560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.230185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.232039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.232648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.344610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:01.357776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eba5f4f1-641b-45b6-8135-8b3ddaa1e121 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1271 microversion: 2.1 time: 0.258970 Oct 04 17:53:01.374238 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 496/963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:01 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:01.391776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e33d9424-c280-4a05-bd62-4b1e3581fa14 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.392401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e33d9424-c280-4a05-bd62-4b1e3581fa14 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:01.441145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:01.458785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f5cc8f2-9467-4623-a9a3-c72df9ca0b7f tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1434 microversion: 2.1 time: 0.258940 Oct 04 17:53:01.459697 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 468/964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:01 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1434 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:01.469210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2b33283-f592-4806-8920-dc88c4fb66fc", "name": "network-vif-deleted", "tag": "12e109f5-4cee-4be6-8615-054870e6a388"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:01.506809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e33d9424-c280-4a05-bd62-4b1e3581fa14 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:01.513307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:01.513808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:01.514260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:01.527308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e33d9424-c280-4a05-bd62-4b1e3581fa14 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1209 microversion: 2.1 time: 0.151845 Oct 04 17:53:01.528021 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 497/965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:01 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1209 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:01.555828 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] Creating event network-vif-deleted:12e109f5-4cee-4be6-8615-054870e6a388 for instance c2b33283-f592-4806-8920-dc88c4fb66fc on n-h2-831194-21 Oct 04 17:53:01.572907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-0a495433-7ca2-459f-a24d-e3ca0894015b req-6726e578-b052-48fb-8da7-12b74f926198 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107185 Oct 04 17:53:01.573532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 469/966] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:01.983908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:01.987273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.006565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.007077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.007524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.011453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.011848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.012295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.103436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4dda814c-ba3a-42b1-93be-0b7e60018a61 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda9f040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.154731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4dda814c-ba3a-42b1-93be-0b7e60018a61 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1433 microversion: 2.1 time: 0.055274 Oct 04 17:53:02.161896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 470/967] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1433 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:02.170343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-343f361c-49c0-4ecd-b8c1-3cc41b4fdb8d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbe3334c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.232411 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-343f361c-49c0-4ecd-b8c1-3cc41b4fdb8d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 200 len: 1433 microversion: 2.1 time: 0.065784 Oct 04 17:53:02.234740 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 471/968] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 1433 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:02.249719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.250583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.278508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.279406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.281747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.283403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.285298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.286010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.362991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.372624 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77997a26-ff67-41bb-b8ac-ad8ad73cc9c5 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1572 microversion: 2.1 time: 0.402094 Oct 04 17:53:02.373236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 498/969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:01 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1572 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:02.390051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.390837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.397465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.398060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.398559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.399369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.399891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.400449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.465816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.473934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b021db9-ace8-408c-abfb-8655077b1dd8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1277 microversion: 2.1 time: 0.088014 Oct 04 17:53:02.474534 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 499/970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:02.487007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.491281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.491986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.497399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72a062b6-8eed-4585-82b9-1b073cc8dc3e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1478 microversion: 2.1 time: 0.251689 Oct 04 17:53:02.498570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.498713 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 472/971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1478 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:02.499432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.499940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.500737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.501352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.501813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.532750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:02.537392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.538063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.538499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.538979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lazy-loading 'fault' on Instance uuid c2b33283-f592-4806-8920-dc88c4fb66fc {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:02.551630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:02.552252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:02.558322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.558808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.559435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.560300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:02.560765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:02.561196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:02.583424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.591494 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-208260a1-c7f8-4b6d-b6c2-239b4d2bc478 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1311 microversion: 2.1 time: 0.105899 Oct 04 17:53:02.592317 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 500/972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:02.640017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:02.644036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:02.649364 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f827b5be-ed07-44e9-947d-b7facd1ca4b2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1205 microversion: 2.1 time: 0.102264 Oct 04 17:53:02.649965 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 473/973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:02 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:03.396584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.397168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.404841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.405277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.405712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.406624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.407078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.407501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.499401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.500154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.510329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.511064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.511512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.512225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.512996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.513432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.756316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:03.764921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd175e31-6c98-4fb5-a6a9-bb86bf1a3fcb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.270208 Oct 04 17:53:03.766806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 474/974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:03.772205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.773007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.779242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.779934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.780521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.781380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.782025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.782599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.919977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:03.934334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-73caf864-0e9a-46e9-b381-15853021f98a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1570 microversion: 2.1 time: 0.541509 Oct 04 17:53:03.935703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 501/975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1570 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:03.943094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:03.943905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:03.951630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.952692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.953371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:03.954374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:03.955064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:03.955593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.010204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.010706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.011152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.011617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lazy-loading 'fault' on Instance uuid c2b33283-f592-4806-8920-dc88c4fb66fc {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:04.113495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:04.124954 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9635274-45ae-42ec-b341-725d07277698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1465 microversion: 2.1 time: 0.354541 Oct 04 17:53:04.125567 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 475/976] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1465 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:04.140267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.141152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:04.148354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.149104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.149705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.150590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.151205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.151824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.185897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3812f9a68f4641e19528d06742b362ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4549aa06d44e5bc01ea13ce0af167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:04.197750 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dce9e30d-dc8c-49a4-b2b1-67072b9445d3 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 200 len: 1311 microversion: 2.1 time: 0.260401 Oct 04 17:53:04.199335 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 502/977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:03 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 1311 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:04.209692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52bdd498-3f70-4009-96aa-5958a58325d3", "tag": "5823281c-e1ca-42d0-804f-e35745ec0c09"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:04.222945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.223535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.224132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.257352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] Creating event network-changed:5823281c-e1ca-42d0-804f-e35745ec0c09 for instance 52bdd498-3f70-4009-96aa-5958a58325d3 on n-h1-831194-21 Oct 04 17:53:04.270914 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-02feaab8-2a18-4936-8f45-63a9deac27aa req-42f5504b-6a15-4f23-b608-78ecd607f032 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062736 Oct 04 17:53:04.272258 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 503/978] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:04.280225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1291632064"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:04.281552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:04.290436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.291261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.291853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.293234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:04.293851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:04.294322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:04.353474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:04.375720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f11069e9-fcb3-464a-9236-e042e16fbef0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1261 microversion: 2.1 time: 0.245888 Oct 04 17:53:04.376459 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 476/979] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:04 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1261 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:04.398515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b4db89f-f505-4f25-98a2-c5cc69a4778d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda9f280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.462361 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b4db89f-f505-4f25-98a2-c5cc69a4778d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1" status: 200 len: 784 microversion: 2.1 time: 0.084738 Oct 04 17:53:04.463289 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 477/980] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:04 2022] GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1 => generated 784 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:04.476954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4faeaab9-c83b-4c76-b9ad-8020573cd97b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.485132 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4faeaab9-c83b-4c76-b9ad-8020573cd97b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012035 Oct 04 17:53:04.493735 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 478/981] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:53:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:04.499325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f193f80d-1241-489c-940d-77f5a47ca20a tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb8cee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:04.585728 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Adding security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 to port 70f78269-fa46-4503-842c-884126928285 Oct 04 17:53:05.247049 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f193f80d-1241-489c-940d-77f5a47ca20a tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "DELETE /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 204 len: 0 microversion: 2.1 time: 0.751828 Oct 04 17:53:05.247745 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 479/982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:04 2022] DELETE /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:05.257799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.258603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:05.279136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.279719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.280278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.281611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.282201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.282694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.472119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a644560-6a02-4035-941f-a82a80019847 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action" status: 202 len: 0 microversion: 2.1 time: 1.197913 Oct 04 17:53:05.472734 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 504/983] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:04 2022] POST /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1/action => generated 0 bytes in 1200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:05.481394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-unplugged", "status": "completed", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:05.501539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.502079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.502528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.535194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] Creating event network-vif-unplugged:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:53:05.540537 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ecb81646-f49c-47f5-b478-de09a635ef38 req-c1596a6b-c458-4671-be98-9f621d09eed3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063486 Oct 04 17:53:05.541627 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 505/984] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:05.547984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.548993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] [instance: c2b33283-f592-4806-8920-dc88c4fb66fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:05.561343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.562215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.562840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.563723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.564684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.565321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.586083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] HTTP exception thrown: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Request method failure captured: Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc HTTP/1.1 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLF5QSlSp34_lyQAY8Cnqn7y-o5HmdMfGTL98TXskMFcqr-P0LJY1dVwjLKauGr12ktlUWV24352tfC_EOOFiMTNzUD56m4JIUsLeb-swrvEHp0l59LD_3ZHBcMA4f_1gaic_rXp_TYs21roQGIma3cVH3kDPuX5Z8Vehx9dDRBF4M Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 93c4549aa06d44e5bc01ea13ce0af167 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:05.588786 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_93c4549aa06d44e5bc01ea13ce0af167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 93c4549aa06d44e5bc01ea13ce0af167 Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-164483590 Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminNegativeTestJSON-164483590-project Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3812f9a68f4641e19528d06742b362ae Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminNegativeTestJSON-164483590-project Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. Oct 04 17:53:05.590442 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c2b33283-f592-4806-8920-dc88c4fb66fc'} Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:05.591340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. Oct 04 17:53:05.593632 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.597627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] Returning 404 to user: Instance c2b33283-f592-4806-8920-dc88c4fb66fc could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:05.598842 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9654dfc3-5167-42f9-912d-b62f0bc01536 tempest-ServersAdminNegativeTestJSON-164483590 tempest-ServersAdminNegativeTestJSON-164483590-project] 10.222.0.42 "GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc" status: 404 len: 111 microversion: 2.1 time: 0.055933 Oct 04 17:53:05.599584 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 506/985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:05 2022] GET /compute/v2.1/servers/c2b33283-f592-4806-8920-dc88c4fb66fc => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:05.622057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb1ac702-68f6-48e2-a0db-10b156918f8c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb2cee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.673526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-eb1ac702-68f6-48e2-a0db-10b156918f8c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] HTTP exception thrown: Image not found. Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb1ac702-68f6-48e2-a0db-10b156918f8c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Request method failure captured: Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 HTTP/1.1 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLRAeh7GRsAcJ_1ZahxefEEbBt2jpOYjZ8_FKutoKok8pkfOENi8RLS7l2OiWeS_klmVtIdzw_xhqa9PCzTrZYSTlA00ve1zojiT8V8kTobDUl42rNLwIq4oBmTp_3BUKGgQBQJip2g8OH2UMmihq6voC3h6jggWMyERoPWh8Q8sW0 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:05.677792 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/482b3b1453764194bd840513ceba251f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_482b3b1453764194bd840513ceba251f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 586c9ab1fba442168f995cfb2782c587 Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '64706bb6-b78d-466e-a695-ec6c4f06d699'} Oct 04 17:53:05.679847 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:05.680941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 64706bb6-b78d-466e-a695-ec6c4f06d699 Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:05.682291 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64706bb6-b78d-466e-a695-ec6c4f06d699 could not be found. Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:05.683725 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:05.685087 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:05.688558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:05.691504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb1ac702-68f6-48e2-a0db-10b156918f8c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:05.692770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb1ac702-68f6-48e2-a0db-10b156918f8c tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 404 len: 62 microversion: 2.1 time: 0.092071 Oct 04 17:53:05.694043 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 507/986] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:05 2022] GET /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:05.702899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.705442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd81ee40-341c-4063-96a6-7b07336cfb7c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.452908 Oct 04 17:53:05.706801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:05.707807 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 480/987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:05 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:05.722718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdaf4e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:05.738861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.740128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.742563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:05.743598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:05.744824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:05.746236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.020197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:06.030557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfecc88e-d36b-45b1-8da7-cc52d867cf22 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1267 microversion: 2.1 time: 0.334749 Oct 04 17:53:06.033822 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 508/988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:05 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1267 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:06.036242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use.", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:06.036979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.036979 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342 HTTP/1.1 Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:06.040237 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: exception: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.041915 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '9d2a54fb-2d1d-49b4-ab7f-566e6766e342'} Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:06.046088 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.047536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:06.048976 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 400 to user: Security Group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 in use. Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-b8d71102-2899-4837-a453-70f4c27eb89d'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35de29c1-d516-406a-b071-286c1034d4d0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342" status: 400 len: 185 microversion: 2.1 time: 0.330182 Oct 04 17:53:06.051164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 481/989] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:05 2022] DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342 => generated 185 bytes in 331 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:06.054322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-49507865"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:06.056132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2886aaa8-9130-449e-9072-febdf7f136c1", "tag": "70f78269-fa46-4503-842c-884126928285"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:06.057281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.073343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.078451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.079028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.085602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.086149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.086600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.089990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.091203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.093322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.111295 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] Creating event network-changed:70f78269-fa46-4503-842c-884126928285 for instance 2886aaa8-9130-449e-9072-febdf7f136c1 on n-h2-831194-21 Oct 04 17:53:06.124826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1b3f37ab-8f02-494d-bfca-4dcdc13bb723 req-5bbcc894-d27e-41fc-877a-8f008e0ab40d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086616 Oct 04 17:53:06.127148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 509/990] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:06.140741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.141425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.156577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.157081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.157520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.158317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.158762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.165161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.252225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:06.460310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fba9cdd2-3ee0-4ae4-9443-a0bfaf22744a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 204 len: 0 microversion: 2.1 time: 0.330528 Oct 04 17:53:06.460919 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 510/991] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:06 2022] DELETE /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:06.472708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.473520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.491776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.500141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.501450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.502588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.503335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.503993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.525415 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cadc845b-5bb5-44bf-9276-149e7275d118 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "POST /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b/action" status: 202 len: 0 microversion: 2.1 time: 0.481586 Oct 04 17:53:06.531227 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 482/992] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:06 2022] POST /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:53:06.544239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f04f57e-12ea-46de-8fea-3077b8516f19 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdaf45e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.614432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f04f57e-12ea-46de-8fea-3077b8516f19 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.075043 Oct 04 17:53:06.617594 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 483/993] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:06.733105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:06.733877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:06.743325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.744110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.744965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.750715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:06.751506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:06.752110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:06.943743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:06.954912 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8abed3df-d7b7-4efa-8f56-f1946a941a7f tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1645 microversion: 2.1 time: 0.489264 Oct 04 17:53:06.963106 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 511/994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1645 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:07.059153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.060152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:07.075427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.080196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.080649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.081626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.085641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.086133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:07.258791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:07.267826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aef1852f-2787-4e59-aa3d-a79bb249307e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.214303 Oct 04 17:53:07.268814 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 512/995] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:07 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:07.370619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:07.382267 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc0dfc08-44fc-4a2f-8ee6-4a330e9287f8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.652798 Oct 04 17:53:07.388976 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 484/996] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:06 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:07.636521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89506005-4737-42e3-8dd1-8f7b557112a3 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd580d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.691823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89506005-4737-42e3-8dd1-8f7b557112a3 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.062094 Oct 04 17:53:07.692706 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 513/997] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:07 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:07.981106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:07.981953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:07.997409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:07.998869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:07.999391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.000349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.000818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.001313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.015312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c2a784f-482e-476d-828b-1e77d9a6f0f7", "tag": "42f2cb70-4d7b-4080-9522-f3089c3dd2f5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:08.037240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.038370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.039206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.056565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] Creating event network-changed:42f2cb70-4d7b-4080-9522-f3089c3dd2f5 for instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 on n-h2-831194-21 Oct 04 17:53:08.062337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-bfb13b7b-a560-4aa3-b95e-e77a9ea910d9 req-5a21aaeb-93fc-48e4-822c-4d9084ada22d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051026 Oct 04 17:53:08.063182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 514/998] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:08.146312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b41563a-8ab1-4067-a385-5eb03bb6c725", "tag": "3281c1fb-60ff-47a0-a8b6-d29cd5a3125d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:08.156149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.156625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.157049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.169288 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] Creating event network-changed:3281c1fb-60ff-47a0-a8b6-d29cd5a3125d for instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 on n-h2-831194-21 Oct 04 17:53:08.174283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3a490dca-3cdf-4a78-9a8e-9ef6d8e7d1d7 req-6eb759bf-075d-46bd-98c9-147baa4c30d2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Oct 04 17:53:08.175632 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 515/999] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:08.225022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:08.236556 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e18f7d16-4ef9-4568-a9d5-8e1771d83788 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1645 microversion: 2.1 time: 0.260020 Oct 04 17:53:08.240122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 485/1000] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:07 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1645 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:08.291622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.292322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:08.299142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.300396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.301306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.302361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.302823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.303247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.415405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.416023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:08.422828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.423320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.423760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.424564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:08.425153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:08.425640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:08.455441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:08.464217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6d07cf2-76c7-4693-b009-9d989ba238e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.176644 Oct 04 17:53:08.478198 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 516/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:08 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:08.690048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:08.703093 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9363bca-c14b-4701-9b72-93bac6484683 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.291063 Oct 04 17:53:08.704459 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 486/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:08 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:08.713248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0db3a43e-5d63-4171-84c6-2130a9c523f7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdc09ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:08.774868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0db3a43e-5d63-4171-84c6-2130a9c523f7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.066691 Oct 04 17:53:08.784674 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 517/1003] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:08 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:09.270127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.271153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.279821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:09.282524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.283579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.284894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.285972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.286444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.287294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.393703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:09.403831 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b4860fc-1e0f-4702-adf5-6fa7d83027ce tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1467 microversion: 2.1 time: 0.141509 Oct 04 17:53:09.405073 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 518/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1467 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:09.414122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f62950b-7304-4b23-ad9f-832eaf140181 tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T17%3A53%3A09.228062&end=2022-10-05T17%3A53%3A09.228062" status: 404 len: 112 microversion: - time: 0.182491 Oct 04 17:53:09.419315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 487/1005] 10.222.0.42 () {58 vars in 1316 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-03T17%3A53%3A09.228062&end=2022-10-05T17%3A53%3A09.228062 => generated 112 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:53:09.424959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bca79c40-fb39-4e4e-9a04-9e23d643a43a tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] Calling method '.version_select at 0x7fbdbd9a4a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.432401 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bca79c40-fb39-4e4e-9a04-9e23d643a43a tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bca79c40-fb39-4e4e-9a04-9e23d643a43a tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] Request method failure captured: Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-simple-tenant-usage/2104b0477d574d588ce4719ae440be30?start=2022-10-05T17%3A53%3A09.228062&end=2022-10-03T17%3A53%3A09.228062 HTTP/1.1 Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHMF4uTdjtrC4a_dNa5nx4H9m5fc9awH5HPyK10Zuo-BYfb_IvFXFuM5AnZnUe6Ms9PkkREwws0e6SvjV51QK4zCl8FN6-FeIbG47_gOQ8Ny4U9jL0GEhFXY1SlRTFk1qtAgZ2Jbda4dWbae_gzvXGkbPLwayz6vI0jMlALsRneVu-M Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a645da3d021648b49cecf0236057322d Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-554232940 Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:53:09.434472 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a645da3d021648b49cecf0236057322d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a645da3d021648b49cecf0236057322d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a645da3d021648b49cecf0236057322d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a645da3d021648b49cecf0236057322d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-554232940 Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a645da3d021648b49cecf0236057322d Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-554232940 Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TenantUsagesNegativeTestJSON-554232940-project-admin Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9cb7789828ba45f79449c2fbc5b35e56 Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-554232940-project-admin Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid start time. The start time cannot occur after the end time. Oct 04 17:53:09.435896 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2104b0477d574d588ce4719ae440be30'} Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 17:53:09.436664 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 04 17:53:09.437805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.438446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bca79c40-fb39-4e4e-9a04-9e23d643a43a tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:09.439508 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bca79c40-fb39-4e4e-9a04-9e23d643a43a tempest-TenantUsagesNegativeTestJSON-554232940 tempest-TenantUsagesNegativeTestJSON-554232940-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/2104b0477d574d588ce4719ae440be30?start=2022-10-05T17%3A53%3A09.228062&end=2022-10-03T17%3A53%3A09.228062" status: 400 len: 111 microversion: 2.1 time: 0.018525 Oct 04 17:53:09.440028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 519/1006] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/os-simple-tenant-usage/2104b0477d574d588ce4719ae440be30?start=2022-10-05T17%3A53%3A09.228062&end=2022-10-03T17%3A53%3A09.228062 => generated 111 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 17:53:09.489720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.491293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.499742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.500770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.502050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.505038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.506117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.506832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.512307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:09.590625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ddd0ed7-043e-4353-bfd9-62c5f9e83945 tempest-TenantUsagesNegativeTestJSON-1865042742 tempest-TenantUsagesNegativeTestJSON-1865042742-project] Calling method '.version_select at 0x7fbdbda9f160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.594641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ddd0ed7-043e-4353-bfd9-62c5f9e83945 tempest-TenantUsagesNegativeTestJSON-1865042742 tempest-TenantUsagesNegativeTestJSON-1865042742-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'de5c6914ad174327a569583255b6d467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2104b0477d574d588ce4719ae440be30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ddd0ed7-043e-4353-bfd9-62c5f9e83945 tempest-TenantUsagesNegativeTestJSON-1865042742 tempest-TenantUsagesNegativeTestJSON-1865042742-project] Request method failure captured: Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A53%3A09.228062&end=2022-10-05T17%3A53%3A09.228062&detailed=1 HTTP/1.1 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHME-RX3c3k0Klvz0Mo58_ECRPLYXM6F7tPiCtX4iC7uVslEGLivNC_8K5DNEWlDlGwXisZ0G8kh2IdmNVhI_Q3jFu6pmQaDFqy_Jw9y8TYodmV6rsxJ-zH9PoopVxviesffeX_yxnjVk_3r-XZPYV7Exxw121LSH1Qa2vzYtSDmMCU Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2104b0477d574d588ce4719ae440be30 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1865042742 Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:09.597784 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2104b0477d574d588ce4719ae440be30"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2104b0477d574d588ce4719ae440be30"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2104b0477d574d588ce4719ae440be30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2104b0477d574d588ce4719ae440be30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1865042742 Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2104b0477d574d588ce4719ae440be30 Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1865042742 Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TenantUsagesNegativeTestJSON-1865042742-project Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: de5c6914ad174327a569583255b6d467 Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1865042742-project Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:53:09.599415 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 04 17:53:09.600392 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 04 17:53:09.601588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 04 17:53:09.602838 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 04 17:53:09.602838 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:09.602838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ddd0ed7-043e-4353-bfd9-62c5f9e83945 tempest-TenantUsagesNegativeTestJSON-1865042742 tempest-TenantUsagesNegativeTestJSON-1865042742-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:09.602838 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ddd0ed7-043e-4353-bfd9-62c5f9e83945 tempest-TenantUsagesNegativeTestJSON-1865042742 tempest-TenantUsagesNegativeTestJSON-1865042742-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A53%3A09.228062&end=2022-10-05T17%3A53%3A09.228062&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.148209 Oct 04 17:53:09.602838 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 488/1007] 10.222.0.42 () {58 vars in 1335 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T17%3A53%3A09.228062&end=2022-10-05T17%3A53%3A09.228062&detailed=1 => generated 123 bytes in 150 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:09.682065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:09.692791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8181c2cb-154a-4134-8f90-d542a45bf0dc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.209487 Oct 04 17:53:09.704124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 520/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:09.728997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.729714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:09.739607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.740549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.741010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.741853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:09.742357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:09.742827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:09.792999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfd584ea-0db3-433a-bc6b-f360ab7c8ca3 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda5aa60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:09.852985 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfd584ea-0db3-433a-bc6b-f360ab7c8ca3 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.064765 Oct 04 17:53:09.855051 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 521/1009] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:09.896863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:09.904991 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4ad6b3c0-c229-4c41-856a-5e23c85dd919 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.179732 Oct 04 17:53:09.905557 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 489/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:09 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:10.107647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2886aaa8-9130-449e-9072-febdf7f136c1", "name": "network-vif-deleted", "tag": "70f78269-fa46-4503-842c-884126928285"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:10.119063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.119817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.120245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.134057 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] Creating event network-vif-deleted:70f78269-fa46-4503-842c-884126928285 for instance 2886aaa8-9130-449e-9072-febdf7f136c1 on n-h2-831194-21 Oct 04 17:53:10.139286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-77fd043d-4a6c-40fc-aa34-30ca4bc3873f req-7d9ebc98-9ee0-46ec-8c59-678ba212c9c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041283 Oct 04 17:53:10.139891 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 522/1011] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:10.432577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.433211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:10.439445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.441192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.441192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.442004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.442432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.442919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.561118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:10.569679 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0a46c71-5491-4fde-9c88-756a6d7a6ac0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 200 len: 1300 microversion: 2.1 time: 0.140993 Oct 04 17:53:10.583305 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 490/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:10.718782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.719690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:10.727985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.728615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.729172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.729931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.730600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.731107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.868650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46c410dc-8564-4b3d-a042-cfe47212fe6f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda96700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.905272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:10.918224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c11cc08d-ffea-4dd4-a9bb-4198da157ddd tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.205256 Oct 04 17:53:10.919120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 523/1013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:10.926989 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46c410dc-8564-4b3d-a042-cfe47212fe6f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.062020 Oct 04 17:53:10.927881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 491/1014] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:10.937730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:10.938465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:10.945375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.945983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.946491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:10.947255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:10.947717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:10.948139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.198430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:11.214474 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a037c411-d8a4-4e3b-ac48-6021a9dc8291 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.288968 Oct 04 17:53:11.216514 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 524/1015] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:10 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:11.477495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:11.479058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:11.485309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bdd498-3f70-4009-96aa-5958a58325d3", "name": "network-vif-plugged", "status": "completed", "tag": "5823281c-e1ca-42d0-804f-e35745ec0c09"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:11.499662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.500404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.500998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.513949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] Creating event network-vif-plugged:5823281c-e1ca-42d0-804f-e35745ec0c09 for instance 52bdd498-3f70-4009-96aa-5958a58325d3 on n-h1-831194-21 Oct 04 17:53:11.520168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f8f63a87-2278-4fb7-ad3c-36ad5ea301c2 req-963d46c3-9216-4265-ab31-62520fd4ba5a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044336 Oct 04 17:53:11.521243 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 492/1016] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:11.595999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.597603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:11.600203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=26 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:11.607131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.607625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.608496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.609203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:11.609656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:11.610197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:11.625795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 HTTP/1.1 Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:11.627835 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:11.629820 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2886aaa8-9130-449e-9072-febdf7f136c1'} Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:11.631142 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:11.632802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:11.634577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:11.634577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55b0753e-a400-4f27-8047-f83c964112e0 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 404 len: 111 microversion: 2.1 time: 0.038241 Oct 04 17:53:11.634577 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 525/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:11.641867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9af2e9d4-0067-46c0-8e35-766fc12128af tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe034790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.858019 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9af2e9d4-0067-46c0-8e35-766fc12128af tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c" status: 202 len: 0 microversion: 2.1 time: 0.220478 Oct 04 17:53:11.858787 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 493/1018] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:11 2022] DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:11.868350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e7c3ea6-de0a-4a8d-aa4a-6f0838c9373b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdb09280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.947096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb138cdb-4e42-4f99-836c-0ef54a36830f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda96af0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:11.999059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb138cdb-4e42-4f99-836c-0ef54a36830f tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.056961 Oct 04 17:53:11.999840 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 494/1019] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:12.008186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.009172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.017109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.017601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.018837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.019729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.020188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.020611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.079858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e7c3ea6-de0a-4a8d-aa4a-6f0838c9373b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342" status: 202 len: 0 microversion: 2.1 time: 0.216465 Oct 04 17:53:12.084724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 526/1020] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:11 2022] DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:12.095505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bddeb8d9-3aac-4207-a554-a5e8f5e64cbb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'create', calling method: .version_select at 0x7fbdbdb093a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-266527689", "description": "tempest-description-504041590"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:12.218567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:12.227216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a429f9b0-4762-45a0-8974-85c7bbe4c8f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.223236 Oct 04 17:53:12.227909 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 495/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:11 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:12.248760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.249402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.256848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.257347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.257788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.258545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.258984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.259399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.294166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bddeb8d9-3aac-4207-a554-a5e8f5e64cbb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.202655 Oct 04 17:53:12.298765 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 527/1022] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:53:12 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:12.313679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9422985b-8f5a-43a5-b48e-49817b78ce61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Action: 'update', calling method: .version_select at 0x7fbdbdb2c310>, body: {"security_group": {"name": "tempest-sg-hth-1950516447", "description": "tempest-description-hth-535894037"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:12.475739 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9422985b-8f5a-43a5-b48e-49817b78ce61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb" status: 200 len: 217 microversion: 2.1 time: 0.165872 Oct 04 17:53:12.476383 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 528/1023] 10.222.0.42 () {60 vars in 1290 bytes} [Tue Oct 4 17:53:12 2022] PUT /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb => generated 217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:12.484724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:12.489658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae3bac31-06ec-488b-a82f-682cc62c03d2 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdab3dc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.496670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0503d43f-0bbd-42d5-a125-5cc36fb4ee43 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.252983 Oct 04 17:53:12.497425 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 496/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:12.551787 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae3bac31-06ec-488b-a82f-682cc62c03d2 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb" status: 200 len: 217 microversion: 2.1 time: 0.066685 Oct 04 17:53:12.552373 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 529/1025] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb => generated 217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:12.566664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ba62187-e7c1-4178-a33d-c6eed8cc9f5a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdd72550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.824458 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ba62187-e7c1-4178-a33d-c6eed8cc9f5a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb" status: 202 len: 0 microversion: 2.1 time: 0.261528 Oct 04 17:53:12.824458 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 497/1026] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:12 2022] DELETE /compute/v2.1/os-security-groups/b8869bcc-a500-4c3d-9948-63882997edfb => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:12.833531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.834082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.844800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.845851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.847102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.848342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.848899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.849310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.867359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 HTTP/1.1 Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:12.869097 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.871322 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2886aaa8-9130-449e-9072-febdf7f136c1'} Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:12.874587 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.875763 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.877078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:12.877078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a57f9f63-2fa1-4357-813d-615a26c78a61 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 404 len: 111 microversion: 2.1 time: 0.042572 Oct 04 17:53:12.877078 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 530/1027] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:12 2022] DELETE /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:12.881778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:12.882444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: 2886aaa8-9130-449e-9072-febdf7f136c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:12.888800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.889535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.890195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.890898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:12.891667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:12.892104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:12.910344 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 HTTP/1.1 Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:12.912051 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.913380 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2886aaa8-9130-449e-9072-febdf7f136c1'} Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:12.914252 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. Oct 04 17:53:12.915449 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:12.916508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Instance 2886aaa8-9130-449e-9072-febdf7f136c1 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:12.916508 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e622f2c8-ac75-4f97-a58c-b7d8d6e0b82e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1" status: 404 len: 111 microversion: 2.1 time: 0.037856 Oct 04 17:53:12.916508 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 498/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:12 2022] GET /compute/v2.1/servers/2886aaa8-9130-449e-9072-febdf7f136c1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:12.922495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdc09820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.016302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad7ff4df-6259-42fa-989e-0bfb5f743e7e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda9f9d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.064292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad7ff4df-6259-42fa-989e-0bfb5f743e7e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.052126 Oct 04 17:53:13.073004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 499/1029] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:13.169077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.169793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.170447 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.170447 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342 HTTP/1.1 Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:13.172427 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.173790 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9d2a54fb-2d1d-49b4-ab7f-566e6766e342'} Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.175158 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.178583 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.180204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group 9d2a54fb-2d1d-49b4-ab7f-566e6766e342 does not exist Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-083d0dd2-9c9a-49c7-8662-65f81e80a7b1'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65e63d75-fcd5-4f18-88ad-a6b0f2fa427e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342" status: 404 len: 194 microversion: 2.1 time: 0.255310 Oct 04 17:53:13.181721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 531/1030] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:12 2022] DELETE /compute/v2.1/os-security-groups/9d2a54fb-2d1d-49b4-ab7f-566e6766e342 => generated 194 bytes in 257 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.184502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbda968b0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.211064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.212092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.212850 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.212850 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c HTTP/1.1 Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:13.215048 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.216553 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b5ee2be1-e93e-4465-9cf9-b4d51cec972c'} Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.217487 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.218782 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.220439 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group b5ee2be1-e93e-4465-9cf9-b4d51cec972c does not exist Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-06e435d2-9339-4e0c-b8a7-de144772acae'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a943134-4df1-432a-bde4-787bfa334ddb tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c" status: 404 len: 194 microversion: 2.1 time: 0.036721 Oct 04 17:53:13.222958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 500/1031] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/b5ee2be1-e93e-4465-9cf9-b4d51cec972c => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.229096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdc7c160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.256160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.256889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.260290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:13.266695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.267339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.267960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.269442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.270010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.270948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.278120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.279781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group b7517373-8dee-48a9-b15c-99376c40ac1a not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.280358 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.280358 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a HTTP/1.1 Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:13.282271 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.283565 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b7517373-8dee-48a9-b15c-99376c40ac1a'} Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.284523 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.285821 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.288720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group b7517373-8dee-48a9-b15c-99376c40ac1a does not exist Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-e385f327-c100-4b13-963b-454722da67b9'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21ff981e-1aea-4938-8cf2-4a1b99920b78 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a" status: 404 len: 194 microversion: 2.1 time: 0.058460 Oct 04 17:53:13.294793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 532/1032] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/b7517373-8dee-48a9-b15c-99376c40ac1a => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.296301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbe54eee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.319693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.320424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group bc82c18c-789a-4e04-a354-3a6e507de8d9 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.320952 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.320952 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9 HTTP/1.1 Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:13.322805 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.324114 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bc82c18c-789a-4e04-a354-3a6e507de8d9'} Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.324901 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.326032 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.328866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group bc82c18c-789a-4e04-a354-3a6e507de8d9 does not exist Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fc3d520a-9fae-48ba-adb3-69b859c2d70d'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-474f018e-f211-479f-b09f-c7f8a47e506b tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9" status: 404 len: 194 microversion: 2.1 time: 0.034332 Oct 04 17:53:13.331606 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 533/1033] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/bc82c18c-789a-4e04-a354-3a6e507de8d9 => generated 194 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.335477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdf31040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.360194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.360803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group e069fb1d-9b18-4ab2-8836-16a81112ea19 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.361331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.361331 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19 HTTP/1.1 Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:13.364426 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.365784 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e069fb1d-9b18-4ab2-8836-16a81112ea19'} Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.366597 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.367708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.368930 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group e069fb1d-9b18-4ab2-8836-16a81112ea19 does not exist Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-f3d94ebb-9429-4c59-978e-c6c06e82ef6f'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88da77b4-47fc-458b-9ac9-dac52182acd7 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19" status: 404 len: 194 microversion: 2.1 time: 0.036439 Oct 04 17:53:13.370863 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 534/1034] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/e069fb1d-9b18-4ab2-8836-16a81112ea19 => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.375665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbdb2cee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.400547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:53:13.401160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Neutron security group 30c2883d-c420-4109-a78d-caba6901e132 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:53:13.402014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.402014 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 HTTP/1.1 Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:13.404009 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.405357 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '30c2883d-c420-4109-a78d-caba6901e132'} Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.406426 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:53:13.407570 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.411375 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Security group 30c2883d-c420-4109-a78d-caba6901e132 does not exist Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-949d58b5-84b2-4d4c-b789-e2b8aa61f342'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-05c25804-db95-4578-a9d2-c70715580040 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132" status: 404 len: 194 microversion: 2.1 time: 0.034052 Oct 04 17:53:13.417181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 535/1035] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/os-security-groups/30c2883d-c420-4109-a78d-caba6901e132 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:13.419096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.419096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.430700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.431208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.431956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.432686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.433153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.433588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.466144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:13.570910 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4afda41-6916-4fa9-b957-9353dab984d4 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 204 len: 0 microversion: 2.1 time: 0.157825 Oct 04 17:53:13.575144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 536/1036] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:13 2022] DELETE /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:13.580946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.582008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.589259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.589752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.590275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.591044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.591679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.592347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.632623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:13.645690 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5bb799fe-850e-4844-bf73-d4d7f6d2892d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.394920 Oct 04 17:53:13.647837 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 501/1037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:13.666040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:13.666920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:13.682539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.683322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.683941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.685070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:13.690660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:13.692083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:13.835742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:13.844244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-963c603d-1474-47be-bdaf-1f9fc2ffc84f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1319 microversion: 2.1 time: 0.267686 Oct 04 17:53:13.844891 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 537/1038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:14.088034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6f5513d-b9c4-4de4-aa42-ca5e50117dba tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd581f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.148888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6f5513d-b9c4-4de4-aa42-ca5e50117dba tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.066527 Oct 04 17:53:14.149676 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 538/1039] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:14.356808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:14.365389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c8eb4ca-4ff1-46c7-8037-571288ce2301 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1647 microversion: 2.1 time: 0.715719 Oct 04 17:53:14.366038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 502/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:13 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1647 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:14.675609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.676294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.683048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.683535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.683966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.684672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.685116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.685536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.825245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:14.833768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b669ec16-3674-461a-9ed1-5c2fb1c12094 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.162571 Oct 04 17:53:14.834493 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 539/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:14.871533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:14.872603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:14.881599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.882569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.883151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.883961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:14.884521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:14.885019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:14.907190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:15.152635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.168211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e732245-98b0-454f-b25b-431347d75a04 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd841f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.184597 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5ce2162-9d82-4bb1-a6c2-42c4b79c38ea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1469 microversion: 2.1 time: 0.305199 Oct 04 17:53:15.184597 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 503/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:14 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:15.201323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.202034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.214368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.214874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.215324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.216048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.219773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.232003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.290290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e732245-98b0-454f-b25b-431347d75a04 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.128356 Oct 04 17:53:15.291452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 540/1043] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:15.389319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.390352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.404032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.405421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.410450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.412842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.425666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.426368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.688267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:15.722692 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94a605d5-7cbf-49c3-b90c-c8159c749ab6 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1647 microversion: 2.1 time: 0.331407 Oct 04 17:53:15.723451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 541/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1647 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:15.816170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-plugged", "status": "completed", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:15.833670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.834183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.834603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.846702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] Creating event network-vif-plugged:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:53:15.858550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f99da85c-47f0-4566-b2f4-1b1a24fdb9fb req-44450902-4896-40b2-9910-8fab3d1311dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046355 Oct 04 17:53:15.859325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 542/1045] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:15.868452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:15.869659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:15.876666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.877404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.878250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:15.879122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:15.879738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:15.880324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.067017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:16.077726 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ada356d-2a50-4692-b066-fadc79aaf1de tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.215567 Oct 04 17:53:16.091505 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 543/1046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.230274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:16.260659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3ae8a86-466c-456e-ad91-51a5168acbea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1319 microversion: 2.1 time: 1.062737 Oct 04 17:53:16.279680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 504/1047] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:15 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1319 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.308958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82758070-1c39-4666-b250-193921dccb56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb2cf70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.412483 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82758070-1c39-4666-b250-193921dccb56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.109721 Oct 04 17:53:16.413064 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 544/1048] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:16.759636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d811adac-4be7-4ec1-9923-223a9ef1383b", "name": "network-vif-deleted", "tag": "6ef46e69-542b-44a8-98a9-5babf4d49774"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:16.760473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:16.761113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:16.801847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.802872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.805506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.807162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.814445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.815573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.816565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:16.817051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:16.826486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:16.876946 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] Creating event network-vif-deleted:6ef46e69-542b-44a8-98a9-5babf4d49774 for instance d811adac-4be7-4ec1-9923-223a9ef1383b on n-h2-831194-21 Oct 04 17:53:16.890046 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-fbad3f95-8f04-4efa-9b1f-2b4a179a705a req-86071c1f-66ab-4324-8daf-6cd9cf99bdc4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133817 Oct 04 17:53:16.890649 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 545/1049] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:17.104324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:17.105027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:17.115929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.116426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.116858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.117561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.118076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.118497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.119449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f5a31af56a3498599ccfcb0858f0e82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '20921fbfd4ce4723aa15435828360aca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.132832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e641969-ded2-4080-b58b-7cbb14faaad3 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 200 len: 1301 microversion: 2.1 time: 0.385309 Oct 04 17:53:17.133425 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 505/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:16 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 1301 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:17.299138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:17.300419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:17.313223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.318407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.323556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.326302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.326985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.331433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.462604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.474292 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9605b3b1-08f2-42de-baa1-bf053848b563 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.374347 Oct 04 17:53:17.475376 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 546/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:17 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:17.480250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4617d7dd-a88f-429e-a183-c5fed51fe698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbd9a41f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:17.540994 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4617d7dd-a88f-429e-a183-c5fed51fe698 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.064438 Oct 04 17:53:17.543329 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 547/1052] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:17 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:17.690923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:17.699297 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5a7fadf-3c7d-4edc-a9ab-b98ca7ce378c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1319 microversion: 2.1 time: 0.404890 Oct 04 17:53:17.714483 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 506/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:17 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1319 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:17.914191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41563a-8ab1-4067-a385-5eb03bb6c725", "name": "network-vif-plugged", "status": "completed", "tag": "3281c1fb-60ff-47a0-a8b6-d29cd5a3125d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:17.929174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:17.930042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:17.930695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:17.947419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] Creating event network-vif-plugged:3281c1fb-60ff-47a0-a8b6-d29cd5a3125d for instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 on n-h2-831194-21 Oct 04 17:53:17.953295 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-97118a40-df6d-416a-9f96-4a8327d9fc91 req-c18ba29b-6b40-4632-ba40-7d19da498d0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042692 Oct 04 17:53:17.959725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 548/1054] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:18.159566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.160061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] [instance: d811adac-4be7-4ec1-9923-223a9ef1383b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.175853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.176554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.177158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.178728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.181312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.181949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.222817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] HTTP exception thrown: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Request method failure captured: Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b HTTP/1.1 Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHKq_xBSFPRwnlkGCp4X0IoFYA8dsm-KSJmpka0PQaGV0SY08a1RQcFGi9j497dIBDxB1KERQ0OwewDzjb63QV5-02LLiLl4YmEZHGibeCO68DIlT3xUhDVglS4He6dsJyKfHsyDhip3ObdNLofYFySftB86ghvgOLbn7W07AxfyHZs Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:18.224576 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/20921fbfd4ce4723aa15435828360aca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_20921fbfd4ce4723aa15435828360aca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 20921fbfd4ce4723aa15435828360aca Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-50897093 Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6f5a31af56a3498599ccfcb0858f0e82 Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsTestJSON-50897093-project Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. Oct 04 17:53:18.226228 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd811adac-4be7-4ec1-9923-223a9ef1383b'} Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:18.226989 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. Oct 04 17:53:18.228362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:18.230782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Returning 404 to user: Instance d811adac-4be7-4ec1-9923-223a9ef1383b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:18.231851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd6f387f-cca4-4bd4-b55d-6f6a31c9166e tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b" status: 404 len: 111 microversion: 2.1 time: 0.079322 Oct 04 17:53:18.232636 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 507/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/servers/d811adac-4be7-4ec1-9923-223a9ef1383b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:18.246213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-442817e1-da70-4f08-a043-a62a35b73555 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbd9b3af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.501647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.503954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.524303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.525418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.526254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.527326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.528011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.528854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.730727 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-442817e1-da70-4f08-a043-a62a35b73555 tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0278f449-4052-4c11-ad32-58cf7fdb005c" status: 202 len: 0 microversion: 2.1 time: 0.492478 Oct 04 17:53:18.731884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 549/1056] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:18 2022] DELETE /compute/v2.1/os-security-groups/0278f449-4052-4c11-ad32-58cf7fdb005c => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:18.738697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d513513d-469d-4026-8db2-0d6eab2f66b9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb091f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.855382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d513513d-469d-4026-8db2-0d6eab2f66b9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.118278 Oct 04 17:53:18.873260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 550/1057] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:18.879207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:18.880328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:18.891314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.893971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.894611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:18.895508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:18.896255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:18.903388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:19.117680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.133776 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12a698f1-4e55-430f-aca4-fd52767847b9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.634482 Oct 04 17:53:19.144724 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 508/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:19.160059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-858be11b-04d9-4a2e-93a2-250ce24fc41a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] Calling method '.version_select at 0x7fbdbda60820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:19.180920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:19.192064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20b0d073-d827-4271-a2c8-4cd151a7481b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1319 microversion: 2.1 time: 0.317724 Oct 04 17:53:19.192671 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 551/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:18 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1319 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:19.883179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5eb389e-4295-40e4-9ba2-abdb9ac287c8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbd9b3ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:19.957720 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5eb389e-4295-40e4-9ba2-abdb9ac287c8 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.079571 Oct 04 17:53:19.973800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 552/1060] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:19 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:19.978870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2a784f-482e-476d-828b-1e77d9a6f0f7", "name": "network-vif-plugged", "status": "completed", "tag": "42f2cb70-4d7b-4080-9522-f3089c3dd2f5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:19.994547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:19.995949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:19.996615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.011411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] Creating event network-vif-plugged:42f2cb70-4d7b-4080-9522-f3089c3dd2f5 for instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 on n-h2-831194-21 Oct 04 17:53:20.017203 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e86bd1ed-685b-4513-8b3a-7732fcc155f6 req-0543daf9-0d3c-466f-8091-3132cf764172 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041839 Oct 04 17:53:20.022888 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 553/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:20.162642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:20.163751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:20.170876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.178173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.179028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.180097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.183897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.184774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.393796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:20.414891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdc7e6e1-126e-4d24-8e66-1870b8800001 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.256341 Oct 04 17:53:20.415700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 554/1062] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:20.434117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:20.435165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:20.469373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.470091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.471485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.472350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:20.473092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:20.474357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:20.494905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-858be11b-04d9-4a2e-93a2-250ce24fc41a tempest-SecurityGroupsTestJSON-50897093 tempest-SecurityGroupsTestJSON-50897093-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/46450b6a-027b-4d5b-a13e-e0e728afb96d" status: 202 len: 0 microversion: 2.1 time: 1.348736 Oct 04 17:53:20.496195 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 509/1063] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:53:19 2022] DELETE /compute/v2.1/os-security-groups/46450b6a-027b-4d5b-a13e-e0e728afb96d => generated 0 bytes in 1351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:20.975800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1547bc84-3314-47cd-b318-f2245b6ee4d0 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb8c040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.009689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:21.020975 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4457e2fa-dafb-4de2-a13b-f0d92e2bacdc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1469 microversion: 2.1 time: 0.603822 Oct 04 17:53:21.024820 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 555/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1469 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:21.054265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.070534 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1547bc84-3314-47cd-b318-f2245b6ee4d0 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.100060 Oct 04 17:53:21.075036 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 510/1065] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:20 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:21.079350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:21.080502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Searching by: {'reservation_id': 'r-gct50qfn', 'deleted': False, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:53:21.086759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.087456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.088078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.091855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.092575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.093207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.261458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:53:21.267087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:21.391851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:21.404263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.404997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.405586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.447687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.449222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:21.469295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.470287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.473451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.476492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.477221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.477846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.676193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d101dc60-7787-460c-9def-7bf67cd54072 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?reservation_id=r-gct50qfn" status: 200 len: 2931 microversion: 2.1 time: 0.631611 Oct 04 17:53:21.676817 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 556/1066] 10.222.0.42 () {58 vars in 1197 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/servers/detail?reservation_id=r-gct50qfn => generated 2931 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:21.688527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:21.708747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.712882 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b35abd19-acd8-4a40-8436-756ab9246d31 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1309 microversion: 2.1 time: 0.273886 Oct 04 17:53:21.725571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_groups [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Querying cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) for 2 instances {{(pid=128849) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 17:53:21.725812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 511/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1309 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:21.726590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.727174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.727791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.769059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a149b8e-a444-4fc1-9166-d183211068b9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/249e5257-650c-463b-9c13-33ebb9551c51" status: 200 len: 271 microversion: 2.1 time: 0.064967 Oct 04 17:53:21.772198 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 557/1068] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/os-server-groups/249e5257-650c-463b-9c13-33ebb9551c51 => generated 271 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:21.781709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:21.782461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:21.794443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.794953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.795397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:21.797130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:21.797888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:21.798697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.071421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1500336376", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "f2090dc6-51a4-4068-ba56-fb71307f8f56"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:22.098714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8fe50b0b-fc71-4c5b-8288-1411117beadd tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 200 len: 1622 microversion: 2.1 time: 0.321011 Oct 04 17:53:22.119463 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 512/1069] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:21 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 1622 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:22.132707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7dd8099d-f990-4a5f-bc32-8dac48a29ded tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdaf4ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.192165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] validate_networks() for [('f2090dc6-51a4-4068-ba56-fb71307f8f56', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:22.200884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7dd8099d-f990-4a5f-bc32-8dac48a29ded tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.080255 Oct 04 17:53:22.201992 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 513/1070] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:22.207207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.208276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.216177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.216932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.217537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.218432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.219174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.219753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.482549 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-311ad51f-3b70-4fec-bc3d-0a1be64609ec tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1622 microversion: 2.1 time: 0.279216 Oct 04 17:53:22.519197 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 514/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1622 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:22.770567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:22.771328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:22.787675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.789089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.789862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:22.791463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:22.795002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:22.795689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.009576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:23.010258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:23.011043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:23.011621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:23.012245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:23.036635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.037450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.038245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.042016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.042709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.043330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.091664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Getting quotas for project 7b22eb2200074581a1ccabbc7f3c4fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:23.102831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Getting quotas for user 9982a2a4d7114c80bf418efb85bcbf79 and project 7b22eb2200074581a1ccabbc7f3c4fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:23.113709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:23.114032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.130239 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aee0d029-1e21-407e-a1c1-e9ee9cf4a919 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1492 microversion: 2.1 time: 0.365196 Oct 04 17:53:23.137442 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 515/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:22 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1492 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.156870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:23.164667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-559255283", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "1e11f48b-fbc6-4dad-a052-8de1fb5361d5"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:23.165203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:23.239936 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-779975b4-474e-4890-827d-3f7290fbb13a tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401772 Oct 04 17:53:23.242006 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 558/1073] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1405 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:53:23.266859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.267521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.277586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:23.278198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.278970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.279629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.281515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.282296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.284617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.645676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4788cba5-7b90-4ce8-8762-a6213d96e7ca tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1645 microversion: 2.1 time: 0.395627 Oct 04 17:53:23.646294 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 559/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1645 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.661485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-143a3258-b461-4588-899d-501dc6d11ccf tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdc7c1f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.787735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-143a3258-b461-4588-899d-501dc6d11ccf tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.140389 Oct 04 17:53:23.797900 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 560/1075] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.805424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-803f5cec-661e-419b-9844-b0621ff02979 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.806670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-803f5cec-661e-419b-9844-b0621ff02979 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.844064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:23.846677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:23.847401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:23.847986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:23.848593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:23.864745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.868424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.869452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.873426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.874156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.874761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.914708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:23.918919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-803f5cec-661e-419b-9844-b0621ff02979 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:23.927649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-803f5cec-661e-419b-9844-b0621ff02979 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1224 microversion: 2.1 time: 0.128343 Oct 04 17:53:23.927881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:23.931637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 561/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1224 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:23.936535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:23.937300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:23.950311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.950953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.951495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:23.958374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:23.961439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:23.963342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:23.963861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:23.966319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.096853 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c3f3f55a-ec58-4675-bba9-92fdb551ea65 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957163 Oct 04 17:53:24.097647 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 516/1077] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:24.114908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.121405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:24.148998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.155132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.157305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.158731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.170690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.171608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.259526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:24.321066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66cdb4e4-6094-455d-be04-354e53610910 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1645 microversion: 2.1 time: 0.387976 Oct 04 17:53:24.337661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 562/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:23 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1645 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:24.345239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77cf059b-6dd3-4da3-86bc-0286d4d70784 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.362176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77cf059b-6dd3-4da3-86bc-0286d4d70784 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:24.519504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77cf059b-6dd3-4da3-86bc-0286d4d70784 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:24.533700 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77cf059b-6dd3-4da3-86bc-0286d4d70784 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1216 microversion: 2.1 time: 0.196491 Oct 04 17:53:24.537116 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 563/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1216 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:24.539141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-564199c1-f977-47a3-9b41-cc5bb5c2155a tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 204 len: 0 microversion: 2.1 time: 0.428669 Oct 04 17:53:24.545303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 517/1080] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:24 2022] DELETE /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:24.556785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.564970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:24.566185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:24.569179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.569863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.570553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.572068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.573916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.576065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.597500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.598051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.598496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.599219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.607421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.612209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.660800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-348239f7-2d18-4736-a373-ebb3b6d8cce6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.121836 Oct 04 17:53:24.665803 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 564/1081] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:24.681020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:24.682135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:24.708164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.709799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.710370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.712846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:24.714542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:24.715074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:24.919214 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20b864bf-9e13-4e9f-b96e-fec6862b51de tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7/action" status: 202 len: 0 microversion: 2.1 time: 0.248091 Oct 04 17:53:24.920382 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 565/1082] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:24 2022] POST /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:24.933391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01179e45-672e-4f8e-a893-ce129d2ca01d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdab3160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.002523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01179e45-672e-4f8e-a893-ce129d2ca01d tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.080346 Oct 04 17:53:25.003559 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 566/1083] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:25.011203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.012464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.021313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.022362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.022975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.024150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.024878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.025558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.297865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ce4c164-e3e4-438c-8ca9-84a83a765fae tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1650 microversion: 2.1 time: 0.292389 Oct 04 17:53:25.300721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 567/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1650 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:25.328467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.330463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.339499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.340467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.341247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.342508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.343123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.343831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.469499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.500908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-265db6fd-5f6a-41ac-a0ca-70f3111c9c73 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1276 microversion: 2.1 time: 0.183599 Oct 04 17:53:25.503767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 568/1085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:25.566185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:25.567039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:25.616002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.616586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.617039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.617761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:25.618306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:25.640058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:25.793571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.807565 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-387b49e4-d264-42cd-9da7-396d1c866642 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1710 microversion: 2.1 time: 1.253266 Oct 04 17:53:25.846359 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 518/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:24 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1710 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:25.904179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:25.936346 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cdfd9909-18a9-4123-9325-779ddf86cdf1 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1220 microversion: 2.1 time: 0.378832 Oct 04 17:53:25.940556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 569/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:25 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1220 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:26.019578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6aa5f737-690a-400a-873d-e6eec6bd309b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdd72d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.099363 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6aa5f737-690a-400a-873d-e6eec6bd309b tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.084585 Oct 04 17:53:26.113889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 519/1088] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:26.324928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.325791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.340962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.344954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.345970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.348244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.351843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.353524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.529673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.530708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.560617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.561496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.562282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.563270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.563944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.565274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.732698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:26.748400 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8df18414-b4a1-46f3-a7b3-59e160da6942 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1282 microversion: 2.1 time: 0.223126 Oct 04 17:53:26.750924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 520/1089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1282 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:26.763139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b4efbfe-b4e9-4f28-9693-724d77d0959a tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1630 microversion: 2.1 time: 0.442148 Oct 04 17:53:26.766876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 570/1090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1630 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:26.790785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": true, "disk_over_commit": false}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:26.793538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.803188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.804591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.805248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.806923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.808179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.808906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.838862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:26.839479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:26.852262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.852764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.853202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.853947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:26.854391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:26.854816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:26.859118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lazy-loading 'flavor' on Instance uuid 3c2a784f-482e-476d-828b-1e77d9a6f0f7 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:26.893717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128850) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:53:27.006382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:27.559219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:27.574722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-113192c6-d656-4f0c-9e02-512da240c63e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1710 microversion: 2.1 time: 0.739626 Oct 04 17:53:27.580596 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 571/1091] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:26 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1710 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:27.594734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.595721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:27.638190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.638758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.639422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.640338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.641397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.647989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.789565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:27.803851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ccd3ef0-c426-49d9-b102-90ca72311f72 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1274 microversion: 2.1 time: 0.221768 Oct 04 17:53:27.804447 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 572/1092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:27.817801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d85b919c-045e-49d0-ba26-f35df2e1a7a2 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda5adc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.912307 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d85b919c-045e-49d0-ba26-f35df2e1a7a2 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.104964 Oct 04 17:53:27.913777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 573/1093] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:27.955756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:27.960976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:27.977990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.978498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.978943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:27.985284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:27.989438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:27.990435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.624979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:28.633962 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d14023eb-7ef1-4e15-bb84-0870e55bb0ae tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.716750 Oct 04 17:53:28.646606 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 574/1094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:27 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:28.651592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:28.652499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:28.666936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.667835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.668629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:28.669574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:28.670289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:28.670961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.121263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:29.135433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5930e63-f5d8-4a1d-972f-10f84af94288 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1710 microversion: 2.1 time: 0.486979 Oct 04 17:53:29.138131 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 575/1095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:28 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1710 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:29.147064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:29.147921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:29.155825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.156555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.157200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.158799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.159487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.160312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.405562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:29.427763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e392618-ccb7-4acc-93bc-23060b28f7c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1274 microversion: 2.1 time: 0.288250 Oct 04 17:53:29.428658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 576/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:29 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1274 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:29.453255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c9d734d-1321-4f6e-829e-c86b40af2803 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda5ad30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:29.527467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c9d734d-1321-4f6e-829e-c86b40af2803 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.097761 Oct 04 17:53:29.528978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 577/1097] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:29 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:29.674718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:29.675386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:29.684069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.688717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.690041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:29.693063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:29.693739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:29.694894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.291687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.306393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5f9517f-e0c7-4f0b-b373-4b9ca0b11c2b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.637156 Oct 04 17:53:30.307189 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 578/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:29 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:30.326820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.329190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:30.353321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.359399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.360145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.363751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.364529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.366040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.418220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:30.428246 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e4cf64a-3e33-496a-8237-ce8fd5276b33 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7/action" status: 202 len: 0 microversion: 2.1 time: 3.642639 Oct 04 17:53:30.430736 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 521/1099] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:53:26 2022] POST /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7/action => generated 0 bytes in 3646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:30.439982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.441051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:30.466161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.470813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.472995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.474415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.479801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.480578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.551206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.564381 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cca40a5-e017-42ee-b2e2-4e5274b94e61 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1642 microversion: 2.1 time: 0.247494 Oct 04 17:53:30.568094 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 579/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1642 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:30.577089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.578044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:30.612717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.613600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.614659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.617277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:30.618100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:30.619698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:30.852028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:30.864544 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e7e7009e-4d13-4fda-9da5-9f16884368bb tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1274 microversion: 2.1 time: 0.294657 Oct 04 17:53:30.879329 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 580/1101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:30.889467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1ce819e-042d-4797-a749-819ad8a32432 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbd9a4940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:30.975979 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1ce819e-042d-4797-a749-819ad8a32432 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.090381 Oct 04 17:53:30.979999 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 581/1102] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:31.023571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:31.060962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.062441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.063052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.100352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] Creating event network-changed:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:53:31.118577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-de77bf7e-9088-4083-9af3-c78885c87786 req-191910df-b9f7-4aa9-8598-43a99360d27a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123894 Oct 04 17:53:31.122659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 582/1103] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:31.268330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:31.279611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12ea37d8-026a-4502-a8b7-05ab9531effe tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.842517 Oct 04 17:53:31.280733 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 522/1104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:30 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:31.333701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.334720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:31.347275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.349969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.350513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.353420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.353968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.354408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.593672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.595740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:31.606388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.612410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.613365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.614393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.615096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.615775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.809903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:31.821194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5812348b-f3a8-4aa0-a00e-73ab2114fc40 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.493443 Oct 04 17:53:31.847284 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 583/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:31 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:31.893397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:31.894941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:31.909585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.911421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.914378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:31.916159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:31.917550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:31.918782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.161922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.169718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b78bd321-67ea-48d0-a700-068c3760f908 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.282125 Oct 04 17:53:32.172970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 584/1106] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:31 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:32.186512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfc55800-48d6-4edb-b478-3e98f99791b9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdc09550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.239076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.252820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ab17923-650d-4839-84cd-938a6aaf565c tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1642 microversion: 2.1 time: 0.662148 Oct 04 17:53:32.254571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 523/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:31 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1642 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:32.277558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfc55800-48d6-4edb-b478-3e98f99791b9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.094720 Oct 04 17:53:32.279652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 585/1108] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:32 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:32.295266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0189e380-0cf1-48ac-a3f0-d85257bff8e8", "name": "network-vif-deleted", "tag": "f7996638-fe7d-4a93-bbb6-4079da1c05ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:32.305396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.306424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:32.315262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.319461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.321496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.322962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.325091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.325917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.326951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.334534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.335351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.360537 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] Creating event network-vif-deleted:f7996638-fe7d-4a93-bbb6-4079da1c05ac for instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 on n-h1-831194-21 Oct 04 17:53:32.387721 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b6c9d0ca-05eb-4a89-8fdb-a0b24a4a2aa1 req-c1d7fb02-1132-4db3-aeff-bda14f04161b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098092 Oct 04 17:53:32.393031 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 524/1109] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:32.684732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:32.700193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fdcaabf9-29c4-48e1-a2a0-5a5fbd73bee7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.393815 Oct 04 17:53:32.717163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 586/1110] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:32 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:32.855594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:32.856477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:32.865180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.882092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.882867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:32.883914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:32.884610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:32.885262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.200879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.202135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:33.216305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.216749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.217189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.220834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.221289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.221950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.241561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:33.251827 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-88e56154-07c8-409a-b757-10b4e89fd474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.400468 Oct 04 17:53:33.271788 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 525/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:32 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:33.286219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.287159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:33.303489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.304584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.307273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.308947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.310419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.313366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.436227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.437083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.452181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.455805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lazy-loading 'fault' on Instance uuid 0189e380-0cf1-48ac-a3f0-d85257bff8e8 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:33.598989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cadc40c954a4934833da24a2ce6b293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37ef99d9be464c5ab92974d0abdbebb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:33.611399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35cf9d3c-d570-437b-9f5c-81f87a0e0077 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 200 len: 1350 microversion: 2.1 time: 0.331025 Oct 04 17:53:33.625855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 526/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 1350 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:33.627883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bcff3d7f-515a-4b10-a5d0-b4711f4161a9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda60dc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.711823 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bcff3d7f-515a-4b10-a5d0-b4711f4161a9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.093787 Oct 04 17:53:33.714013 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 527/1113] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:33.732368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:33.732994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:33.747711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.749464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.749967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.752646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:33.753129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:33.757330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:33.901509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:33.938517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:33.951980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:33.964230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a036970-1436-4f85-ae74-34d81e09a978 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.767496 Oct 04 17:53:33.968238 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 587/1114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:34.286537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.287858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.315540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.321592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.322369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.323156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.325685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.328917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.527043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:34.596318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:34.706627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:34.715504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc279399-e58b-47cc-b1f6-c9f31d813dea tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.987897 Oct 04 17:53:34.723196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 528/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:33 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:34.742992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "add46b9a-e4ce-4087-abe4-fe0da839c023", "tag": "8630bc0b-f935-41f9-a5c8-39bae62eed7a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:34.762400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.763190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.764059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.787511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] Creating event network-changed:8630bc0b-f935-41f9-a5c8-39bae62eed7a for instance add46b9a-e4ce-4087-abe4-fe0da839c023 on n-h2-831194-21 Oct 04 17:53:34.801719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-96f6adb5-92f0-4352-b9f2-c534af777a9c req-144ebddd-79f9-475a-85ec-c8894b116437 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076576 Oct 04 17:53:34.807849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:34.813975 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 529/1116] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:34.818416 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6f7c61f-9fc3-446a-8d4a-db8f36ef10c6 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.544886 Oct 04 17:53:34.819642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.820442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.838270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.839060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.839689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.840583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.841080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.841482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.842030 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 588/1117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:34.857750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e277c971-09cc-4172-bcce-606903b82807 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdc09820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.865461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 HTTP/1.1 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:34.878322 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:34.880232 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0189e380-0cf1-48ac-a3f0-d85257bff8e8'} Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:34.881330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:34.882806 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.884047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:34.884047 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc79f7bd-e6bf-47d8-9f78-8bb9bb806485 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 404 len: 111 microversion: 2.1 time: 0.064665 Oct 04 17:53:34.886958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 530/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:34.894075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.894585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.932172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.932735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.933116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.933861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:34.934319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:34.934748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:34.938060 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e277c971-09cc-4172-bcce-606903b82807 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.094207 Oct 04 17:53:34.938808 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 589/1119] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:34.961042 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 HTTP/1.1 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:34.966663 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:34.968022 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '93695d49-46d7-4f96-8944-4f3d2dc0c2f9'} Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:34.968767 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:34.972644 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:34.974229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:34.974229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-122decd7-c2e4-4dfb-a527-2eaa3223d3fd tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 404 len: 111 microversion: 2.1 time: 0.081093 Oct 04 17:53:34.974229 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 531/1120] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:34 2022] DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:34.979070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:34.979713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:34.989284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.002959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.003427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.004184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.004857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.005299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.007361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.008269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:35.018904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.019507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.020899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.022041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.023959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.025117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.034367 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 HTTP/1.1 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:35.036048 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:35.037410 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '93695d49-46d7-4f96-8944-4f3d2dc0c2f9'} Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:35.038668 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:35.041718 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:35.043915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:35.043915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c532ce2-0b79-483f-ac5b-ff27fb85f95d tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 404 len: 111 microversion: 2.1 time: 0.062956 Oct 04 17:53:35.050288 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 590/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:35.055250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bb2a5f9-ecbe-4e31-8ceb-e164083c283f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '.version_select at 0x7fbdbd9b3790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.106801 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6bb2a5f9-ecbe-4e31-8ceb-e164083c283f tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67455838" status: 202 len: 0 microversion: 2.1 time: 0.055326 Oct 04 17:53:35.107605 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 591/1122] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 17:53:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67455838 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:35.514760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:35.525860 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-153f82fd-a787-42a1-a953-d2a49c312404 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.535262 Oct 04 17:53:35.536937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 532/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:34 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:35.760239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.761268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:35.771131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.771648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.772101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.772834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.773365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.773798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.859646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:35.860981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:35.878848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.879726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.880397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:35.881433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:35.882158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:35.882817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.471504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:36.484786 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b7ab1a8-b586-4f70-8eb0-3360b7fd87db tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.629173 Oct 04 17:53:36.504396 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 533/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:35 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:36.511670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8eb49835-9a6c-4d69-b490-eee0bf9f028e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda9f9d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:36.593071 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8eb49835-9a6c-4d69-b490-eee0bf9f028e tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.087223 Oct 04 17:53:36.593878 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 534/1125] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:36 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:36.603301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "name": "network-vif-plugged", "status": "completed", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:36.636537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.637025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.637456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.663627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] Creating event network-vif-plugged:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:53:36.675903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-94a2c26c-4977-45f2-8429-78d6a2d6ef49 req-8eb64c76-e791-452e-bdb3-38b73bae1479 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080539 Oct 04 17:53:36.678890 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 535/1126] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:36.688103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:36.689672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:36.705770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.712366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.712827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:36.713570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:36.714071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:36.714493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.009087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:37.019818 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5954c70-7f67-48c2-8f78-51ce14b6bd77 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.339501 Oct 04 17:53:37.020650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 536/1127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:36 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:37.031325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2a784f-482e-476d-828b-1e77d9a6f0f7", "name": "network-vif-unplugged", "status": "completed", "tag": "42f2cb70-4d7b-4080-9522-f3089c3dd2f5"}, {"name": "network-changed", "server_uuid": "3c2a784f-482e-476d-828b-1e77d9a6f0f7", "tag": "42f2cb70-4d7b-4080-9522-f3089c3dd2f5"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:37.056862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.057202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.057474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.146816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Creating event network-vif-unplugged:42f2cb70-4d7b-4080-9522-f3089c3dd2f5 for instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 on n-h2-831194-21 Oct 04 17:53:37.151288 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] Creating event network-changed:42f2cb70-4d7b-4080-9522-f3089c3dd2f5 for instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 on n-h2-831194-21 Oct 04 17:53:37.160612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:37.166434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-dc2264ab-3e08-40cd-b73a-10f275ee30c6 req-17f2b49c-e895-4bdd-a9ef-d889e2132642 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.144420 Oct 04 17:53:37.167573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 537/1128] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:37.185586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36266d3f-9ab4-4a4e-93e8-0de6bb4886d7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 1.430492 Oct 04 17:53:37.188955 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 592/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:35 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:37.512431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.513123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:37.531966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.539534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.539997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.540764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:37.541222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:37.541655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:37.609695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae6d5795-a2b5-4554-af66-c6f1dc86d037 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbd9a4940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.682933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae6d5795-a2b5-4554-af66-c6f1dc86d037 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1427 microversion: 2.1 time: 0.077202 Oct 04 17:53:37.692121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 593/1130] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:37 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1427 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:37.886541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5283f671-0b48-4ffc-9e0e-735fc55ee99b tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.921701 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5283f671-0b48-4ffc-9e0e-735fc55ee99b tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1922826566" status: 202 len: 0 microversion: 2.1 time: 0.038922 Oct 04 17:53:37.922598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 594/1131] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:53:37 2022] DELETE /compute/v2.1/flavors/1922826566 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:53:37.924903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:37.932574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45392a89-0175-4164-95de-1e0b23195bec tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:37.966673 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c52263f-e242-4215-af9f-295d6ebfe292 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.458433 Oct 04 17:53:37.974971 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 538/1132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:37 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.005714 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45392a89-0175-4164-95de-1e0b23195bec tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.076142 Oct 04 17:53:38.006070 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 595/1133] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:53:37 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:38.028342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f7ce7c7-0d2e-4db2-aa8c-d8cf700d4cdd tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.054992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.055271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f7ce7c7-0d2e-4db2-aa8c-d8cf700d4cdd tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/192406065" status: 202 len: 0 microversion: 2.1 time: 0.030605 Oct 04 17:53:38.056226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 539/1134] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:53:38 2022] DELETE /compute/v2.1/flavors/192406065 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:38.056539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.065670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fb84af7-788e-496b-b835-a6430e331038 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.068390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.070295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.071897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.075889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.077302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.078952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.106203 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fb84af7-788e-496b-b835-a6430e331038 tempest-ServersWithSpecificFlavorTestJSON-1324111463 tempest-ServersWithSpecificFlavorTestJSON-1324111463-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044710 Oct 04 17:53:38.115778 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 540/1135] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.143230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.143772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.154478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.154974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.155416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.156121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.156577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.157000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.196462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 HTTP/1.1 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:38.198359 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.199875 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0189e380-0cf1-48ac-a3f0-d85257bff8e8'} Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:38.200690 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.202034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.204481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:38.204481 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3324735c-2073-49d8-be9c-fa1aa707de0e tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 404 len: 111 microversion: 2.1 time: 0.061568 Oct 04 17:53:38.204481 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 541/1136] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:38 2022] DELETE /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:53:38.218588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.220685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 0189e380-0cf1-48ac-a3f0-d85257bff8e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.227649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:38.230084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.230933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.231698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.232615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.233250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.233952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.257805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 HTTP/1.1 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:38.259805 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.261435 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0189e380-0cf1-48ac-a3f0-d85257bff8e8'} Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:38.262286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. Oct 04 17:53:38.267639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.269808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 0189e380-0cf1-48ac-a3f0-d85257bff8e8 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:38.269808 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54d0a9d9-f2f5-4501-bba0-91a59c9366d2 tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8" status: 404 len: 111 microversion: 2.1 time: 0.057870 Oct 04 17:53:38.269808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 542/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/0189e380-0cf1-48ac-a3f0-d85257bff8e8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:38.269808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.269808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.274926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.275402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.275834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.276519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.276965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.277391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.427902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.436141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-166f16af-996e-41ca-a68d-9f16fb06cd2a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.172216 Oct 04 17:53:38.436714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 543/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.442233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.442994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.450461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:38.457641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.458441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.458911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.459718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.459843 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-875d0e87-89aa-484e-b43b-79b916bb7766 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.417862 Oct 04 17:53:38.460247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.460407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 596/1139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.461307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.478474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 HTTP/1.1 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:38.480516 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.482249 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '93695d49-46d7-4f96-8944-4f3d2dc0c2f9'} Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:38.483041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.484507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.486569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:38.486569 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee24c0ba-9243-41cc-ac20-7fcbba54c2df tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 404 len: 111 microversion: 2.1 time: 0.046090 Oct 04 17:53:38.486569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 544/1140] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:38 2022] DELETE /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:38.497718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.499288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] [instance: 93695d49-46d7-4f96-8944-4f3d2dc0c2f9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.509271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.509928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.510227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.510936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.511390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.511821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.537208 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] HTTP exception thrown: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Request method failure captured: Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 HTTP/1.1 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHJlHhBboOw1px6-_of3oirKSi2lRi8j3oyiQGpyluzuMqZjCCShJGYh93xLl__rmlrmLDm49G57T8xTdIFCOmVhiqj8LIhbe_CbWpUDARrCQ0JbAlqwsxKXm1V716wAT_dYVeuviMNYFlCg2MdHqjUK6XYEQInPaQf8qD78lcLXjYo Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:38.541267 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_37ef99d9be464c5ab92974d0abdbebb2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 37ef99d9be464c5ab92974d0abdbebb2 Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018 Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7cadc40c954a4934833da24a2ce6b293 Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-44825018-project Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.542889 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '93695d49-46d7-4f96-8944-4f3d2dc0c2f9'} Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:38.543757 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. Oct 04 17:53:38.545948 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:38.547224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] Returning 404 to user: Instance 93695d49-46d7-4f96-8944-4f3d2dc0c2f9 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:38.547224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cffe0101-282b-49d3-ae47-033fa7dcbfce tempest-ServersWithSpecificFlavorTestJSON-44825018 tempest-ServersWithSpecificFlavorTestJSON-44825018-project] 10.222.0.42 "GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9" status: 404 len: 111 microversion: 2.1 time: 0.051338 Oct 04 17:53:38.547224 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 597/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/93695d49-46d7-4f96-8944-4f3d2dc0c2f9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:38.699969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3dc0930b-2bef-4bbe-8181-77014fe31df4 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbda60310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.799108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3dc0930b-2bef-4bbe-8181-77014fe31df4 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1436 microversion: 2.1 time: 0.102341 Oct 04 17:53:38.805025 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 545/1142] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1436 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.819214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58e7d502-5ad5-4065-83cc-4899730c1ea1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdb09280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.897459 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58e7d502-5ad5-4065-83cc-4899730c1ea1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 200 len: 1436 microversion: 2.1 time: 0.082798 Oct 04 17:53:38.899419 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 598/1143] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 1436 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:38.921744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.922400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:38.934303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.937217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.941945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.943326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:38.944085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:38.944697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:38.993379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:38.996343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:39.009648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.020848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.021633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:39.022802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.023462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.024098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:39.336492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:39.346834 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f483ab52-5478-4efe-9bd4-05271dbb20a4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1324 microversion: 2.1 time: 0.359363 Oct 04 17:53:39.368280 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 599/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:39.371457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:39.386686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e261663-78e9-4034-abbd-4c4ab9d93c53 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1465 microversion: 2.1 time: 0.477980 Oct 04 17:53:39.390268 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 546/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:38 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1465 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:39.418477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35f1e251-dce9-4c69-889d-c0eb3c42de18 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbdab3160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:39.461740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:39.463040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:39.478254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.480772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.481456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:39.484729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:39.486055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:39.486784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:39.957095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:39.974521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e7283530-0001-4d9d-bd72-3ce0479f2cff tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.517612 Oct 04 17:53:39.975095 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 547/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:39 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:39.979820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:39.980641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:40.002541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.003043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.003487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.004190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.004844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.005457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.353273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:40.364514 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-08227d64-a443-4507-86c2-f7343192d9d6 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.388096 Oct 04 17:53:40.365096 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 548/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:39 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:40.373951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e62c8032-52d6-4078-99b5-30cd03da2e93"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:40.377185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:40.401373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.403204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.403681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.404403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.404862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.409553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.415033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:40.530177 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-35f1e251-dce9-4c69-889d-c0eb3c42de18 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "DELETE /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7" status: 204 len: 0 microversion: 2.1 time: 1.115195 Oct 04 17:53:40.530670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 600/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:39 2022] DELETE /compute/v2.1/images/7fc704fd-b886-4c01-8bf6-929f5045fcd7 => generated 0 bytes in 1117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:40.539185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:40.539811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:40.555265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.555767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.556209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.565618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:40.566216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:40.566681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:40.936285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a0fca1da-41d9-4d5f-b4c9-d948bf9d69b7 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "POST /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568244 Oct 04 17:53:40.936637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 549/1149] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 17:53:40 2022] POST /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:40.948146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91a72379-d47e-496a-bb0c-f549afa2e9b7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '.version_select at 0x7fbdbd9e8790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.016184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-91a72379-d47e-496a-bb0c-f549afa2e9b7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] HTTP exception thrown: Image not found. Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91a72379-d47e-496a-bb0c-f549afa2e9b7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Request method failure captured: Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 HTTP/1.1 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLRAeh7GRsAcJ_1ZahxefEEbBt2jpOYjZ8_FKutoKok8pkfOENi8RLS7l2OiWeS_klmVtIdzw_xhqa9PCzTrZYSTlA00ve1zojiT8V8kTobDUl42rNLwIq4oBmTp_3BUKGgQBQJip2g8OH2UMmihq6voC3h6jggWMyERoPWh8Q8sW0 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:53:41.018962 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/482b3b1453764194bd840513ceba251f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_482b3b1453764194bd840513ceba251f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 586c9ab1fba442168f995cfb2782c587 Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '64706bb6-b78d-466e-a695-ec6c4f06d699'} Oct 04 17:53:41.020349 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 64706bb6-b78d-466e-a695-ec6c4f06d699 to delete Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:41.021263 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64706bb6-b78d-466e-a695-ec6c4f06d699 could not be found. Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:41.022544 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:53:41.023826 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:53:41.024961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91a72379-d47e-496a-bb0c-f549afa2e9b7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:41.026398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91a72379-d47e-496a-bb0c-f549afa2e9b7 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "DELETE /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699" status: 404 len: 62 microversion: 2.1 time: 0.088390 Oct 04 17:53:41.027155 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 550/1150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:40 2022] DELETE /compute/v2.1/images/64706bb6-b78d-466e-a695-ec6c4f06d699 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:53:41.033073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.033817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:41.056210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.056715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.057452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.064440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.065138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.065729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.124687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:41.134693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75e0fd9b-227d-4186-89fb-592b2c1b21c8 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1519 microversion: 2.1 time: 0.603113 Oct 04 17:53:41.137170 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 601/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:40 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1519 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:41.145881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.146692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:41.153113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.153915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.155708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.164403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.168819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.174814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.274358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:41.367297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:41.384915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e506d36-f749-41e8-a422-51ad0ce4d8e2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.355208 Oct 04 17:53:41.385512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 551/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:41 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:41.400521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34b7126e-8872-4b3d-8759-9ac8b939b638 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'create', calling method: .version_select at 0x7fbdbd9c49d0>, body: {"pool": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:41.435874 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3146443-6c5e-42ed-8ead-3c3dba741754 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 204 len: 0 microversion: 2.1 time: 0.293303 Oct 04 17:53:41.436925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 602/1153] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:41 2022] DELETE /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:41.448462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:41.449520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:41.459770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.460569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.461245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.462179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:41.462924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:41.463503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:41.969779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:41.978337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0cc0587-d578-45f3-8622-e5631b05f558 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.539952 Oct 04 17:53:41.991182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 603/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:41 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:42.002681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:42.003473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:42.014588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.015303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.015831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.017228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.022787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.023361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.350042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.365063 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32697a7b-ac26-45bb-aa29-22e234869ad1 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1471 microversion: 2.1 time: 0.381960 Oct 04 17:53:42.370990 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 604/1155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:41 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1471 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:42.380430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-unplugged", "status": "completed", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:42.390057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:42.394067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.394762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.395992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.412800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] Creating event network-vif-unplugged:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:53:42.432098 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e787ce6c-8805-40cd-9ff0-a8cef8aef58a req-880e3241-3f5d-415a-b8d6-5fe4e9ba9d50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049191 Oct 04 17:53:42.434725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 605/1156] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:42.449569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:42.450600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:42.468376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.482060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.486100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.486938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:42.487581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:42.489307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:42.500471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:42.853970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:42.889424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ddd9c48e-4424-4df0-a9e1-764ee1623d6c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.438640 Oct 04 17:53:42.890177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 606/1157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:42 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:43.006282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:43.006905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:43.037579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.038200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.039749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.043866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.046297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.046738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.468307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:43.479862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bcee8038-5d8a-4d53-8a2d-de2a28b4ea8c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.478329 Oct 04 17:53:43.480446 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 607/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:43 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:43.489972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:43.494807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:43.526546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.528871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.529604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.531402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.532177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.533107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.865556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:43.877763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd53c091-59f1-42a7-acc6-6365c6cc9fc9 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1471 microversion: 2.1 time: 0.395540 Oct 04 17:53:43.902244 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 608/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:43 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1471 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:43.920059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:43.920688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:43.934923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.935427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.935868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:43.936577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:43.937034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:43.937462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:44.649565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:44.659033 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18472e3c-0474-45fe-abb8-32344e3bc637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.743095 Oct 04 17:53:44.662048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 609/1160] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:43 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:44.668904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:44.675337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:44.691540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:44.692042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:44.692708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:44.693634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:44.694315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:44.694943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.166990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:45.185631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-de0985c4-5d31-443c-b45d-7249a074fa59 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.520362 Oct 04 17:53:45.207971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 610/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:44 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:45.214123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add46b9a-e4ce-4087-abe4-fe0da839c023", "name": "network-vif-plugged", "status": "completed", "tag": "8630bc0b-f935-41f9-a5c8-39bae62eed7a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:45.238654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.239155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.239605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.272394 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] Creating event network-vif-plugged:8630bc0b-f935-41f9-a5c8-39bae62eed7a for instance add46b9a-e4ce-4087-abe4-fe0da839c023 on n-h2-831194-21 Oct 04 17:53:45.279759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8e67319a-8111-4e5f-a76f-0d88cc3ffa6b req-e0249c5d-2b56-4d9a-a483-c957b1347a48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070400 Oct 04 17:53:45.280724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 611/1162] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:45.294611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:45.296102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:45.305570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.306449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.307388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.308338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.309102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.309761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.416004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:45.429176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb4decfd-15a7-4153-8faf-7ab6bfe05e78 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1429 microversion: 2.1 time: 0.145650 Oct 04 17:53:45.429806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 612/1163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:45 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1429 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:45.686482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:45.688647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:45.696493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.697032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.697623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.698361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.698882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.699394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.911376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:45.922419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd2b8c40-80e2-423a-9fff-c655f8aa295b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.240394 Oct 04 17:53:45.923533 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 613/1164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:45 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:45.933332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8834a347-65a9-445c-b3e9-69c28c52587b", "name": "network-vif-deleted", "tag": "b90a6ccd-419c-41cf-81e0-a343d002a5ec"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:45.947167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:45.948114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:45.948786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:45.969751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] Creating event network-vif-deleted:b90a6ccd-419c-41cf-81e0-a343d002a5ec for instance 8834a347-65a9-445c-b3e9-69c28c52587b on n-h2-831194-21 Oct 04 17:53:45.975556 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a3981048-6a81-4c55-af4c-2dc01ff48e54 req-348c1998-fb85-42bb-871a-18aa23a8823e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049723 Oct 04 17:53:45.976908 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 614/1165] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:46.218629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:46.220439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:46.229033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.229906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.234146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.235301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.236104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.236939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.442386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.450693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e10155a2-f44b-42a7-b3b8-fc55b6bb2f0f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1316 microversion: 2.1 time: 0.241540 Oct 04 17:53:46.451993 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 615/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:46 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1316 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:46.458901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:46.459673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:46.467070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.467811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.468393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.469286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.469929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.470504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.533121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.533684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.534173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.534659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lazy-loading 'fault' on Instance uuid 8834a347-65a9-445c-b3e9-69c28c52587b {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:53:46.608169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '586c9ab1fba442168f995cfb2782c587', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482b3b1453764194bd840513ceba251f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:46.633293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56119e78-c250-476c-bbb8-004cf52f4efa tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 200 len: 1306 microversion: 2.1 time: 0.179376 Oct 04 17:53:46.656352 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 616/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:46 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 1306 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:46.951494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:46.952119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:46.970027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.974725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.975057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:46.980921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:46.981683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:46.984419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.253164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:47.271739 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d8491dc-f091-476e-9193-b73216d68388 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1502 microversion: 2.1 time: 0.324675 Oct 04 17:53:47.282629 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 617/1168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:46 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:47.395933 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34b7126e-8872-4b3d-8759-9ac8b939b638 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.004910 Oct 04 17:53:47.396843 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 552/1169] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:53:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:47.479359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:47.480102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:47.495603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.496106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.501454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.503143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.508035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.508870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.643072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-541233933", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "f2090dc6-51a4-4068-ba56-fb71307f8f56"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:47.735244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] validate_networks() for [('f2090dc6-51a4-4068-ba56-fb71307f8f56', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:47.880403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:47.897144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff2b9555-928e-4167-9778-1577c90ed392 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1466 microversion: 2.1 time: 0.420111 Oct 04 17:53:47.898059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 618/1170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:47 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1466 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:47.912062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:47.917622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] [instance: 8834a347-65a9-445c-b3e9-69c28c52587b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:47.950349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.953886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.955197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:47.961622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:47.962438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:47.963187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.006705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] HTTP exception thrown: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Request method failure captured: Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b HTTP/1.1 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLRAeh7GRsAcJ_1ZahxefEEbBt2jpOYjZ8_FKutoKok8pkfOENi8RLS7l2OiWeS_klmVtIdzw_xhqa9PCzTrZYSTlA00ve1zojiT8V8kTobDUl42rNLwIq4oBmTp_3BUKGgQBQJip2g8OH2UMmihq6voC3h6jggWMyERoPWh8Q8sW0 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:53:48.011059 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/482b3b1453764194bd840513ceba251f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/482b3b1453764194bd840513ceba251f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_482b3b1453764194bd840513ceba251f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 482b3b1453764194bd840513ceba251f Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1379893792 Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 586c9ab1fba442168f995cfb2782c587 Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerTestJSON-1379893792-project Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. Oct 04 17:53:48.013014 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8834a347-65a9-445c-b3e9-69c28c52587b'} Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:48.013946 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. Oct 04 17:53:48.015396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:48.016931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] Returning 404 to user: Instance 8834a347-65a9-445c-b3e9-69c28c52587b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:48.016931 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9dde2c3e-e6bd-447c-bb4f-74d429a4ae56 tempest-ImagesOneServerTestJSON-1379893792 tempest-ImagesOneServerTestJSON-1379893792-project] 10.222.0.42 "GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b" status: 404 len: 111 microversion: 2.1 time: 0.111346 Oct 04 17:53:48.021587 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 619/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:47 2022] GET /compute/v2.1/servers/8834a347-65a9-445c-b3e9-69c28c52587b => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:53:48.035043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:48.035693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:48.051124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.055267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.055776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.058006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:48.058511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:48.060355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:48.950952 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ae83533-1767-4455-b974-00c7701b9af3 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1619 microversion: 2.1 time: 0.925454 Oct 04 17:53:48.966557 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 620/1172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:48 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1619 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:49.002903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:49.006116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:49.020778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.023676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.024566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.026606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.029361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.030205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.622108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:49.622636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:49.623254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:49.623941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:49.624590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:49.649862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.650549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.651033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.654468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.655213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.657688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.657941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:49.673379 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ac67305-58f3-481c-828e-6fb1d4f4904e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1477 microversion: 2.1 time: 0.704641 Oct 04 17:53:49.675345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 621/1173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:48 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1477 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:49.684225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1311731323", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["1e11f48b-fbc6-4dad-a052-8de1fb5361d5"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:49.703549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Getting quotas for project 7b22eb2200074581a1ccabbc7f3c4fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:49.713190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Getting quotas for user 9982a2a4d7114c80bf418efb85bcbf79 and project 7b22eb2200074581a1ccabbc7f3c4fb5. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:49.738561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:49.742222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:49.790278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:49.853424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b7cd138-dd90-4bee-8f7a-34a0325e58a5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.213451 Oct 04 17:53:49.865849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 553/1174] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:49.883753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46200c35-b2e6-4c49-a562-7ced9ada4bb7 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '.version_select at 0x7fbdbd9d93a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:49.890482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46200c35-b2e6-4c49-a562-7ced9ada4bb7 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:49.904631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46200c35-b2e6-4c49-a562-7ced9ada4bb7 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:49.905526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46200c35-b2e6-4c49-a562-7ced9ada4bb7 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:49.952181 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46200c35-b2e6-4c49-a562-7ced9ada4bb7 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 790 microversion: 2.1 time: 0.084745 Oct 04 17:53:49.961450 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 554/1175] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:53:49 2022] GET /compute/v2.1/os-migrations => generated 790 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:49.972846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f88d3677-2cdd-4900-ad69-b5807ed739b7 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:49.974723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f88d3677-2cdd-4900-ad69-b5807ed739b7 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:50.157517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f88d3677-2cdd-4900-ad69-b5807ed739b7 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:50.165610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f88d3677-2cdd-4900-ad69-b5807ed739b7 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1223 microversion: 2.1 time: 0.202611 Oct 04 17:53:50.166139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 555/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:49 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1223 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:50.195470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:50.196419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:50.210414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.210907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.213578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.214416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.215881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.217304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.557461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-074a0937-8640-43ed-96ce-f1c739720d93 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1630 microversion: 2.1 time: 0.379579 Oct 04 17:53:50.559601 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 556/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:50 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1630 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:50.596199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8a26848-8cb1-4996-bb57-6e7bc202fe72 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: .version_select at 0x7fbdbd9e59d0>, body: {"keypair": {"name": "tempest-keypair-866914179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGFDh3onNuHEF3QsGOKLct94qbB/tIc+FjKg+n2WdEaNB65w0aY9up4zTzOyR03bXt5ulkijoMHyYoKfi9b2Vzz8PlzPl8ZNSm44oq6eSTCo4FtiKlmRuuV0YMOpSvOHw=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:50.619553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e8a26848-8cb1-4996-bb57-6e7bc202fe72 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for project b7916c0d165d40f38d13d012e9dc627c. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:50.631359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e8a26848-8cb1-4996-bb57-6e7bc202fe72 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for user ea6b89bd15d0468a920310645029d5d1 and project b7916c0d165d40f38d13d012e9dc627c. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:50.691390 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8a26848-8cb1-4996-bb57-6e7bc202fe72 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102183 Oct 04 17:53:50.692853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 557/1178] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:50.852000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:50.852819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:50.853338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:50.853819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:50.854436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:50.872989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.873484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.873945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.874674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:50.875667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:50.876060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:50.926184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:50.934420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:50.969780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:50.973430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:51.117421 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea2997ff-907b-468c-9a5c-a1ab93eec7c0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440883 Oct 04 17:53:51.125375 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 622/1179] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:51.138053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-173344b2-0423-4772-a1a7-cfff18a0131b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:51.138924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-173344b2-0423-4772-a1a7-cfff18a0131b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:51.196302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:51.196924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:51.241764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:51.248538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:51.249001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:51.249747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:51.250335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:51.260079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:51.330407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-173344b2-0423-4772-a1a7-cfff18a0131b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:51.340777 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-173344b2-0423-4772-a1a7-cfff18a0131b tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1217 microversion: 2.1 time: 0.209004 Oct 04 17:53:51.342192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 558/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:51 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:51.699150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:51.712145 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30df994b-50b7-4955-89e8-dbba9f3f3346 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1227 microversion: 2.1 time: 0.524189 Oct 04 17:53:51.712960 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 623/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:51 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1227 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:51.911198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:51.930101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:51.933074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Searching by: {'deleted': False, 'project_id': '380038639de34db8ae85b4aeda7d02dc'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:53:51.948888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:51.949500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:51.950620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:51.953207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:51.954286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:51.955275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.044753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:53:52.072983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d967f8a3-5e17-4532-bbb7-a345026c31e0 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd9b44c0>, body: {"keypair": {"name": "tempest-keypair-1331777455", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInyPTcKMhbGR2TtDDgE+PRmamPzfJ3UPpoP1FGFYFP4UTRmOgEvGMFk5vDfrC0azHlOIC+CWBScM/pkdS0yAhFLhxcCHscOdMs2OgHgiL0ZTBMB37Ht+CYyMxu4II577Q=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:52.114444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d967f8a3-5e17-4532-bbb7-a345026c31e0 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:52.122135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d967f8a3-5e17-4532-bbb7-a345026c31e0 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:52.145994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:52.151294 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3254221d-3062-461b-86de-25fd73a37a91 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 338 microversion: 2.1 time: 0.246183 Oct 04 17:53:52.161568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 624/1182] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:53:51 2022] GET /compute/v2.1/servers => generated 338 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:52.166944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.173952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:52.175140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Searching by: {'deleted': False, 'project_id': '380038639de34db8ae85b4aeda7d02dc'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:53:52.190706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.191678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.192344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.193389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.194086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.194683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.217706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d967f8a3-5e17-4532-bbb7-a345026c31e0 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.468368 Oct 04 17:53:52.218743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 559/1183] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:52.230694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e202fdab-e861-47c2-a5c7-4f5ff39bd94e tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd9a4e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.239353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:53:52.269262 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e202fdab-e861-47c2-a5c7-4f5ff39bd94e tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1331777455" status: 200 len: 497 microversion: 2.1 time: 0.042391 Oct 04 17:53:52.269903 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 560/1184] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1331777455 => generated 497 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:52.280977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-212ee03c-0fca-4ca6-bdd4-805f5c410da7 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd9aaaf0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.312867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:52.321930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.322749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.323369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.333548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-212ee03c-0fca-4ca6-bdd4-805f5c410da7 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331777455" status: 202 len: 0 microversion: 2.1 time: 0.056155 Oct 04 17:53:52.334172 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 561/1185] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 17:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1331777455 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:53:52.354936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f5b4c91-1b1b-4b6f-b5a6-07d653dfdeaa tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd9abf70>, body: {"keypair": {"name": "tempest-keypair-115975823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOn+yWGMn1GWqaytAUpubV5FsqJRSzOUkaskyvtvuLmp31zJ9MAbvtckAaZuX24ii0U0+bIshmFGObhyziuPLLtd2wv130V3PQ9frlezpsEDSu+C4+ZRbZBpvbspU+COpg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:52.410161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9f5b4c91-1b1b-4b6f-b5a6-07d653dfdeaa tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:52.417367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9f5b4c91-1b1b-4b6f-b5a6-07d653dfdeaa tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:52.477473 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f5b4c91-1b1b-4b6f-b5a6-07d653dfdeaa tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135521 Oct 04 17:53:52.483648 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 562/1186] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:52.490898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.491560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:52.500700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.501441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.501933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.502666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.503133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.503567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.599588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:52.611348 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2745f683-d6ab-49fc-801d-59729d8b3014 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1269 microversion: 2.1 time: 0.131838 Oct 04 17:53:52.611959 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 563/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1269 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:52.625624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cc75319-6ee5-45ad-9e7b-c33a96a81f4e tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd941700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.682292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2cc75319-6ee5-45ad-9e7b-c33a96a81f4e tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-115975823" status: 202 len: 0 microversion: 2.1 time: 0.065289 Oct 04 17:53:52.683485 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 564/1188] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-115975823 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:52.694022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f32c276-9165-4ac0-8148-697a366dfb82 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd97aaf0>, body: {"keypair": {"name": "tempest-keypair-1576888982", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:52.725026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6f32c276-9165-4ac0-8148-697a366dfb82 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:52.733462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6f32c276-9165-4ac0-8148-697a366dfb82 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:52.764982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:52.788384 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f32c276-9165-4ac0-8148-697a366dfb82 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.099534 Oct 04 17:53:52.789786 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 565/1189] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:52 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:52.802325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:52.803310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:52.815793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.818427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.819091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.820751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:52.821226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:52.825166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:52.978584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:52.986743 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94e14e85-3270-46f2-8a14-27b7b8b89680 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1283 microversion: 2.1 time: 0.194373 Oct 04 17:53:52.987330 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 566/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1283 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:53.003340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89556a5f-009d-419d-b1af-e93834fefcf9 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbda77670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.034653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89556a5f-009d-419d-b1af-e93834fefcf9 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576888982" status: 202 len: 0 microversion: 2.1 time: 0.043627 Oct 04 17:53:53.036136 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 567/1191] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 17:53:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576888982 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:53.049010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c32eb50-972d-448c-a4f8-f977134f2eca tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd9411f0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1102453364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4o1b/zlWWGVt6LFFScbKjj0+ZQyA0rFt8xd/sJJxl/8CrDXIT8A8ZI0dEEqLBRAs6vrKVUd1mkL1+Uoku8GfMIYZ3KkVMGT8IfziuF/QNfU+fhI37H2mBTTWrPOIZgQw=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:53.080403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7c32eb50-972d-448c-a4f8-f977134f2eca tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:53.088431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7c32eb50-972d-448c-a4f8-f977134f2eca tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:53.140087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c32eb50-972d-448c-a4f8-f977134f2eca tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.096279 Oct 04 17:53:53.142932 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 568/1192] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:53.155951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b117123-6780-42c9-bd02-b663f93461a6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd9ab4c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1283220753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4Aj6tQZ43Tg6S+aht/t7/j7qBPvNS0HlfMc3+V+GuRfJxdD5kg+UEa3jmz6bW1Q4LgGrg/NPXhTBwSAke7DjYbv/zPUp8/FYocyx6/HDWi7nIcSrK8RIhbTVGYeokBUg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:53.185956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2b117123-6780-42c9-bd02-b663f93461a6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:53.196574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2b117123-6780-42c9-bd02-b663f93461a6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:53.241399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b117123-6780-42c9-bd02-b663f93461a6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.088908 Oct 04 17:53:53.243564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 569/1193] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:53.261616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d8b465d-9f4e-447a-9e4d-e7fba1a09d4d tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Action: 'create', calling method: .version_select at 0x7fbdbd97a790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1755060459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF8qZ1QxcY2tlSbtzESnB9mMOpS1GPCiMrLnjICfATcTfiDU1mjCKcXtsQJZXSGLqGEX4GVAqlpNHGAekCjsR/CLY4H8MFRl3pX1l3SWYOlzsgmUx49lBdgZ6xICMsrTg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:53.292950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2d8b465d-9f4e-447a-9e4d-e7fba1a09d4d tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:53.300160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2d8b465d-9f4e-447a-9e4d-e7fba1a09d4d tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Getting quotas for user 4df5584d3c5b4562bd6cf074ee09f17c and project 6711bfcc124b4f06bf24027456a1b09f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:53.331290 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d8b465d-9f4e-447a-9e4d-e7fba1a09d4d tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.078655 Oct 04 17:53:53.338268 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 570/1194] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:53:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:53:53.357064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff9be7d1-3e27-4ca4-96dd-be5ea98fa1e6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd9d93a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.362443 n-d-831194-21 devstack@n-api.service[128850]: WARNING oslo_db.sqlalchemy.utils [None req-ff9be7d1-3e27-4ca4-96dd-be5ea98fa1e6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 17:53:53.370817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff9be7d1-3e27-4ca4-96dd-be5ea98fa1e6 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.031075 Oct 04 17:53:53.372122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 571/1195] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:53.385090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24fc9f57-ca37-475e-8a37-46418b8e7b5a tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd9410d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.432954 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24fc9f57-ca37-475e-8a37-46418b8e7b5a tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1755060459" status: 202 len: 0 microversion: 2.1 time: 0.053437 Oct 04 17:53:53.438415 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 572/1196] 10.222.0.42 () {58 vars in 1278 bytes} [Tue Oct 4 17:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1755060459 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:53.446218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-09e1222f-3125-4cfc-8f8d-854a3c4d07ac tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd9abdc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.475871 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-09e1222f-3125-4cfc-8f8d-854a3c4d07ac tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1283220753" status: 202 len: 0 microversion: 2.1 time: 0.035592 Oct 04 17:53:53.476837 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 573/1197] 10.222.0.42 () {58 vars in 1278 bytes} [Tue Oct 4 17:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1283220753 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:53.504447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf79b2fe-408c-40e3-8380-2d1331fb6309 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] Calling method '.version_select at 0x7fbdbd97aa60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.536761 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf79b2fe-408c-40e3-8380-2d1331fb6309 tempest-KeyPairsV2TestJSON-367328874 tempest-KeyPairsV2TestJSON-367328874-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1102453364" status: 202 len: 0 microversion: 2.1 time: 0.054187 Oct 04 17:53:53.541503 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 574/1198] 10.222.0.42 () {58 vars in 1278 bytes} [Tue Oct 4 17:53:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1102453364 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:53:53.641647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.643134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:53.657461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.659089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.660737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.662680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:53.663866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:53.664471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:53.739272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99088120-bede-496c-a48f-8e10e1e8c5ab tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1710 microversion: 2.1 time: 1.576064 Oct 04 17:53:53.762942 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 625/1199] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:53:52 2022] GET /compute/v2.1/servers/detail => generated 1710 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:53.773276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e535fc4-9ff6-4151-b93d-2e256eb82316 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:53.791504 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e535fc4-9ff6-4151-b93d-2e256eb82316 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.022971 Oct 04 17:53:53.793130 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 626/1200] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:53:53.831434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:53.841643 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1cb38eb-2076-46c8-848f-9daa8f0a8446 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1275 microversion: 2.1 time: 0.205723 Oct 04 17:53:53.842488 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 575/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:53 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1275 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:54.019857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.023117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.043335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.045296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.046162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.047180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.048457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.049134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.167207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.167710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.184571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.185068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.185503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.186426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.186882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.187303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.264988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:53:54.423533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c0923f7-3b6e-47b7-aedd-e5dd681fb997 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 204 len: 0 microversion: 2.1 time: 0.258304 Oct 04 17:53:54.425001 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 576/1202] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:53:54 2022] DELETE /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:53:54.434385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.435161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.446123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.446839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.447289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.448001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.448466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.448883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.696598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:54.709811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-088538b0-650f-4aa1-bdf7-07241918cb12 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 0.700293 Oct 04 17:53:54.714741 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 627/1203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:54.872906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:54.873747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:54.888068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.888999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.890050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:54.891522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:54.892393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:54.893029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:55.056223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:55.095175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acd13576-b567-44aa-863b-91f419568471 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1275 microversion: 2.1 time: 0.225573 Oct 04 17:53:55.096736 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 628/1204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1275 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:55.422951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:55.439183 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24dedf33-6716-4e41-a1c1-0af97679f65e tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1713 microversion: 2.1 time: 1.009896 Oct 04 17:53:55.456378 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 577/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:54 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1713 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:55.640267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2006602070", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ddc88b3c-c71e-4266-969e-2a17e558023b"}], "security_groups": [{"name": "tempest-securitygroup--423820951"}], "key_name": "tempest-keypair-866914179", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:55.739293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:55.740629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:55.752160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:55.752860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:55.753503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:55.754419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:55.755042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:55.767125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:55.965174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] validate_networks() for [('ddc88b3c-c71e-4266-969e-2a17e558023b', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:53:56.457655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:56.476775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19e3be9b-36f7-41ff-bbb4-0ea52998910c tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 0.735475 Oct 04 17:53:56.489727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 578/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:55 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:53:56.494506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:56.495427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:56.511367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.512138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.512694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:56.513713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:56.523091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:56.523903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.170294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:53:57.171472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:53:57.177207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:53:57.178425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:53:57.179571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:53:57.213804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.214330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.214766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.223611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.224117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.224566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.276116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:53:57.284149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:57.297751 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e9c68e0-23a3-4faa-9986-c2f50b03236d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.818375 Oct 04 17:53:57.298722 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 579/1207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:56 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:57.309268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:57.309807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:57.312064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for user ea6b89bd15d0468a920310645029d5d1 and project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:53:57.327715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.328758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.329178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.330022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.330470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.331123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.364596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:53:57.369449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:53:57.502059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d307db09-b7f4-45af-a0eb-76cd91e69ef6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.861543 Oct 04 17:53:57.503837 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 629/1208] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:53:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 1868 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:53:57.510974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:57.512265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:57.530541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.530910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.532338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:57.532338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:57.532751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:57.533179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.254978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:58.271557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3a6e670-32a4-4c2a-b585-d14181452857 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 0.766132 Oct 04 17:53:58.272101 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 630/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:57 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:58.277972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0356efa-305f-4f54-b8f5-29a15848e55b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.280395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f0356efa-305f-4f54-b8f5-29a15848e55b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.443394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0356efa-305f-4f54-b8f5-29a15848e55b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:58.452211 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0356efa-305f-4f54-b8f5-29a15848e55b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1234 microversion: 2.1 time: 0.178756 Oct 04 17:53:58.455046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 631/1210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1234 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:58.569659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:58.584461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0426cea9-b9bc-48ce-bd36-f8948285a66f tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1713 microversion: 2.1 time: 1.283188 Oct 04 17:53:58.585559 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 580/1211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:57 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1713 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:58.607068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:58.608435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.631132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.631943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.634325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.636405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.636893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.637345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.761162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0add312f-a9eb-4af2-a047-0f4ab4a18e9b"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:53:58.764210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:58.779071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.779504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.779942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:58.780688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:58.781776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:58.786960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.407362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] HTTP exception thrown: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Request method failure captured: Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments/e62c8032-52d6-4078-99b5-30cd03da2e93 HTTP/1.1 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 74 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLBsumarF0axFyPomTukoy5IBpUNYx6tNoi9BEMJxaaj2wuLMp410Y8UORnCVINovlNhuC5STGXK_ffNjniWLDMEJ3xIkVcC3gBABZkeftF7dPpfGNA7XhFQsQdpSoPZvSNiAHY8Ud_e7FjWaZk3G94TIlD4F1y3vTBvi7ij547MbI Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d9d5b4db92cf453ba6e5d78cbf094131 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:53:59.411320 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d9d5b4db92cf453ba6e5d78cbf094131 Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesAdminNegativeTest-550475163-project-admin Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: fbcc048beaa44182b70ac0f2c96dd34b Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesAdminNegativeTest-550475163-project-admin Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: {"volumeAttachment": {"volumeId": "0add312f-a9eb-4af2-a047-0f4ab4a18e9b"}} Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:53:59.412685 n-d-831194-21 devstack@n-api.service[128849]: exception: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '6eec3b80-8ffb-4118-82d2-40e6a0bb51d8', 'id': 'e62c8032-52d6-4078-99b5-30cd03da2e93', 'body': {'volumeAttachment': {'volumeId': '0add312f-a9eb-4af2-a047-0f4ab4a18e9b'}}} Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:53:59.413542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. (HTTP 404) (Request-ID: req-ca502674-175e-4e4e-9c65-95df87c9ded9) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:53:59.414633 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:53:59.415799 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. Oct 04 17:53:59.418324 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:53:59.420664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Returning 400 to user: Volume 0add312f-a9eb-4af2-a047-0f4ab4a18e9b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:53:59.420664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-95b1fcc5-328f-4d22-8cdd-f5fc39420290 tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments/e62c8032-52d6-4078-99b5-30cd03da2e93" status: 400 len: 107 microversion: 2.1 time: 0.955638 Oct 04 17:53:59.420664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 632/1212] 10.222.0.42 () {60 vars in 1433 bytes} [Tue Oct 4 17:53:58 2022] PUT /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments/e62c8032-52d6-4078-99b5-30cd03da2e93 => generated 107 bytes in 958 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:53:59.424221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.427893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.461846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.462465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.462992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.467267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.467863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.468385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.689022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:53:59.904871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:53:59.928218 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87e813ee-cb72-4f7e-9939-b6fb88c9f547 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 0.511494 Oct 04 17:53:59.951471 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 633/1213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:53:59.961971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:53:59.963377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:53:59.983296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.989689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.990488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:53:59.991583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:53:59.992806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:53:59.993745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.017410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.037013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a0ac25b-b20e-4d1c-8eb0-d0ac13e9ab08 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 1.450223 Oct 04 17:54:00.040216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 581/1214] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:58 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.065731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.066951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.117680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.119194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.119876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.120941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.121591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.122293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.318861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.324183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lazy-loading 'services' on Instance uuid 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:00.331638 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1f7a2b7-aa8e-4231-a1a8-e8401fe0705b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1292 microversion: 2.1 time: 0.378820 Oct 04 17:54:00.332926 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 634/1215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:53:59 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1292 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.340559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.341177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.367750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.368530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.368971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.369680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.370182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.370610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.395892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:00.517970 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7c80091-228d-48cd-b3ac-7a5ff1ce925f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments/e62c8032-52d6-4078-99b5-30cd03da2e93" status: 202 len: 0 microversion: 2.1 time: 0.472426 Oct 04 17:54:00.522642 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 582/1216] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 17:54:00 2022] DELETE /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments/e62c8032-52d6-4078-99b5-30cd03da2e93 => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:00.557076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3", "name": "network-vif-unplugged", "status": "completed", "tag": "86cd2ab4-af1e-441f-b195-b10d26c71dd8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:00.598464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.598980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.599421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.650182 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] Creating event network-vif-unplugged:86cd2ab4-af1e-441f-b195-b10d26c71dd8 for instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 on n-h1-831194-21 Oct 04 17:54:00.680112 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-eebe6b4c-f097-4c91-8cfe-8a7657718b08 req-26a38565-f5f3-4b61-9fc8-56a2c99df2fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154595 Oct 04 17:54:00.681882 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 583/1217] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:00.689567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.691881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.698505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.699385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.699981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.700835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.701559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.702445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.751921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42d77030-7635-4417-8e30-88577fc3619f tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068483 Oct 04 17:54:00.752744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 584/1218] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:00.757405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5847b48d-6ac0-4404-920a-1ca63655a372", "tag": "1b4094e9-d428-474e-896b-9b69af6d691b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:00.769157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.769960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.770920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.784934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] Creating event network-changed:1b4094e9-d428-474e-896b-9b69af6d691b for instance 5847b48d-6ac0-4404-920a-1ca63655a372 on n-h1-831194-21 Oct 04 17:54:00.790094 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5f503020-99c1-4b95-b0d3-417db9e8f012 req-d385117c-fef5-453b-bfd9-781ac9e1d0f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036041 Oct 04 17:54:00.791244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 585/1219] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:00.932192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:00.944557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a3a1571d-32fc-463b-9854-a4c6b4c3f224 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1713 microversion: 2.1 time: 0.610237 Oct 04 17:54:00.946686 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 635/1220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1713 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:00.953685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:00.954787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:00.963218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.963862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.964449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:00.965885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:00.967826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:00.969585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.069538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.071133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.097516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.099000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.101888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.102772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.103483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.108732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.500050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.513057 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bb95be5d-7406-4c65-a3a0-d7c1cd4ea3d9 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.449458 Oct 04 17:54:01.514186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 636/1221] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.521912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.522512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.535738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:01.537540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.538381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.538814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.539536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.539986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.544168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.661964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.674679 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba238bbf-ab33-4637-aef4-539726d696f2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 0.726367 Oct 04 17:54:01.675372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 586/1222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:00 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.765050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.768009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.788568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.789247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.789705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.790493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.791014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.791383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.853259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d61e9c2-5ada-4975-bf0c-a6038879b2dc tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092228 Oct 04 17:54:01.854430 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 587/1223] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:54:01.917428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:01.926392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-73a6d2a9-7e32-4625-ad5e-e9163ce55645 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1292 microversion: 2.1 time: 0.411052 Oct 04 17:54:01.929597 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 637/1224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1292 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:01.968182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:01.969420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:01.983333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.987733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.988282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:01.989086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:01.989648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:01.996308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.342843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '50c74962551945478e624d84fbe50d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '380038639de34db8ae85b4aeda7d02dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:02.353212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2959bc25-2a89-4d10-91d3-6d329ae4dd73 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 200 len: 1645 microversion: 2.1 time: 0.389381 Oct 04 17:54:02.357162 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 588/1225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:01 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 1645 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:02.539083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:02.540417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:02.555870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.562423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.568079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.573415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.574708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.575328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.705431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:02.706504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:02.725561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.771268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.772605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:02.773630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:02.774303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:02.775948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.307958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=38 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:03.832626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:03.852283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-baf29526-6ca2-4b16-a638-29cce6dc4922 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 1.318418 Oct 04 17:54:03.881636 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 638/1226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:02 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:03.895688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:03.906605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:03.923462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.926134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.926829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:03.929101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:03.930603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:03.932076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.070425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f824543-f0fe-4138-9d89-113ae4466b43 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185381 Oct 04 17:54:04.074279 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 639/1227] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:03 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:04.090478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.092913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.105097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.105938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.116216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.132040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.132795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.136054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.525517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:04.541195 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cfaa5620-831a-4976-98a5-c821099e1558 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 1.842405 Oct 04 17:54:04.554393 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 589/1228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:02 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:04.564320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3", "name": "network-vif-deleted", "tag": "86cd2ab4-af1e-441f-b195-b10d26c71dd8"}, {"name": "network-changed", "server_uuid": "b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01", "tag": "f11c9ad1-e1be-4d4c-936e-9ba8ee65a296"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:04.577585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.578436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.580334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.611362 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Creating event network-vif-deleted:86cd2ab4-af1e-441f-b195-b10d26c71dd8 for instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 on n-h1-831194-21 Oct 04 17:54:04.615667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] Creating event network-changed:f11c9ad1-e1be-4d4c-936e-9ba8ee65a296 for instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 on n-h2-831194-21 Oct 04 17:54:04.652316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5fb34e0f-017d-4afb-aa53-f80f66dd78f6 req-1618cf9f-4634-438a-9fc0-869a25af6a32 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.107402 Oct 04 17:54:04.654525 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 590/1229] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:04.661172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.672724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] [instance: 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.697496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.698348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.698891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.699736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.700385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.700903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.716825 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] HTTP exception thrown: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Request method failure captured: Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 HTTP/1.1 Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLJ2G8g-3DSlLAHxH2kelovfwBO2pTK4gIeDpUxCp_X1hKvLgxXhIZS08HQv_7Htc89wh1aLKomPEiSKt6454qLJBq9N85KMN47Kd7BRN1oxHP51VRjAncFZU-s7PxsYr0tZhQaaI344uzGSGvP0cQvn3hs38bc8cdG1HQ7sfPNVPk Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 380038639de34db8ae85b4aeda7d02dc Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestManualDisk-1649387850 Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:54:04.719246 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/380038639de34db8ae85b4aeda7d02dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/380038639de34db8ae85b4aeda7d02dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/380038639de34db8ae85b4aeda7d02dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_380038639de34db8ae85b4aeda7d02dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestManualDisk-1649387850 Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 380038639de34db8ae85b4aeda7d02dc Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestManualDisk-1649387850 Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestManualDisk-1649387850-project Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 50c74962551945478e624d84fbe50d3a Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestManualDisk-1649387850-project Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. Oct 04 17:54:04.720659 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3'} Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:04.721529 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. Oct 04 17:54:04.723007 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:04.724601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Returning 404 to user: Instance 8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:04.725559 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d9a4b2c-f38c-4bf7-a264-22aa037951f8 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3" status: 404 len: 111 microversion: 2.1 time: 0.069695 Oct 04 17:54:04.726262 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 591/1230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/8b31e9c6-9d99-4802-8ff1-e03efdf8f3a3 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:04.735679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76148e18-351f-4222-af7a-445acaa33479 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] Calling method '.version_select at 0x7fbdbda43ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.753988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=5,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:04.763126 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76148e18-351f-4222-af7a-445acaa33479 tempest-ServersTestManualDisk-1649387850 tempest-ServersTestManualDisk-1649387850-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-663678651" status: 202 len: 0 microversion: 2.1 time: 0.031598 Oct 04 17:54:04.764495 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 592/1231] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:54:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-663678651 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:54:04.881309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:04.882139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:04.909065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.910308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.912592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:04.913484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:04.916650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:04.917225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.010716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:05.021237 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe677d1d-18b6-4efd-8a57-4d7e567c9669 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.944722 Oct 04 17:54:05.026702 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 640/1232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:05.089112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.095392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.117342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.118547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.119236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.120371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.121051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.121705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.208256 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-512c7b7c-9acf-4b04-89e4-97ac8192999e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123708 Oct 04 17:54:05.209058 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 641/1233] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:05.569994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:05.570990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:05.582464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.583267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.583878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:05.586807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:05.589471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:05.590180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.488273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.498250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9be3703d-c4c9-4012-986a-e9aaf5871dc3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 1.620710 Oct 04 17:54:06.504259 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 593/1234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:04 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:06.516178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.517063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.550952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.552556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.556891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.557937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.558602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.559226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.599865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:06.611083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3307f1f5-7088-48e4-b543-b3cb1bd536fc tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 1.041903 Oct 04 17:54:06.611712 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 642/1235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:05 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:06.617311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:06.641590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:06.657461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.664854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.667950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.668896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:06.674995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:06.675449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:06.779570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:06.808822 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aff532bf-61e1-4ed7-87d2-200e64e65906 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195035 Oct 04 17:54:06.809952 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 643/1236] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:07.254570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:07.262880 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c422e6d1-ce17-487d-a874-c9af78076254 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.757260 Oct 04 17:54:07.266592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 594/1237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:06 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:07.413276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:07.527465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.528695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.544547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.545545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.546916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.548466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.549099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.549688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.666237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbdb2c310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.669225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.670014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.672916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.726547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.728577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.737464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.788935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.789414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.791687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.808961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aca8b287-d4a8-4253-a46b-a2a0bebe476f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.397753 Oct 04 17:54:07.810343 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 644/1238] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:07.826866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:07.828050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:07.850576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.852894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.854674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:07.860078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:07.861664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:07.863297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.068669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:08.079877 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fda054e3-d16a-4851-9cdd-dc5a1702789a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.556395 Oct 04 17:54:08.080466 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 595/1239] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:54:08.096691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.098962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:08.133452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.134011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.136628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.142254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.142931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.143385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.259561 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b755b4d8-67a6-4825-bfde-63612b1d0b5a tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.178028 Oct 04 17:54:08.275897 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 596/1240] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:08.291353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbda96af0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.308427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.309357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.310947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.359031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.362092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.363001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.393933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.394607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.395180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.408819 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b625c13-5053-4cf7-966b-61a4236dd944 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1508 microversion: 2.1 time: 0.131199 Oct 04 17:54:08.422410 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 597/1241] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:08.428284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:08.444133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.445021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.445729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.449879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:08.460143 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] Creating event network-changed:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h2-831194-21 Oct 04 17:54:08.469707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1b5bd385-6270-4c23-905f-30362d0a0ca9 req-e06362f0-5655-47c7-ba08-44221be1c2c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045497 Oct 04 17:54:08.471025 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 598/1242] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:08.480415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:08.482976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:08.505235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.506046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.506715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:08.507660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:08.508362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:08.508975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.316556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.317964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:09.332525 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ffe6c145-971d-4c36-9245-0ec5a2fe01e0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.860129 Oct 04 17:54:09.333682 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 599/1243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:08 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:09.333987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c2e95f9-6ffa-4aea-85b0-250cb6e5a9fa tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 1.521887 Oct 04 17:54:09.340031 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 645/1244] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:07 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:09.347025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbda43ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.348810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.349288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.349734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.352940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.358679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.375611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.383042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.383668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.387526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.388464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.390471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.391173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.391625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.393154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.409243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.411081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.411819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.419238 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b68f229-31fb-4043-ab88-5989a21992c4 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.084650 Oct 04 17:54:09.429365 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 600/1245] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.448197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5847b48d-6ac0-4404-920a-1ca63655a372", "name": "network-vif-plugged", "status": "completed", "tag": "1b4094e9-d428-474e-896b-9b69af6d691b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:09.471996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.472464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.475179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.514192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] Creating event network-vif-plugged:1b4094e9-d428-474e-896b-9b69af6d691b for instance 5847b48d-6ac0-4404-920a-1ca63655a372 on n-h1-831194-21 Oct 04 17:54:09.523260 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9bd32c7b-f945-42be-a8cf-a119b88575ea req-6f2338a4-f27b-4274-a0e0-40a0aaa8fb6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091813 Oct 04 17:54:09.524314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 601/1246] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.532118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.537607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:09.588276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.588774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.589209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.593633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.594516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.595143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.667424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a27bff0-8899-4e75-a389-3884ac0e705d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140965 Oct 04 17:54:09.674333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 602/1247] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.685462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd941040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.687654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.688299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.688742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.717599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.724436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.725476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.736750 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-51f4cfd4-4d63-4b89-8c09-5bc796515bba tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.061192 Oct 04 17:54:09.748629 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 603/1248] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.753539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6d871900-c06a-4c81-8e29-e6fa69a169c9 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd9a4b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.755706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d871900-c06a-4c81-8e29-e6fa69a169c9 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.756387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d871900-c06a-4c81-8e29-e6fa69a169c9 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.756995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d871900-c06a-4c81-8e29-e6fa69a169c9 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.775031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6d871900-c06a-4c81-8e29-e6fa69a169c9 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.024919 Oct 04 17:54:09.784180 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 604/1249] 10.222.0.42 () {58 vars in 1179 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.789041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd9411f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.791344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.792038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.792631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.801265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:09.809902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.810642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.811231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.825623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.826400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.827963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.835211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fb07f75-1d9c-449e-b6b9-1a75abbcab34 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.049586 Oct 04 17:54:09.841743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 605/1250] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.847237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd941040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.849355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.850134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.850820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.865988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.866704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.867347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.874845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4af3c509-cb0d-4810-83f5-f1f69ad1479f tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 759 microversion: 2.1 time: 0.031594 Oct 04 17:54:09.885617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 606/1251] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 759 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.891718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd906790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.894028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.894762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.895426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.909757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.910639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.911282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.918311 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57227661-f42e-4937-ac47-75ed08901942 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.030894 Oct 04 17:54:09.929689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 607/1252] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:09.934878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Calling method '.version_select at 0x7fbdbd9a4700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:09.937207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.938070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.938727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.952518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.953421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.954129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.965233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:09.966119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:09.966762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:09.992564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84934d1e-8c5b-4d4b-bd5e-6f031e31b738 tempest-HypervisorAdminTestJSON-991323695 tempest-HypervisorAdminTestJSON-991323695-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.061064 Oct 04 17:54:10.000240 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 608/1253] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:10.052963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:10.070616 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f8dc67b-8e83-459a-b510-cb6b452ab4d0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.728986 Oct 04 17:54:10.073800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 646/1254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:09 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:10.360127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.361855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:10.365503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:10.366280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:10.379979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.383689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.384191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.384633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.385353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.385812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.386251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.387534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.388385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:10.398714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:10.401173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:10.401908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.505902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.523297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98a17b18-7ae4-456a-8e09-1cb264d5b9c7 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 1.161337 Oct 04 17:54:11.523920 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 647/1255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:10 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:11.557040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.561063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.583149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.584224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.584692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.585740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.586381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.587310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.712129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10456d90-9420-46ed-b1e0-650848cd9cc4 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164954 Oct 04 17:54:11.713240 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 648/1256] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 197 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:11.726957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:11.729360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:11.738469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.743699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.744889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.746327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:11.748532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:11.749310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:11.809937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:11.819979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29aa6746-1f61-4fde-8c59-42fe6a6114a9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1323 microversion: 2.1 time: 1.463984 Oct 04 17:54:11.829791 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 609/1257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:10 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1323 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:12.196207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:12.204563 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6fce764-c5d8-4d4b-8ae5-9bc9b6a855b0 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.489768 Oct 04 17:54:12.205169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 649/1258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:11 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:12.352870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01", "name": "network-vif-plugged", "status": "completed", "tag": "f11c9ad1-e1be-4d4c-936e-9ba8ee65a296"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:12.398972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.399467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.399964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.447397 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] Creating event network-vif-plugged:f11c9ad1-e1be-4d4c-936e-9ba8ee65a296 for instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 on n-h2-831194-21 Oct 04 17:54:12.469330 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-be0aa155-a1b7-4247-8a1c-07439383b0ac req-1d1ea47e-2894-4b27-8cb3-f20438192ad4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125811 Oct 04 17:54:12.472457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 610/1259] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:12.554546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.555293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.574295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.599118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.609135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.614098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.615549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.617860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.729608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.734608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.760364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.761613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.763733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.770434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.772738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.773508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.830273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-441749a6-1d5f-4a51-8adb-f0e9421adf18 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108522 Oct 04 17:54:12.831285 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 611/1260] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:54:12.852797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:12.854728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:12.872488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.873330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.874086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:12.876543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:12.877250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:12.878163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.335803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.346110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3eaa3317-b201-4d24-82d5-8f2bc3dba0d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.797590 Oct 04 17:54:13.348062 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 650/1261] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:13.357378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-179176073", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "9468212d-5a59-4dfa-b7c2-970aea85b0ac"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:13.415552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:13.434635 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a8499494-59ec-4f39-83ab-58e4731383c3 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 200 len: 1518 microversion: 2.1 time: 0.589325 Oct 04 17:54:13.435257 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 612/1262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:12 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 1518 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:13.440762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:13.441333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:13.456284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.456780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.457208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.457945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:13.458401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:13.458823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:13.461207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] validate_networks() for [('9468212d-5a59-4dfa-b7c2-970aea85b0ac', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:14.028331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:14.038504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae5a6b77-f55c-440a-9e91-3ea8d2a65e57 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1317 microversion: 2.1 time: 0.602057 Oct 04 17:54:14.060839 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 613/1263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:13 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1317 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:14.081683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: .version_select at 0x7fbdbf75e3a0>, body: {"addFloatingIp": {"address": "172.25.5.66"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:14.084586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:14.103143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.103895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.104508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.105376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:14.106076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:14.106661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:14.300071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:54:14.300482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquired lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:54:15.421425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:15.422085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:15.422809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:15.423229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:15.423646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:15.443914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.444511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.445017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.445809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.448434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.454505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.495389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for project 8131bad014684bb0973ae16c4aad02d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:15.514218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Getting quotas for user deedb2b40cc946c18b21f6859166f286 and project 8131bad014684bb0973ae16c4aad02d5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:15.547340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:15.556886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:15.652306 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e2384dbf-e0d8-4ab1-81d9-cfc76950abdb tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301593 Oct 04 17:54:15.658262 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 651/1264] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:54:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:54:15.668481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:15.672123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:15.684379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.687617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.688286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:15.689032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:15.689506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:15.692033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.276141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.312158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aee97603-9060-4a0f-8ddc-61707989c7ae tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.644979 Oct 04 17:54:16.313302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 652/1265] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:15 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:16.320455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:16.321137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:16.331698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.336600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.344032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.346438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:16.346993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:16.347639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:16.793304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:16.801196 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8023fd3-d5f3-4b09-8e01-5afec8a74664 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1467 microversion: 2.1 time: 0.486718 Oct 04 17:54:16.806122 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 653/1266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:16 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1467 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:17.077763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:17.384916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49fbfe31-9a66-45e4-ae87-4fa56bf25414 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7a2700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-386143336", "description": "tempest-description-1550964437"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:18.132456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Updating instance_info_cache with network_info: [{"id": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40", "address": "fa:16:3e:4a:cf:4a", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04dd7bce-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:18.160423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Releasing lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:54:18.161607 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70a1af08-e74c-4155-bbcb-8b68a6dd92cb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action" status: 202 len: 0 microversion: 2.1 time: 4.098326 Oct 04 17:54:18.162817 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 614/1267] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:14 2022] POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action => generated 0 bytes in 4101 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:54:18.168125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:18.169070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.184529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.185310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.185946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.186831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.190878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.191386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.296876 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49fbfe31-9a66-45e4-ae87-4fa56bf25414 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.489354 Oct 04 17:54:18.298213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 654/1268] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:18.303047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:18.303745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.310396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.311277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.312131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.313101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.313777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.314452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.491323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:18.544980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5046adc4-b587-4475-9ca8-2805fd69c511 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1213 microversion: 2.1 time: 0.376888 Oct 04 17:54:18.561178 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 615/1269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:18 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1213 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:18.561178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:18.605821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.607101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.615092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.678910 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2bce2343-f910-4198-9f3a-21a7349ba275 tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1620 microversion: 2.1 time: 0.379359 Oct 04 17:54:18.679697 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 655/1270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:18 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1620 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:18.682983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] Creating event network-changed:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:54:18.695854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:18.696487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.702771 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8009ee23-f7d2-4948-bac9-226abc5db436 req-6db690be-8067-491f-bfdf-6bf2c3ac0653 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149850 Oct 04 17:54:18.704212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 616/1271] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:18.710796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.66"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:18.715185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:18.722540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.726640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.727762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.730242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.731318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.734068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.752478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.758963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.767946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.784395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:18.788566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:18.791896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:18.866146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:54:18.866852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquired lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:54:19.255882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:19.268540 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6dab615-4be0-4856-94d4-7ef330dd0a80 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.579253 Oct 04 17:54:19.269517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 656/1272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:18 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:19.280355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0e2edbc-90b4-4fd0-a13f-f7899678c3e7 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbdb2cca0>, body: {"security_group_rule": {"parent_group_id": "5f5e14a1-5f28-4c7d-8e35-e54f0e2cc30a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:19.898434 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0e2edbc-90b4-4fd0-a13f-f7899678c3e7 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.627520 Oct 04 17:54:19.899114 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 657/1273] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:19.905775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1459155288", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "1e11f48b-fbc6-4dad-a052-8de1fb5361d5"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:20.087628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:20.719800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:20.720226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:20.720894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:20.721306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:20.721719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:20.733916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.735050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.735670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.737025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.737689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.738311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.759126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:20.765860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Getting quotas for user b63f236c86fc48dca2ec03eca543d7c9 and project 468f9964fe8b4cd8a635b9ae8ae67fda. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:20.802540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:20.809614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:20.916506 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-945e71a5-56bd-41c5-8969-2feb871f0df3 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.015869 Oct 04 17:54:20.918873 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 658/1274] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:54:20.927468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "name": "network-vif-plugged", "status": "completed", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:20.943340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:20.944364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:20.945113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:20.969346 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] Creating event network-vif-plugged:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h2-831194-21 Oct 04 17:54:20.976990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2831d4af-a958-4740-a816-063e4f08072e req-641f4b55-71d0-4093-a368-bcfa313eafe8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056486 Oct 04 17:54:20.978196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 659/1275] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:21.009433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:21.021197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:21.034415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.036649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.037576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.039075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:21.040585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:21.041253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:21.298457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:21.315783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3fa6711-4420-49bc-994b-06ba04507c58 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1275 microversion: 2.1 time: 0.335819 Oct 04 17:54:21.337276 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 660/1276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:20 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1275 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:21.342840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c55769c-3535-468b-900e-f2ee7c37622f tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7a20d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-521749908", "description": "tempest-description-1066461027"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:22.057150 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c55769c-3535-468b-900e-f2ee7c37622f tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.718632 Oct 04 17:54:22.058499 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 661/1277] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:22.064507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.065407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.086921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.087748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.090442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.091381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.093760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.095366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.577160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:22.585981 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-828ade6d-f07f-443e-b487-8c7eed452d59 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1359 microversion: 2.1 time: 0.526035 Oct 04 17:54:22.586566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 662/1278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1359 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:22.609701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:22.610423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:22.642677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.649867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.650762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:22.660203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:22.661248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:22.662413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:23.334263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:23.344629 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c990686f-4072-4c31-befa-eb93a000841e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1269 microversion: 2.1 time: 0.756558 Oct 04 17:54:23.350940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 663/1279] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:22 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1269 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:23.362845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d52187f3-0e0d-4025-a78d-273bbb897415 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7f6790>, body: {"security_group_rule": {"parent_group_id": "74569572-e493-47ff-9a07-7258c298f458", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:24.335439 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d52187f3-0e0d-4025-a78d-273bbb897415 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.982979 Oct 04 17:54:24.337703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 664/1280] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:23 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:24.343115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.343994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.373364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.382305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.383738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.386735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.389366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.391484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.856961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:24.865656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b90be05f-c9b8-4968-a273-76d4aad22689 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.526675 Oct 04 17:54:24.866273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 665/1281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:24 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:24.880328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:24.883495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:24.923798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.928004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.929788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:24.932142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:24.938931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:24.940832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:25.027220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:25.654045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:25.673907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7f36b70-56f7-4bbf-8601-f92fb4565804 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1542 microversion: 2.1 time: 0.805358 Oct 04 17:54:25.679475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 666/1282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:24 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1542 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:25.734181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c39edeea-b7cf-409d-96fc-e2b176b1c2cc tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbda5aa60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1001104240", "description": "tempest-description-1602805618"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:26.356626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c39edeea-b7cf-409d-96fc-e2b176b1c2cc tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.651281 Oct 04 17:54:26.372063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 667/1283] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:25 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:26.380131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:26.381723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:26.393255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.394446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.395906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.397476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.398490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.400701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.570158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:26.585016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b349d535-7acc-4293-9168-dc344d55f2ef tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1275 microversion: 2.1 time: 0.209465 Oct 04 17:54:26.586533 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 668/1284] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:26 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1275 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:26.593329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:26.594367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:26.603126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.603968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.604631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:26.606073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:26.609096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:26.609905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.619735 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.network.neutron [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] re-assign floating IP 172.25.5.66 from instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 Oct 04 17:54:27.656048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da9a25b5-c589-4db0-be2d-b65a3d401b06 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.066300 Oct 04 17:54:27.657358 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 669/1285] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:54:26 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-interface => generated 284 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:27.682948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:27.685332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:27.719346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.722764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.723659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.724770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:27.725706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:27.727202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:27.791405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:28.236255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:28.248908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-246bdcaf-8e15-484b-8963-b85daaedf124 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.589804 Oct 04 17:54:28.257500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 670/1286] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:27 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:28.270112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-741f7bf1-5588-4fcf-bff8-6dbd8ac1461e tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7f69d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-963594927", "description": "tempest-description-1309341845"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:28.729282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=56 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:28.889969 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-741f7bf1-5588-4fcf-bff8-6dbd8ac1461e tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.628804 Oct 04 17:54:28.893487 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 671/1287] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:28.904963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:28.929671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:28.940946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:28.941578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:28.959433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] Creating event network-changed:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:54:28.970272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2f3f709c-9732-42f3-b01f-948c49d93310 req-b01c8ed4-83b8-49e4-bea9-d144500bac60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074295 Oct 04 17:54:28.971083 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 672/1288] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:28.986686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:28.987665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:29.018541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.022501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.023142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.024061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:29.028567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:29.030059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:29.472453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:29.492333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e89496a7-19aa-495f-9b80-72fb66060fc8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.500939 Oct 04 17:54:29.493631 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 673/1289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:28 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:29.502085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dec3fd9d-bf11-4beb-86d5-c142a90cd8f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7f68b0>, body: {"security_group_rule": {"parent_group_id": "48fcdb8c-1476-46d0-b477-6a125d3432cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "38a41f75-fbed-4e0a-b9a7-8af794b046d9"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:30.485995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dec3fd9d-bf11-4beb-86d5-c142a90cd8f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.990319 Oct 04 17:54:30.487903 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 674/1290] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:29 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:30.492990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:30.493909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:30.501809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.502597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.503273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.504227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:30.504906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:30.506041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:30.749354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:30.762708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:30.776071 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef7d75e7-e875-4bbb-8913-a294739dba6e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.286491 Oct 04 17:54:30.777524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 675/1291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:30 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:30.790573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:31.023543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Updating instance_info_cache with network_info: [{"id": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40", "address": "fa:16:3e:4a:cf:4a", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04dd7bce-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:31.036752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:31.064241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-163091202", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "0fbc2cd6-4b6c-4457-b74c-6928dfaa420c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:31.179033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] validate_networks() for [('0fbc2cd6-4b6c-4457-b74c-6928dfaa420c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:32.556470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:32.557052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:32.557471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:32.558098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:32.558685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:32.569080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:32.591170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:32.592041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:32.593607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:32.596328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:32.596989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:32.598068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:32.651406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:32.674888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for user bdb5e71c56fa43c8aa71bc62264aaf69 and project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:32.712355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:32.714770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:32.838516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8f76928-9879-4eba-9b35-05195e10844a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057713 Oct 04 17:54:32.842390 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 676/1292] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:54:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:54:32.847164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6404d86-1889-41b3-890d-2a66d2aa42d5 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7f65e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-381124058", "description": "tempest-description-1376117637"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:33.665720 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6404d86-1889-41b3-890d-2a66d2aa42d5 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.821695 Oct 04 17:54:33.667759 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 677/1293] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:32 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:33.687585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:33.692738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:33.736764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.739790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.740881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.744388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:33.749054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:33.752775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:33.930739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Updating instance_info_cache with network_info: [{"id": "1b4094e9-d428-474e-896b-9b69af6d691b", "address": "fa:16:3e:f0:cb:f9", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1b4094e9-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:33.948233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Releasing lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:54:33.952178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53027815-e272-4ac9-8cd9-3df1f5e41ce1 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372/action" status: 202 len: 0 microversion: 2.1 time: 15.244046 Oct 04 17:54:33.960824 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 617/1294] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:18 2022] POST /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372/action => generated 0 bytes in 15253 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:54:33.971664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5847b48d-6ac0-4404-920a-1ca63655a372", "tag": "1b4094e9-d428-474e-896b-9b69af6d691b"}, {"name": "network-changed", "server_uuid": "333fa54f-7eca-4683-919e-5aaa85cde326", "tag": "55f0a861-e42e-4579-af97-4d6d3413a506"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:34.000413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.004433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.005342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.038832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Creating event network-changed:1b4094e9-d428-474e-896b-9b69af6d691b for instance 5847b48d-6ac0-4404-920a-1ca63655a372 on n-h1-831194-21 Oct 04 17:54:34.040254 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] Creating event network-changed:55f0a861-e42e-4579-af97-4d6d3413a506 for instance 333fa54f-7eca-4683-919e-5aaa85cde326 on n-h1-831194-21 Oct 04 17:54:34.060922 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4ea7d985-72d3-475e-af6a-68e92064b46b req-252de917-e908-4b31-ab36-4dcdc5ca1fa0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.094260 Oct 04 17:54:34.064899 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 618/1295] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:34.084237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:34.085941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:34.105074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.108518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.109339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.112313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:34.114274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:34.114969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:34.193543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:34.202779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3695385d-ce3e-4b59-ba3f-19407a9067ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.533355 Oct 04 17:54:34.206594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 678/1296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:33 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:34.248557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-293242015", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "0fbc2cd6-4b6c-4457-b74c-6928dfaa420c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:34.376564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] validate_networks() for [('0fbc2cd6-4b6c-4457-b74c-6928dfaa420c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:35.009620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:35.020814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e6c96c5-f9fc-40f4-bbe2-24454d80d11d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.954079 Oct 04 17:54:35.027127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 619/1297] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:34 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:35.033547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6387e9c8-bd57-480d-894e-b7f70dd8eba0 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbda96790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1906906426", "description": "tempest-description-1886486756"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:35.430096 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6387e9c8-bd57-480d-894e-b7f70dd8eba0 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.400921 Oct 04 17:54:35.431660 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 620/1298] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:35 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:35.437668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: .version_select at 0x7fbdbf75e4c0>, body: {"removeFloatingIp": {"address": "172.25.5.66"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:35.877456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:35.878621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:35.879264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:35.880174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:35.880879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:35.892822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.893608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.907061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.908209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:35.911057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:35.911671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:35.965226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:35.985296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for user bdb5e71c56fa43c8aa71bc62264aaf69 and project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:36.010835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:36.018011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:36.137290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33758f02-9b8c-4ed7-a566-d1301ff35fab tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.903294 Oct 04 17:54:36.149992 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 679/1299] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:54:36.157666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:36.158570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:36.165754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.166579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.168002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.170394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.171078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.171840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.665377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:36.673167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.678730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.680718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.681727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:36.690971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:36.698550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:36.798994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:36.819702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b2820aa-592c-467e-bcaa-07d3ac774278 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.668072 Oct 04 17:54:36.841209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 680/1300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:36 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:36.853484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dae50657-5254-465f-8bd5-cd6081878a55 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbdb2c310>, body: {"security_group_rule": {"parent_group_id": "0667878a-6ee8-44ef-9242-019a2414e502", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "0ea12116-b8bb-4432-83e3-1cb6291eefc2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:37.905880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dae50657-5254-465f-8bd5-cd6081878a55 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.063385 Oct 04 17:54:37.913691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 681/1301] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:36 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:37.919218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:37.920348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:37.937729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.938702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.939424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.940401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:37.942125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:37.944731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:37.966179 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] HTTP exception thrown: Floating IP 172.25.5.66 is not associated with instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46. Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Request method failure captured: Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action HTTP/1.1 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 48 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHMRm_KMzFtZgtXedNMdSqefZBBtY0xFekbCerBufzt7XkW8n03in-qPSmXUJchhe-tI8mH1olONRZ1ZvbdlwbwLH7dWWOzKNCKPL8NYFfec9p69DIC_WxmmSHDlk80_aD_x0rrr9IVpi0w2zeY_Q4k1X_QU0dh-JrKpf0wGlMBXkDs Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:54:37.971105 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9982a2a4d7114c80bf418efb85bcbf79 Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: {"removeFloatingIp": {"address": "172.25.5.66"}} Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:54:37.972638 n-d-831194-21 devstack@n-api.service[128850]: exception: Floating IP 172.25.5.66 is not associated with instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46. Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'ec1bcd6a-43e6-463f-b3a6-f4b68544ba46', 'body': {'removeFloatingIp': {'address': '172.25.5.66'}}} Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.5.66 is not associated with instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46. Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:37.974168 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.5.66 is not associated with instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46. Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Returning 409 to user: Floating IP 172.25.5.66 is not associated with instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:37.975673 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74e4c727-c102-47b4-811c-5cc15fc76dd5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action" status: 409 len: 145 microversion: 2.1 time: 2.540003 Oct 04 17:54:37.978032 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 621/1302] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:35 2022] POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action => generated 145 bytes in 2546 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:54:38.002714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1764440546", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "451", "networks": [{"uuid": "0fbc2cd6-4b6c-4457-b74c-6928dfaa420c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:38.137771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] validate_networks() for [('0fbc2cd6-4b6c-4457-b74c-6928dfaa420c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:38.439005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:38.450152 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-715d50bb-736a-41a9-b1c2-b84ca0b51c4e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.534860 Oct 04 17:54:38.455124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 682/1303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:37 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:38.461202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9cbb02b5-83bf-4653-9962-e0ed408b2583", "tag": "2f793395-4937-4a2a-83ee-cf2938c66428"}, {"name": "network-changed", "server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:38.496925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.500402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.501791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.541123 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Creating event network-changed:2f793395-4937-4a2a-83ee-cf2938c66428 for instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 on n-h1-831194-21 Oct 04 17:54:38.541634 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] Creating event network-changed:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h2-831194-21 Oct 04 17:54:38.577247 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-408a52e5-0490-41db-bb72-e19414ee4a3c req-c53f96e6-f7ed-408a-91d1-28873dc87f8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.120347 Oct 04 17:54:38.582580 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 683/1304] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:38.601591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "333fa54f-7eca-4683-919e-5aaa85cde326", "name": "network-vif-plugged", "status": "completed", "tag": "55f0a861-e42e-4579-af97-4d6d3413a506"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:38.639812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.640302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.640735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.681411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] Creating event network-vif-plugged:55f0a861-e42e-4579-af97-4d6d3413a506 for instance 333fa54f-7eca-4683-919e-5aaa85cde326 on n-h1-831194-21 Oct 04 17:54:38.721119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a761caab-094f-47d5-9ef1-a9e35c7b1a22 req-de4b6f1d-16eb-464b-adaf-66de3d4ebfcd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125525 Oct 04 17:54:38.737582 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 684/1305] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:38.744916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:38.745537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:38.766446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.766951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.767388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:38.768102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:38.768554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:38.768978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:39.152779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:39.172410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ae19acc-0fab-4d38-a398-1d72d1712649 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.433328 Oct 04 17:54:39.176033 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 685/1306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:38 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:39.184427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1fe9e7a-2c14-48c0-a0b2-a6b8bd997f69 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd79f820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:39.857888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1fe9e7a-2c14-48c0-a0b2-a6b8bd997f69 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0ea12116-b8bb-4432-83e3-1cb6291eefc2" status: 202 len: 0 microversion: 2.1 time: 0.676655 Oct 04 17:54:39.863227 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 686/1307] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:39 2022] DELETE /compute/v2.1/os-security-groups/0ea12116-b8bb-4432-83e3-1cb6291eefc2 => generated 0 bytes in 684 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:39.871959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: .version_select at 0x7fbdbf7aaca0>, body: {"removeFloatingIp": {"address": "172.25.5.66"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:40.165496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:40.171694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.172192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.172634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:40.173341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:40.173794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:40.174247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.076987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:41.077444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:41.078518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:41.079208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:41.080047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:41.095351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.096292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.096896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.097797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.098612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.099477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.121592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=87,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=2,nova_cell1:RELEASE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:41.190637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:41.192882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:54:41.194136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquired lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:54:41.206368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Getting quotas for user bdb5e71c56fa43c8aa71bc62264aaf69 and project abb1b2887bb64298a7538044a6624b23. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:41.257525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:41.259895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:41.400183 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b15f7b4-9cfb-4621-84d7-5cdf8f83605b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.420674 Oct 04 17:54:41.404583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 622/1308] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:54:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:54:41.412973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:41.417442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:41.448367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.449101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.458720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:41.459716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:41.462341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:41.467056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.176407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:42.184149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd51ded3-388d-4938-a71e-627eec6c9414 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1317 microversion: 2.1 time: 0.778235 Oct 04 17:54:42.184821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 623/1309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:41 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1317 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:42.201742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc78f6f0-6d36-424e-8217-ab2391caa090 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7de310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:42.448251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Building network info cache for instance {{(pid=128849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:42.542388 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc78f6f0-6d36-424e-8217-ab2391caa090 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/0667878a-6ee8-44ef-9242-019a2414e502" status: 200 len: 247 microversion: 2.1 time: 0.356206 Oct 04 17:54:42.543578 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 624/1310] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:54:42 2022] GET /compute/v2.1/os-security-groups/0667878a-6ee8-44ef-9242-019a2414e502 => generated 247 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:42.552440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:42.553318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:42.565304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.566198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.568022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:42.569859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:42.570705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:42.573360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.060958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.101711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a861d0ae-8e68-4dd3-82cd-cc8cff3c3ee4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.555910 Oct 04 17:54:43.104737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 625/1311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:42 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:43.242901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Updating instance_info_cache with network_info: [{"id": "1b4094e9-d428-474e-896b-9b69af6d691b", "address": "fa:16:3e:f0:cb:f9", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap1b4094e9-d4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:43.286201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Releasing lock "refresh_cache-5847b48d-6ac0-4404-920a-1ca63655a372" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:54:43.287482 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1219853-2e05-4a2b-b26f-00c823095256 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372/action" status: 202 len: 0 microversion: 2.1 time: 3.422884 Oct 04 17:54:43.288426 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 687/1312] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:39 2022] POST /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372/action => generated 0 bytes in 3424 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:54:43.299406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b76737c-cdb8-4cbf-8237-6a9311f42a7b", "tag": "4d75f825-6256-415f-8ee4-83ef26b5a4fb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:43.305761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbb02b5-83bf-4653-9962-e0ed408b2583", "name": "network-vif-plugged", "status": "completed", "tag": "2f793395-4937-4a2a-83ee-cf2938c66428"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:43.339940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.342778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.348505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.354468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.355724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.359462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.386386 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] Creating event network-vif-plugged:2f793395-4937-4a2a-83ee-cf2938c66428 for instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 on n-h1-831194-21 Oct 04 17:54:43.394312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f0401b3c-3001-4271-aca4-592b249604c3 req-7f8d38e8-9a83-4356-a61e-16b02678ad89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103140 Oct 04 17:54:43.395833 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 688/1313] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:43.404530 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] Creating event network-changed:4d75f825-6256-415f-8ee4-83ef26b5a4fb for instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b on n-h2-831194-21 Oct 04 17:54:43.408400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:43.412887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:43.426897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.429364 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-da487def-6a4e-4867-b08d-0d72ab7b1aff req-fe23a928-ec47-431f-9f68-01b54cc8fd48 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318172 Oct 04 17:54:43.433096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.433919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.435342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.436164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 626/1314] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:43.439088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.439775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.462916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b6e1ca7-81c4-4c28-abe7-18246a70f524 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7bc8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-302577013", "description": "tempest-description-1276434682"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:43.569405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.581730 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e8359b6-aec7-4553-8e9c-d88b80570dc3 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1217 microversion: 2.1 time: 0.184305 Oct 04 17:54:43.586095 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 689/1315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:43 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1217 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:43.591950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:43.597497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:43.609570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.618416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.618992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.619921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.620451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.621238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.924615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:43.937148 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d52daaf1-50ec-41a6-9f56-af30349e458d tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1507 microversion: 2.1 time: 0.349339 Oct 04 17:54:43.960531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 690/1316] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:43 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1507 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:43.973956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:43.974681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:43.987754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.988256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.988695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:43.996400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:43.996890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:43.997444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.089536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:44.172159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:44.283653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64780d4d-2894-425c-a71d-d47369219fb2 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 204 len: 0 microversion: 2.1 time: 0.319265 Oct 04 17:54:44.287444 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 691/1317] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:43 2022] DELETE /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:44.305554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:44.306473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:44.319468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.325859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.326495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.327462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.328032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.328579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.662467 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b6e1ca7-81c4-4c28-abe7-18246a70f524 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.219706 Oct 04 17:54:44.664751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 627/1318] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:54:43 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:44.673270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.66"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:44.685497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:44.702515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.703827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.705930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.706871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.711145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.712198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.754088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:54:44.754828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquired lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:54:44.855240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:44.870976 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81828e5d-2f5c-4431-a3c4-4d23efb05223 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1317 microversion: 2.1 time: 0.581422 Oct 04 17:54:44.885861 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 692/1319] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:44 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:44.888198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:44.888824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:44.897357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.897871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.898312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:44.899025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:44.899476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:44.899901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.040527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:45.049682 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7f659c4-bed4-4d28-a367-49c8e833ebe2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1279 microversion: 2.1 time: 0.175755 Oct 04 17:54:45.053381 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 693/1320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:44 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:45.066397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff04153d-2079-4c29-a259-07c2866942d6 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd728310>, body: {"security_group_rule": {"parent_group_id": "4115b6a8-1c0d-4438-b1af-2964b730e87f", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:45.667455 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff04153d-2079-4c29-a259-07c2866942d6 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.612294 Oct 04 17:54:45.668346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 694/1321] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:45 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:45.674001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5847b48d-6ac0-4404-920a-1ca63655a372", "tag": "1b4094e9-d428-474e-896b-9b69af6d691b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:45.714519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:45.715225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:45.717196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:45.736037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] Creating event network-changed:1b4094e9-d428-474e-896b-9b69af6d691b for instance 5847b48d-6ac0-4404-920a-1ca63655a372 on n-h1-831194-21 Oct 04 17:54:45.743437 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-32985616-2d7a-48ae-bbdb-755b00a41ed7 req-5cecbd8c-6fb9-4f10-b59d-9ff3050b5faa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073341 Oct 04 17:54:45.744782 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 695/1322] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:45.752080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e94476-aca0-4a4c-951f-8a14647c1492 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Action: 'create', calling method: .version_select at 0x7fbdbd7a2ee0>, body: {"security_group_rule": {"parent_group_id": "4115b6a8-1c0d-4438-b1af-2964b730e87f", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:45.940050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:46.002297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:46.867593 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65e94476-aca0-4a4c-951f-8a14647c1492 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.121106 Oct 04 17:54:46.868483 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 696/1323] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:54:45 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:46.879282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:46.881369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:46.899899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.907494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.908561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:46.909568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:46.910387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:46.912168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.337413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:47.359273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e3f3896-76d0-44b5-a4ff-fc3644daedea tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1467 microversion: 2.1 time: 0.485967 Oct 04 17:54:47.361610 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 697/1324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:46 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1467 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:47.380019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:47.381414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:47.407225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.408666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.410288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.410927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.417049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.417626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.736579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:47.752480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60692cb9-40ef-44d3-a449-22f419d8e81e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.383703 Oct 04 17:54:47.755734 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 698/1325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:47 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:47.862195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d", "tag": "4f958882-a06e-4880-bd3b-1d991dd8546e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:47.878341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.879174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.880355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.916279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] Creating event network-changed:4f958882-a06e-4880-bd3b-1d991dd8546e for instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d on n-h2-831194-21 Oct 04 17:54:47.924441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6da15bc5-a2b1-479a-a34f-25272cd03f95 req-e2be4675-9a94-40e1-9cbc-61d856ae8a72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.166035 Oct 04 17:54:47.926229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 699/1326] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:47.933328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1997ef48-d87f-43d6-90c7-2360f2d6b429"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:47.937475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:47.947655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.948895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.949537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:47.952054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:47.952819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:47.953478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.048293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] HTTP exception thrown: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Request method failure captured: Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326/os-volume_attachments/d2251208-e409-4c11-a734-ee4e6b47975a HTTP/1.1 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 74 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLBsumarF0axFyPomTukoy5IBpUNYx6tNoi9BEMJxaaj2wuLMp410Y8UORnCVINovlNhuC5STGXK_ffNjniWLDMEJ3xIkVcC3gBABZkeftF7dPpfGNA7XhFQsQdpSoPZvSNiAHY8Ud_e7FjWaZk3G94TIlD4F1y3vTBvi7ij547MbI Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d9d5b4db92cf453ba6e5d78cbf094131 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 17:54:48.051045 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d9d5b4db92cf453ba6e5d78cbf094131"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d9d5b4db92cf453ba6e5d78cbf094131 Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-550475163 Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesAdminNegativeTest-550475163-project-admin Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: fbcc048beaa44182b70ac0f2c96dd34b Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesAdminNegativeTest-550475163-project-admin Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: {"volumeAttachment": {"volumeId": "1997ef48-d87f-43d6-90c7-2360f2d6b429"}} Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:54:48.052776 n-d-831194-21 devstack@n-api.service[128849]: exception: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '333fa54f-7eca-4683-919e-5aaa85cde326', 'id': 'd2251208-e409-4c11-a734-ee4e6b47975a', 'body': {'volumeAttachment': {'volumeId': '1997ef48-d87f-43d6-90c7-2360f2d6b429'}}} Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:54:48.053746 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. (HTTP 404) (Request-ID: req-414d2998-9009-4b11-b1d4-aba407448844) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:54:48.055076 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:48.056514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. Oct 04 17:54:48.057886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:48.060879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] Returning 404 to user: Volume d2251208-e409-4c11-a734-ee4e6b47975a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:48.062890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3de189dc-e299-44ed-b674-112d15c30efe tempest-VolumesAdminNegativeTest-550475163 tempest-VolumesAdminNegativeTest-550475163-project-admin] 10.222.0.42 "PUT /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326/os-volume_attachments/d2251208-e409-4c11-a734-ee4e6b47975a" status: 404 len: 109 microversion: 2.1 time: 0.133695 Oct 04 17:54:48.064194 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 700/1327] 10.222.0.42 () {60 vars in 1433 bytes} [Tue Oct 4 17:54:47 2022] PUT /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326/os-volume_attachments/d2251208-e409-4c11-a734-ee4e6b47975a => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:48.074849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0d9b1f7-4823-4ac6-8c5d-4232631e15d1 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7f6820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.222752 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0d9b1f7-4823-4ac6-8c5d-4232631e15d1 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/4115b6a8-1c0d-4438-b1af-2964b730e87f" status: 200 len: 664 microversion: 2.1 time: 0.157200 Oct 04 17:54:48.223940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 701/1328] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:54:48 2022] GET /compute/v2.1/os-security-groups/4115b6a8-1c0d-4438-b1af-2964b730e87f => generated 664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:48.229549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:48.230509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:48.275717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.277819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.279371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.280967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.289857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.290690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.909412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-345df013-3aa6-4649-8ac6-91377b62539c tempest-ServersOnMultiNodesTest-2112823783 tempest-ServersOnMultiNodesTest-2112823783-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1620 microversion: 2.1 time: 0.684246 Oct 04 17:54:48.930309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 702/1329] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:48 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1620 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:48.942633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b76737c-cdb8-4cbf-8237-6a9311f42a7b", "name": "network-vif-plugged", "status": "completed", "tag": "4d75f825-6256-415f-8ee4-83ef26b5a4fb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:48.968158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:48.968644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:48.969072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:48.983862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] Creating event network-vif-plugged:4d75f825-6256-415f-8ee4-83ef26b5a4fb for instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b on n-h2-831194-21 Oct 04 17:54:48.988907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a0deaca2-93df-44a5-8012-91a03dc552cc req-9a7299c7-6f74-4992-94e0-41d03d1cdcbe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057252 Oct 04 17:54:48.990739 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 703/1330] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:48.999164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4201ad66-3e83-4521-9e43-31c8bfbcdea9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7f69d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.019642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:50.132546 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4201ad66-3e83-4521-9e43-31c8bfbcdea9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/f7b44033-55f2-4f88-a0c9-bd6dd578f109" status: 202 len: 0 microversion: 2.1 time: 1.139785 Oct 04 17:54:50.133148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 704/1331] 10.222.0.42 () {58 vars in 1287 bytes} [Tue Oct 4 17:54:48 2022] DELETE /compute/v2.1/os-security-group-rules/f7b44033-55f2-4f88-a0c9-bd6dd578f109 => generated 0 bytes in 1142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:50.139037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.140058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:50.157056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.159049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.159691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.161549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.162225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.163970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.752449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:50.769425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43c70a42-b5b0-4fdb-8a15-1a86335c7da9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.635122 Oct 04 17:54:50.769965 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 705/1332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:50 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:50.786012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:50.787029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:50.806030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.806917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.807576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.808486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:50.809173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:50.809782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:50.871095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:51.035602 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e282a8c8-353e-4899-addf-2901bf42e528 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 204 len: 0 microversion: 2.1 time: 0.264351 Oct 04 17:54:51.036472 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 706/1333] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:50 2022] DELETE /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:51.049039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d42aeef-9c12-447c-ac25-fc9bcde5ec1f", "tag": "112197ff-9427-4f44-ab55-41caaeed780a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:51.072828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.078695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.079545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.111548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] Creating event network-changed:112197ff-9427-4f44-ab55-41caaeed780a for instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f on n-h2-831194-21 Oct 04 17:54:51.116993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2b6cb922-2866-4260-991d-e6f3ecae7352 req-4b70dc62-7785-4b14-86d3-953bfd8e82f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078861 Oct 04 17:54:51.118644 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 707/1334] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:51.130505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5847b48d-6ac0-4404-920a-1ca63655a372", "name": "network-vif-deleted", "tag": "1b4094e9-d428-474e-896b-9b69af6d691b"}, {"name": "network-changed", "server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:51.137565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:51.156114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.165188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.167443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.202115 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Creating event network-vif-deleted:1b4094e9-d428-474e-896b-9b69af6d691b for instance 5847b48d-6ac0-4404-920a-1ca63655a372 on n-h1-831194-21 Oct 04 17:54:51.203524 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] Creating event network-changed:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:54:51.225543 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8ac502f6-7435-45c4-8869-26cae25712e4 req-5f29743f-ee18-4004-87ab-3f2281ee915b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.102716 Oct 04 17:54:51.226774 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 708/1335] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:51.228560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:51.242581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c19213b9-a22e-4328-afdf-8cebdd0d1ba1 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7a2940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:51.677689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Updating instance_info_cache with network_info: [{"id": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40", "address": "fa:16:3e:4a:cf:4a", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04dd7bce-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:51.706609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Releasing lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:54:51.716133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85956911-7bfd-4300-9d67-47014fb9ffb9 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action" status: 202 len: 0 microversion: 2.1 time: 7.041987 Oct 04 17:54:51.716133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 628/1336] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:44 2022] POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action => generated 0 bytes in 7047 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:54:51.726570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:51.727214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:51.746376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.748126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.748601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:51.749345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:51.756144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:51.756673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.273330 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c19213b9-a22e-4328-afdf-8cebdd0d1ba1 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/4115b6a8-1c0d-4438-b1af-2964b730e87f" status: 202 len: 0 microversion: 2.1 time: 1.044742 Oct 04 17:54:52.273931 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 709/1337] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:51 2022] DELETE /compute/v2.1/os-security-groups/4115b6a8-1c0d-4438-b1af-2964b730e87f => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:52.280024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66717812-63a3-45c8-bba1-f128987bee1f tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '.version_select at 0x7fbdbd6c2790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.403736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:52.412901 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79256514-d45d-4cc9-861a-274e22353a47 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1473 microversion: 2.1 time: 0.698007 Oct 04 17:54:52.419774 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 629/1338] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:51 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1473 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:52.440509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:52.441430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:52.448216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.448731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.451708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.452495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:52.452986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:52.453422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:52.876927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:52.911304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a58996c1-5c0a-417e-b214-76b6dfbecae4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.490171 Oct 04 17:54:52.913909 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 630/1339] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:52 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:52.936526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7b6790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.054947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:54:53.055605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Neutron security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:54:53.056146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] HTTP exception thrown: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.056146 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Request method failure captured: Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-security-groups/0ea12116-b8bb-4432-83e3-1cb6291eefc2 HTTP/1.1 Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHNHEyOhtS62rHqopnmtXAF37sqGE8-ZIsAG6Q0aQqOWhY5rJKolpwb50e7_WS3dEZPDDE7R4AxWaNCgoXEO4JaipLQJYULe3obV0Uft-D2o8q1mbYaB6MEYU0OD1L3LavPrRE62VdA2Zx5O5Af6oCf3kDm1hrmCjIpOCTPmlzHSV_k Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b2dd9454711049e891abd811bb53c03d Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-2120411933 Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:54:53.058164 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b2dd9454711049e891abd811bb53c03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2dd9454711049e891abd811bb53c03d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b2dd9454711049e891abd811bb53c03d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b2dd9454711049e891abd811bb53c03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupRulesTestJSON-2120411933 Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b2dd9454711049e891abd811bb53c03d Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-2120411933 Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupRulesTestJSON-2120411933-project Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9afa808c10914f95a105568289daa528 Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupRulesTestJSON-2120411933-project Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.059642 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0ea12116-b8bb-4432-83e3-1cb6291eefc2'} Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:53.060632 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:54:53.061871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.065659 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Returning 404 to user: Security group 0ea12116-b8bb-4432-83e3-1cb6291eefc2 does not exist Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-a2526022-7798-47fd-8860-f9aa03ce1dbf'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9fe9fd62-b4c3-44b1-bbca-95601e0815f9 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0ea12116-b8bb-4432-83e3-1cb6291eefc2" status: 404 len: 194 microversion: 2.1 time: 0.143653 Oct 04 17:54:53.067669 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 631/1340] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:52 2022] DELETE /compute/v2.1/os-security-groups/0ea12116-b8bb-4432-83e3-1cb6291eefc2 => generated 194 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:53.070385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.070852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:53.085354 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66717812-63a3-45c8-bba1-f128987bee1f tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/7a41b6d6-e685-4dec-9885-24b9016e892f" status: 200 len: 183 microversion: 2.1 time: 0.809226 Oct 04 17:54:53.093652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 710/1341] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:54:52 2022] GET /compute/v2.1/os-floating-ips/7a41b6d6-e685-4dec-9885-24b9016e892f => generated 183 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:53.098784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4365348c-3b2b-46ef-8f76-819c81008491 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7f6430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.108930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.109711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.112503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.113423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.114100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.114697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.171778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:53.353763 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47fdec5b-b5ba-4a8d-97a9-433a60c80fab tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "DELETE /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 204 len: 0 microversion: 2.1 time: 0.291235 Oct 04 17:54:53.354384 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 632/1342] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:53 2022] DELETE /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:53.359945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.66"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:53.624401 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4365348c-3b2b-46ef-8f76-819c81008491 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/0667878a-6ee8-44ef-9242-019a2414e502" status: 202 len: 0 microversion: 2.1 time: 0.529326 Oct 04 17:54:53.626625 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 711/1343] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:53 2022] DELETE /compute/v2.1/os-security-groups/0667878a-6ee8-44ef-9242-019a2414e502 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:53.633774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:53.635366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:53.682031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.688727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.689530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.693447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.694113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.696988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.885758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:53.895628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.896131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.896565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:53.905428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:53.906011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:53.906462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:54.348618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:54.362529 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ace18740-8aba-4e2b-91c6-2ed650574f0e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1513 microversion: 2.1 time: 0.734343 Oct 04 17:54:54.363439 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 712/1344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:53 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1513 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:54.368661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:54.369273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:54.385386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:54.385930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:54.386376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:54.387791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:54.388455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:54.388890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:54.554103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:54.571767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-298356ec-2af7-4838-a3c8-992b2656527a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 200 len: 1431 microversion: 2.1 time: 0.206727 Oct 04 17:54:54.572740 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 713/1345] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:54 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 1431 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:54.577931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e9bde04-6c43-430b-b146-b93d52182230 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7f6c10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:54.711218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:54:54.711620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquired lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:54:55.949027 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e9bde04-6c43-430b-b146-b93d52182230 tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/38a41f75-fbed-4e0a-b9a7-8af794b046d9" status: 202 len: 0 microversion: 2.1 time: 1.374928 Oct 04 17:54:55.951170 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 714/1346] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:54 2022] DELETE /compute/v2.1/os-security-groups/38a41f75-fbed-4e0a-b9a7-8af794b046d9 => generated 0 bytes in 1378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:56.068363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1160787826", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "0d00d17a-1f2f-4d1c-a39a-93ff893f6b91"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:56.201448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] validate_networks() for [('0d00d17a-1f2f-4d1c-a39a-93ff893f6b91', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:54:57.366212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:54:57.367264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:54:57.367403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:54:57.367747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:54:57.368157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:54:57.384335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.390655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.391694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:57.392725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.393215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.393662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:57.474175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:57.485863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:57.503089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:54:57.506888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for user 606a8a3f1311407498ad45ed8d78e558 and project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:57.531368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:54:57.533884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:54:57.619464 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e1a6f88-704a-4f82-bf03-720a7c1fc0c8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.663070 Oct 04 17:54:57.619464 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 715/1347] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:54:57.625081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:57.625888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:57.648304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.648537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.649225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:57.650323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:57.651103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:57.651689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.264136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:58.291653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a43457ae-6134-4f83-a049-94d7080d34c4 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.653245 Oct 04 17:54:58.294270 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 716/1348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:57 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:58.300521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9cbb02b5-83bf-4653-9962-e0ed408b2583", "name": "network-vif-deleted", "tag": "2f793395-4937-4a2a-83ee-cf2938c66428"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:58.325137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.325769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.326230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.358501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] Creating event network-vif-deleted:2f793395-4937-4a2a-83ee-cf2938c66428 for instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 on n-h1-831194-21 Oct 04 17:54:58.363954 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ae5bb33b-1e2f-4d4e-bcd4-d0da7ee9fb17 req-7b846aed-1873-4125-8173-96e21c4ffb43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067404 Oct 04 17:54:58.364681 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 717/1349] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:58.371309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.374612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:58.392704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.393376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.393621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.394972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.395817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.396686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.475542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.476392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.476995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.477625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lazy-loading 'fault' on Instance uuid 333fa54f-7eca-4683-919e-5aaa85cde326 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:54:58.483412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:58.579763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:58.593917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a3a5c67-d2c2-4f34-ad92-8675c8263324 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 200 len: 1307 microversion: 2.1 time: 0.227879 Oct 04 17:54:58.594799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 718/1350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:58 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 1307 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:58.619811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.621758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 9cbb02b5-83bf-4653-9962-e0ed408b2583] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:58.628738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.629504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.630140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.631051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.631668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.632265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.675659 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 HTTP/1.1 Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:54:58.677759 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. Oct 04 17:54:58.679539 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9cbb02b5-83bf-4653-9962-e0ed408b2583'} Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:58.680558 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. Oct 04 17:54:58.682630 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:58.688318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 9cbb02b5-83bf-4653-9962-e0ed408b2583 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:58.692032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0deb09a-4f5f-48e7-a710-0f22ab50ce30 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583" status: 404 len: 111 microversion: 2.1 time: 0.095730 Oct 04 17:54:58.704042 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 719/1351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:58 2022] GET /compute/v2.1/servers/9cbb02b5-83bf-4653-9962-e0ed408b2583 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:58.710437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-85f804d3-6f59-44a7-bd4a-43d41713579c tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7a25e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.756366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Updating instance_info_cache with network_info: [{"id": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40", "address": "fa:16:3e:4a:cf:4a", "network": {"id": "f2090dc6-51a4-4068-ba56-fb71307f8f56", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-240601223-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "7b22eb2200074581a1ccabbc7f3c4fb5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap04dd7bce-c2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:54:58.773435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Releasing lock "refresh_cache-ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:54:58.774872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b36296f3-f767-4b5c-ae1b-10020095f474 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action" status: 202 len: 0 microversion: 2.1 time: 5.419161 Oct 04 17:54:58.776146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 633/1352] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:54:53 2022] POST /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46/action => generated 0 bytes in 5421 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:54:58.788430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:58.791239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:58.812408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:58.815286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.816116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.817777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.818954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:58.820054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:58.820758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:58.922065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:58.931326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:58.933059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:58.934658 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c3f98be-b7b0-46d4-a199-284b1d8530b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1258 microversion: 2.25 time: 0.157083 Oct 04 17:54:58.935716 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 634/1353] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:54:58 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:54:58.940821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a58b3067-35a1-4b15-9d8e-940ae5d4df5b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Action: 'create', calling method: .version_select at 0x7fbdbd7b6790>, body: {"keypair": {"name": "tempest-keypair-1030634744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCGiwFS1i9g5PoGHlQohbcd3oahZUeu7JIDsHCLtex1Zn6NrIFq5QInzbi74hBeaGOVXSZPpzAdd7XPW8CBXuWqQH236jxuohPG/ettv1aRehwQxtTIylZiJcSjRxcrEwQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:58.958275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a58b3067-35a1-4b15-9d8e-940ae5d4df5b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Getting quotas for project 745bc6877bef48bf94ff8bfa4e87dbf6. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:54:58.965747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a58b3067-35a1-4b15-9d8e-940ae5d4df5b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Getting quotas for user 94ec2d1c74a24166b9d437b09103f861 and project 745bc6877bef48bf94ff8bfa4e87dbf6. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:54:58.995553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-85f804d3-6f59-44a7-bd4a-43d41713579c tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/48fcdb8c-1476-46d0-b477-6a125d3432cd" status: 202 len: 0 microversion: 2.1 time: 0.290093 Oct 04 17:54:58.999610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a58b3067-35a1-4b15-9d8e-940ae5d4df5b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.060313 Oct 04 17:54:58.999610 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 635/1354] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 17:54:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 63 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:54:59.000348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 720/1355] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:58 2022] DELETE /compute/v2.1/os-security-groups/48fcdb8c-1476-46d0-b477-6a125d3432cd => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:59.007089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.007527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.022592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.023010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.023461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.024188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.024649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.025082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.070590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:54:59.171433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d", "name": "network-vif-plugged", "status": "completed", "tag": "4f958882-a06e-4880-bd3b-1d991dd8546e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:54:59.218593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.219508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.223579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.245276 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5f1b597-c655-4c3d-a366-01396c309733 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 204 len: 0 microversion: 2.1 time: 0.244560 Oct 04 17:54:59.246986 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 636/1356] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:58 2022] DELETE /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:54:59.256135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.257152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.269650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.270305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.270850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.271764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.272321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.273048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.288331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] Creating event network-vif-plugged:4f958882-a06e-4880-bd3b-1d991dd8546e for instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d on n-h2-831194-21 Oct 04 17:54:59.295165 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] HTTP exception thrown: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Request method failure captured: Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 HTTP/1.1 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHMRm_KMzFtZgtXedNMdSqefZBBtY0xFekbCerBufzt7XkW8n03in-qPSmXUJchhe-tI8mH1olONRZ1ZvbdlwbwLH7dWWOzKNCKPL8NYFfec9p69DIC_WxmmSHDlk80_aD_x0rrr9IVpi0w2zeY_Q4k1X_QU0dh-JrKpf0wGlMBXkDs Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:54:59.298649 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9982a2a4d7114c80bf418efb85bcbf79 Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.300024 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5847b48d-6ac0-4404-920a-1ca63655a372'} Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:59.300895 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.303295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.306374 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8650f6ef-76d6-4297-9093-5792a7cc53d4 req-86558f5d-2061-4dbd-9a7a-e944d103aa7b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302045 Oct 04 17:54:59.308831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Returning 404 to user: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:59.309767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 721/1357] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:54:59.310481 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3fbaa4c3-5621-4801-9190-4c5dffbdfbed tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 404 len: 111 microversion: 2.1 time: 0.061449 Oct 04 17:54:59.311291 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 637/1358] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:54:59 2022] DELETE /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:59.326726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.330715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-353b5222-f5f5-403d-b790-4ae272e2bcde tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7f69d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.331644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.347334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.349680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.350755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.352247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.353506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.354132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.564232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:54:59.580613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cef03d6c-7188-44ac-bb6b-cf0908ea9ebd tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1473 microversion: 2.1 time: 0.267729 Oct 04 17:54:59.595914 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 638/1359] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1473 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:54:59.604122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.604690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: 5847b48d-6ac0-4404-920a-1ca63655a372] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.613269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.613767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.614434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.615337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.616074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.616648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.632399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] HTTP exception thrown: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Request method failure captured: Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 HTTP/1.1 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHMRm_KMzFtZgtXedNMdSqefZBBtY0xFekbCerBufzt7XkW8n03in-qPSmXUJchhe-tI8mH1olONRZ1ZvbdlwbwLH7dWWOzKNCKPL8NYFfec9p69DIC_WxmmSHDlk80_aD_x0rrr9IVpi0w2zeY_Q4k1X_QU0dh-JrKpf0wGlMBXkDs Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:54:59.635107 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9982a2a4d7114c80bf418efb85bcbf79 Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.639683 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5847b48d-6ac0-4404-920a-1ca63655a372'} Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:59.640710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. Oct 04 17:54:59.642552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.645700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Returning 404 to user: Instance 5847b48d-6ac0-4404-920a-1ca63655a372 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:59.645700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5aec349-99d6-4e01-b5c3-679ebdc6d947 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372" status: 404 len: 111 microversion: 2.1 time: 0.039810 Oct 04 17:54:59.645700 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 639/1360] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1/servers/5847b48d-6ac0-4404-920a-1ca63655a372 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:59.648098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.648948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.656979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.657153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.657556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.658390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.659365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.659981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.678100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=4,nova_cell1:RELEASE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:54:59.758214 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-353b5222-f5f5-403d-b790-4ae272e2bcde tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/74569572-e493-47ff-9a07-7258c298f458" status: 202 len: 0 microversion: 2.1 time: 0.443399 Oct 04 17:54:59.763965 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 722/1361] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:54:59 2022] DELETE /compute/v2.1/os-security-groups/74569572-e493-47ff-9a07-7258c298f458 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:54:59.773365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:54:59.782772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 333fa54f-7eca-4683-919e-5aaa85cde326] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:54:59.791768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.792282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.792738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.793765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:54:59.794449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:54:59.794892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:54:59.827630 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] HTTP exception thrown: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Request method failure captured: Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 HTTP/1.1 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKr-h4TOACD8ehgqEX_15GUIuNjGsi1g5cKkgQQXDnOZJhW1ZklgFbAtX30c8uTawmo7NyHGidQe9EVd_VCQjPmwECuxKMIEp17P2mx2TYcZ35QB9kTMmIr47bmxomsQpf84VzslMU2aTntrP1DZ7kwPpQyYw-4ndX0lx8Wu1kZCOM Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8131bad014684bb0973ae16c4aad02d5 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:54:59.829707 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8131bad014684bb0973ae16c4aad02d5 Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesAdminNegativeTest-1022533065-project Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: deedb2b40cc946c18b21f6859166f286 Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesAdminNegativeTest-1022533065-project Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. Oct 04 17:54:59.831122 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '333fa54f-7eca-4683-919e-5aaa85cde326'} Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:54:59.832217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. Oct 04 17:54:59.835527 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:54:59.846925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Returning 404 to user: Instance 333fa54f-7eca-4683-919e-5aaa85cde326 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:54:59.847924 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f84df47-a5ea-4f18-be2c-07009a3ed8ad tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326" status: 404 len: 111 microversion: 2.1 time: 0.082902 Oct 04 17:54:59.849113 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 723/1362] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1/servers/333fa54f-7eca-4683-919e-5aaa85cde326 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:54:59.854926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-afb42a26-fb4a-4316-a05c-7eeebb48ca41 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '.version_select at 0x7fbdbd79f1f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:00.046838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:00.055489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0857d9ca-cac0-4d65-b80f-01528a807957 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.411716 Oct 04 17:55:00.060244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 640/1363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:54:59 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:00.069556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c63d5436-4f6e-4c5b-a25c-4a0377662f7c tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] Calling method '.version_select at 0x7fbdbd7bc9d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.341794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-afb42a26-fb4a-4316-a05c-7eeebb48ca41 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/7a41b6d6-e685-4dec-9885-24b9016e892f" status: 202 len: 0 microversion: 2.1 time: 1.490800 Oct 04 17:55:01.343486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 724/1364] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:54:59 2022] DELETE /compute/v2.1/os-floating-ips/7a41b6d6-e685-4dec-9885-24b9016e892f => generated 0 bytes in 1494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:01.349039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.350846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.368698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.372226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.374991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.376014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.382818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.383291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.443534 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c63d5436-4f6e-4c5b-a25c-4a0377662f7c tempest-SecurityGroupRulesTestJSON-2120411933 tempest-SecurityGroupRulesTestJSON-2120411933-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/5f5e14a1-5f28-4c7d-8e35-e54f0e2cc30a" status: 202 len: 0 microversion: 2.1 time: 1.381898 Oct 04 17:55:01.444484 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 641/1365] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:55:00 2022] DELETE /compute/v2.1/os-security-groups/5f5e14a1-5f28-4c7d-8e35-e54f0e2cc30a => generated 0 bytes in 1383 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:01.450921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}, {"server_uuid": "333fa54f-7eca-4683-919e-5aaa85cde326", "name": "network-vif-deleted", "tag": "55f0a861-e42e-4579-af97-4d6d3413a506"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:01.477212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.477699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.480936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.506407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Creating event network-changed:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:55:01.508477 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] Creating event network-vif-deleted:55f0a861-e42e-4579-af97-4d6d3413a506 for instance 333fa54f-7eca-4683-919e-5aaa85cde326 on n-h1-831194-21 Oct 04 17:55:01.524152 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-755759f3-a845-4611-8b6b-0559695b5294 req-85596b10-07fa-45c2-a603-a73d2e16ecee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.078434 Oct 04 17:55:01.524974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 642/1366] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:01.525438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.540136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.540863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.541009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.542542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.545385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef43dcb3-8360-49be-a84f-e08b1743137d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1320 microversion: 2.25 time: 0.199973 Oct 04 17:55:01.548048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 725/1367] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1320 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:01.562347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.562347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.562347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.562347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.562778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.562778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.600148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.601598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.614837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.618596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.620020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.627068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.628717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.629413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.938767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:01.948523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6610d33c-26d6-4399-94b6-da127b4c524d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.382325 Oct 04 17:55:01.962735 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 726/1368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:01.972897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:01.973660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:01.981204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.982025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.982897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:01.983884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:01.984546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:01.985177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.042797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:02.161661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.185164 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa99a47c-34de-48bc-b946-016ca76757d2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1431 microversion: 2.1 time: 0.655714 Oct 04 17:55:02.200100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 643/1369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:01 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1431 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:02.215662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8947da35-4431-4e27-b015-df0dd4a1e908 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 204 len: 0 microversion: 2.1 time: 0.247470 Oct 04 17:55:02.218071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01", "name": "network-vif-deleted", "tag": "f11c9ad1-e1be-4d4c-936e-9ba8ee65a296"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:02.220736 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 727/1370] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:01 2022] DELETE /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:02.230387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.240542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:02.242743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.245315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.246555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.270507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.272491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.276013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] Creating event network-vif-deleted:f11c9ad1-e1be-4d4c-936e-9ba8ee65a296 for instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 on n-h2-831194-21 Oct 04 17:55:02.278068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.283949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.284577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.287585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b2508395-3ddd-4909-9564-523ba0947414 req-0f22c597-cf98-452e-9551-7db9549a36d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080328 Oct 04 17:55:02.288183 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 644/1371] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:02.288382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.529279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.537964 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf04a4cc-8c77-489d-9982-0088cffd0fc4 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1525 microversion: 2.1 time: 0.312512 Oct 04 17:55:02.539169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 728/1372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1525 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:02.581384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.582775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:02.597044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.597551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.598086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.598813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.599271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.599697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.753871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.768615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.771122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:02.773496 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-10b2bbaa-25f2-493d-97eb-8cc1a38cb3d6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1320 microversion: 2.25 time: 0.196560 Oct 04 17:55:02.775539 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 645/1373] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1320 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:02.977618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:02.978631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:02.988186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.989984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.990692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:02.992404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:02.993155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:02.993853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.182304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.193029 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a48caa37-da71-4b5b-adea-26b2390b7c9e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.219703 Oct 04 17:55:03.210392 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 729/1374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:02 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:03.211486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-988049922", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "5878b10e-58c6-42fe-9d34-1c0803ba832a"}, {"port": "e715b681-6d3d-42b7-bf4c-9dab4479a0ba", "tag": "port-1"}, {"port": "a67950f7-a222-4066-81f1-b63ffdaaf39d", "tag": "port-2"}, {"uuid": "80ef1694-96f8-4004-bfb0-4ea4893bf999", "tag": "net-1"}, {"uuid": "80ef1694-96f8-4004-bfb0-4ea4893bf999"}, {"uuid": "7efe5caf-d950-4975-9a02-02b7c690c23d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "7efe5caf-d950-4975-9a02-02b7c690c23d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "6cf338ae-c0bc-4d94-9c6f-3ecb1d28c8f9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "529b0f9b-ab15-4a06-a033-86bf2d9fa55b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "58fa0e37-717a-4878-808a-25804061bb54", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--942400555"}], "key_name": "tempest-keypair-1030634744", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:03.217587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.218585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.226400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.227266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.227930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.230351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.231918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.232611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.272740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.273040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.274435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.275100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lazy-loading 'fault' on Instance uuid b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:03.320396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.329453 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7a85527-189e-48b1-932a-56b8e3b0ddcc tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1307 microversion: 2.1 time: 0.117763 Oct 04 17:55:03.330558 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 730/1375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1307 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:03.466531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] validate_networks() for [('5878b10e-58c6-42fe-9d34-1c0803ba832a', None, None, None, None, None), (None, None, 'e715b681-6d3d-42b7-bf4c-9dab4479a0ba', None, None, None), (None, None, 'a67950f7-a222-4066-81f1-b63ffdaaf39d', None, None, None), ('80ef1694-96f8-4004-bfb0-4ea4893bf999', None, None, None, None, None), ('80ef1694-96f8-4004-bfb0-4ea4893bf999', None, None, None, None, None), ('7efe5caf-d950-4975-9a02-02b7c690c23d', '10.2.2.100', None, None, None, None), ('7efe5caf-d950-4975-9a02-02b7c690c23d', '10.2.2.200', None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:03.566739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.568595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.578293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.579286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.579962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.581143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.581707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.582285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.890328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:03.904521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58c211fa-3406-4e95-bae8-c37ec7226726 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1525 microversion: 2.1 time: 0.341484 Oct 04 17:55:03.924182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 731/1376] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1525 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:03.932487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:03.938707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:03.950587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.953394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.953939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:03.956999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:03.958401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:03.958859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.383682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:04.401494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:04.408477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:04.415880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21b67f55-74be-4207-b412-0a532102528f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.490432 Oct 04 17:55:04.417175 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 732/1377] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:03 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:04.438565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d42aeef-9c12-447c-ac25-fc9bcde5ec1f", "name": "network-vif-plugged", "status": "completed", "tag": "112197ff-9427-4f44-ab55-41caaeed780a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:04.467934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:04.468381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:04.468826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.505653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] Creating event network-vif-plugged:112197ff-9427-4f44-ab55-41caaeed780a for instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f on n-h2-831194-21 Oct 04 17:55:04.510408 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cc747291-83e4-4fc9-aa63-4bf10b890a83 req-0dc6e5e8-b01e-4fd1-8522-aad66fdde1eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090413 Oct 04 17:55:04.512272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 733/1378] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:04.528591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:04.540714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:04.552397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:04.552905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:04.553364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.560880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:04.561461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:04.562242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.899709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:04.915590 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44a025e9-a5e8-4795-a1a2-5b515aa4b3d8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.393253 Oct 04 17:55:04.916281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 734/1379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:04 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:04.928745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:04.929530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:04.945707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:04.946240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:04.946683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:04.947471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:04.947846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:04.948271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.039190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.039683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.040112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.040751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lazy-loading 'fault' on Instance uuid b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:05.320233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:05.332420 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d50041a2-bb02-4033-8c6c-068398d60c24 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 200 len: 1307 microversion: 2.1 time: 0.410364 Oct 04 17:55:05.333301 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 735/1380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:04 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:05.346311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:05.350589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:05.364217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.364972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.365592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.367444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.373429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.374135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.437468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:05.568383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:05.631099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ff9e444-fd01-481f-b12b-b68109e6453e tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 204 len: 0 microversion: 2.1 time: 0.293837 Oct 04 17:55:05.635839 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 736/1381] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:05 2022] DELETE /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:05.645493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:05.647023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:05.654929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.655765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.656385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.657275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.657997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.658717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.828647 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1b388ca-71b7-4111-ae74-f278d72c4e95 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1814 microversion: 2.1 time: 0.188683 Oct 04 17:55:05.851636 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 737/1382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:05 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1814 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:05.858002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:05.858619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:05.870189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.872485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.873188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.874300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.875123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.875961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.957711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:05.967443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20910630-6917-4080-b8d5-17171e61aefb tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1309 microversion: 2.1 time: 0.114162 Oct 04 17:55:05.968399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 738/1383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:05 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1309 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:05.977944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:05.978815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:05.987234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.988021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.988657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:05.989407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:05.990079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:05.990522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.160704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:06.172067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:06.173662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:06.174878 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81e4865e-9d0d-4ee4-a086-80f3bb87e917 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.205700 Oct 04 17:55:06.175434 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 739/1384] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:05 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:06.179911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1bcd6a-43e6-463f-b3a6-f4b68544ba46", "name": "network-vif-deleted", "tag": "04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:06.189703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.190211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.190637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.202289 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] Creating event network-vif-deleted:04dd7bce-c2c6-45b3-b5f6-3f7674fdaa40 for instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 on n-h2-831194-21 Oct 04 17:55:06.207337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3c5a7691-f337-4b4b-91f0-0fede7c9b7ce req-961718d4-7da7-4599-94c3-48cd39f21336 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030675 Oct 04 17:55:06.207901 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 740/1385] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:06.212858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.213559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:06.220184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.220667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.221106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.221795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.222648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.222784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.384935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:06.393891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb03228d-db02-4bbd-aa39-75e55a133048 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1680 microversion: 2.1 time: 0.184778 Oct 04 17:55:06.402736 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 741/1386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1680 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:06.402736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.403331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.403815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.404257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.405106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.405427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.405898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.430889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-022a09be-db74-4d01-9979-6d1c4283e354 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035376 Oct 04 17:55:06.431805 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 742/1387] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:06.436506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.437121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:06.443251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.443735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.444176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.444872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.445326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.445748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.599025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:06.608145 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d08bfa28-6df4-4079-a39a-147c5330fc42 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1321 microversion: 2.1 time: 0.175050 Oct 04 17:55:06.608882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 743/1388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:06.630342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.631187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:06.638905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.640102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.640102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.640987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.641597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.642119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.665724 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 HTTP/1.1 Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:06.668103 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. Oct 04 17:55:06.669952 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01'} Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:06.671039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. Oct 04 17:55:06.672603 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:06.674191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:06.674702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd168a20-a594-4826-806c-69266b2f92a2 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01" status: 404 len: 111 microversion: 2.1 time: 0.050380 Oct 04 17:55:06.678838 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 744/1389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1/servers/b5e5675f-0eb5-4f57-a4c5-0ea0a57a2f01 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:06.684669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.690375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:06.698937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.700640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.701129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.701877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.702338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.703121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.736901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:06.900752 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a03fec18-67cd-4d1c-9b99-418524ea062a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 204 len: 0 microversion: 2.1 time: 0.220520 Oct 04 17:55:06.904964 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 745/1390] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:06 2022] DELETE /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:06.910398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:06.911926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:06.922131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.922640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.923519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:06.924646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:06.924774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:06.925131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.084877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.094892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cadcb434-f49c-421e-afd1-5eccab33125c tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1472 microversion: 2.1 time: 0.188675 Oct 04 17:55:07.095667 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 746/1391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:06 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1472 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:07.119837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:07.120456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:07.126896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.127584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.128027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.128724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.129273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.129705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.163856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.164345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.164988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.165227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lazy-loading 'fault' on Instance uuid ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:07.211380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.221059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21233831-be5e-407a-b30c-e69ce00fd45b tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1314 microversion: 2.1 time: 0.113172 Oct 04 17:55:07.222128 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 747/1392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:07 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1314 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:07.227024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:07.227757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:07.234538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.235151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.235711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.236515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.237196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.237723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.524798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:07.578564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.589068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.593904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.595079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc53df8b-8794-42f3-ae50-70230c141a6d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.371820 Oct 04 17:55:07.613980 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 748/1393] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:07 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:07.619881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:07.620512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:07.627392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.627889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.628324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.629037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.629780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.630262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.936806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:07.944817 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21583c64-20bb-486d-a66d-75b960ee8d72 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1680 microversion: 2.1 time: 0.329645 Oct 04 17:55:07.945587 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 749/1394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:07 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1680 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:07.950223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2675c593-64c2-4f3f-afe2-95c16acfd0a0", "tag": "300ba45e-98fd-4b51-afc8-87c09c85ed51"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:07.955194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:07.963064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:07.963550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:07.964039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:07.978307 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] Creating event network-changed:300ba45e-98fd-4b51-afc8-87c09c85ed51 for instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 on n-h1-831194-21 Oct 04 17:55:07.984586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e37d5b9d-ab18-4b5a-9979-d379e5b8fa72 req-6fa492ee-046f-4a4d-87da-9e68d777b6eb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037861 Oct 04 17:55:07.985191 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 750/1395] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:07.991989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:07.992697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:08.000892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:08.000892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:08.001369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:08.002178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:08.002736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:08.003205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:08.487458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:08.497522 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef528bff-08a6-43d9-a8a5-512cb3975e46 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1512 microversion: 2.1 time: 0.510969 Oct 04 17:55:08.498238 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 751/1396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:07 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1512 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:08.503764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9397ac4c-4ce2-4528-8abe-07476907f664", "device": "/dev/xvdb"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:08.507038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:08.521596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:08.522203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:08.522904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:08.523820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:08.524516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:08.525141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:08.976328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:09.179928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:09.229663 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5758ca63-501a-4920-bdf3-b9ebcd0bc1aa tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729947 Oct 04 17:55:09.233754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 752/1397] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 17:55:08 2022] POST /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:09.280782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:09.280782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:09.295966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.298482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.299107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.305198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.305872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.306617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.561933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:09.579771 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5c71906-2bfa-49e5-8f38-c05ab113b287 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1472 microversion: 2.1 time: 0.344424 Oct 04 17:55:09.580986 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 753/1398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:09 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1472 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:09.586761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:09.588214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:09.603031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.604049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.604846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.606384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.609138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.621338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.666470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.667123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.667900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.668888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lazy-loading 'fault' on Instance uuid ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:09.752732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9982a2a4d7114c80bf418efb85bcbf79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b22eb2200074581a1ccabbc7f3c4fb5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:09.779573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9371ba7-7cd2-46c2-bc21-0b30e4be7ead tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 200 len: 1488 microversion: 2.1 time: 0.196748 Oct 04 17:55:09.801949 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 754/1399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:09 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 1488 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:09.811173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:09.814738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:09.834535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.845521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.851082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:09.852155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:09.854981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:09.857254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.287607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:10.301456 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-583ae014-6a10-4479-be5a-ec14a8116a94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1510 microversion: 2.1 time: 0.498202 Oct 04 17:55:10.302090 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 755/1400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:09 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:10.313666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:10.314317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:10.332452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:10.332955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:10.333483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.334236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:10.334776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:10.335214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.783752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:10.797006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:10.799393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:10.803825 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5e6b482-0efd-4c94-a7fc-0ee0187c7848 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.500467 Oct 04 17:55:10.806971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 756/1401] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:10 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:10.816664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:10.817563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:10.831791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:10.832573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:10.833948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.834899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:10.838183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:10.838829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.909472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:10.909998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:10.912035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:10.912501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lazy-loading 'fault' on Instance uuid 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:10.997454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deedb2b40cc946c18b21f6859166f286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8131bad014684bb0973ae16c4aad02d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:11.006746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-011ede86-3ba7-4f30-bfdb-c994ebda08aa tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 200 len: 1330 microversion: 2.1 time: 0.198466 Oct 04 17:55:11.017994 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 757/1402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:10 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 1330 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:11.035033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eec3b80-8ffb-4118-82d2-40e6a0bb51d8", "name": "network-vif-deleted", "tag": "1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:11.059905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.063433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.064160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.092206 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] Creating event network-vif-deleted:1d7c75fd-a1ae-4c9e-a6cf-4d19bf40a9df for instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 on n-h1-831194-21 Oct 04 17:55:11.109689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-292b28ca-5329-4428-873a-b6e807f1b104 req-32a9c624-b9b8-427b-b5f4-b1a41ed93bb9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089860 Oct 04 17:55:11.110344 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 758/1403] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:11.121067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:11.122197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:11.144177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.144702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.145273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.146121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.147234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.147838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.469225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:11.483227 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-131df410-4df0-4194-b4e5-244500fc0068 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1510 microversion: 2.1 time: 0.369481 Oct 04 17:55:11.488817 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 759/1404] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:11 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1510 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:11.495101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:11.501564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:11.516348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.519828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.520518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.521641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.524601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.528595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.611639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.611639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.611639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.611639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lazy-loading 'fault' on Instance uuid add46b9a-e4ce-4087-abe4-fe0da839c023 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:11.702992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:11.730048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7979760d-7a5d-453f-a776-bb5a045ce206 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 200 len: 1306 microversion: 2.1 time: 0.238638 Oct 04 17:55:11.750578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 760/1405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:11 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:11.761983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:11.767310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] [instance: ec1bcd6a-43e6-463f-b3a6-f4b68544ba46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:11.777626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.780031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.780742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.781773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.783405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.784957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.829149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:11.830287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:11.830951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:11.831545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:11.832143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:11.848736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.853475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] HTTP exception thrown: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. Oct 04 17:55:11.854490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.855555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.856574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.857072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.857508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Request method failure captured: Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 HTTP/1.1 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHMRm_KMzFtZgtXedNMdSqefZBBtY0xFekbCerBufzt7XkW8n03in-qPSmXUJchhe-tI8mH1olONRZ1ZvbdlwbwLH7dWWOzKNCKPL8NYFfec9p69DIC_WxmmSHDlk80_aD_x0rrr9IVpi0w2zeY_Q4k1X_QU0dh-JrKpf0wGlMBXkDs Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:11.858195 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b22eb2200074581a1ccabbc7f3c4fb5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 7b22eb2200074581a1ccabbc7f3c4fb5 Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-648914183 Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9982a2a4d7114c80bf418efb85bcbf79 Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-648914183-project Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. Oct 04 17:55:11.859636 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'ec1bcd6a-43e6-463f-b3a6-f4b68544ba46'} Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:11.860477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. Oct 04 17:55:11.863740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:11.865889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] Returning 404 to user: Instance ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:11.865889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b75430a-18e6-47ae-bcfb-a3351186f7f5 tempest-FloatingIPsAssociationTestJSON-648914183 tempest-FloatingIPsAssociationTestJSON-648914183-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46" status: 404 len: 111 microversion: 2.1 time: 0.109821 Oct 04 17:55:11.865889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 761/1406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:11 2022] GET /compute/v2.1/servers/ec1bcd6a-43e6-463f-b3a6-f4b68544ba46 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:11.879791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:11.923582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:11.934083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:11.944617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Getting quotas for project 745bc6877bef48bf94ff8bfa4e87dbf6. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:11.966460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Getting quotas for user 94ec2d1c74a24166b9d437b09103f861 and project 745bc6877bef48bf94ff8bfa4e87dbf6. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:11.970078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.971838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.974774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:11.976715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:11.978000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:11.979074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:12.240426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:12.329771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:12.334081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='6cf338ae-c0bc-4d94-9c6f-3ecb1d28c8f9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='529b0f9b-ab15-4a06-a033-86bf2d9fa55b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='58fa0e37-717a-4878-808a-25804061bb54',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:12.705158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:12.713739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:12.715207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:12.715969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.100274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-448c7fe9-744a-4790-9e0a-e7b5b1a13f5c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.892017 Oct 04 17:55:13.113650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 646/1407] 10.222.0.42 () {62 vars in 1189 bytes} [Tue Oct 4 17:55:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 9902 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:55:13.124029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.124871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.141026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.141530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.142015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.142731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.143193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.143674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.289060 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-beb25243-2823-4411-8194-e23bf0a9e5e2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.422349 Oct 04 17:55:13.298807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 762/1408] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 17:55:11 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:13.304005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.304846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] [instance: 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.325562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.326432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.327166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.328214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.328840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.329431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.343843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.345652 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] HTTP exception thrown: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Request method failure captured: Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 HTTP/1.1 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHKr-h4TOACD8ehgqEX_15GUIuNjGsi1g5cKkgQQXDnOZJhW1ZklgFbAtX30c8uTawmo7NyHGidQe9EVd_VCQjPmwECuxKMIEp17P2mx2TYcZ35QB9kTMmIr47bmxomsQpf84VzslMU2aTntrP1DZ7kwPpQyYw-4ndX0lx8Wu1kZCOM Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8131bad014684bb0973ae16c4aad02d5 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:13.348236 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8131bad014684bb0973ae16c4aad02d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8131bad014684bb0973ae16c4aad02d5 Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1022533065 Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesAdminNegativeTest-1022533065-project Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: deedb2b40cc946c18b21f6859166f286 Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesAdminNegativeTest-1022533065-project Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. Oct 04 17:55:13.350090 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '6eec3b80-8ffb-4118-82d2-40e6a0bb51d8'} Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:13.351068 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. Oct 04 17:55:13.352648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.355635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.356191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Returning 404 to user: Instance 6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:13.357394 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15f2f103-f672-45d0-8b28-1671e486dc03 tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8" status: 404 len: 111 microversion: 2.1 time: 0.057033 Oct 04 17:55:13.360916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.361719 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 763/1409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1/servers/6eec3b80-8ffb-4118-82d2-40e6a0bb51d8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:13.364521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d4c13a1-69b8-4087-89df-8a3494b50470 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.254301 Oct 04 17:55:13.367083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.367953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: add46b9a-e4ce-4087-abe4-fe0da839c023] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.374899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.375675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.376355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.377279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.378002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.378572 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 647/1410] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:13.378883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.391704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.392335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.396311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 HTTP/1.1 Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:13.398218 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. Oct 04 17:55:13.399738 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'add46b9a-e4ce-4087-abe4-fe0da839c023'} Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:13.400555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. Oct 04 17:55:13.403802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:13.407605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance add46b9a-e4ce-4087-abe4-fe0da839c023 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:13.409039 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6744eca-eada-4e18-99de-854c2989095e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023" status: 404 len: 111 microversion: 2.1 time: 0.046302 Oct 04 17:55:13.410163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 764/1411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1/servers/add46b9a-e4ce-4087-abe4-fe0da839c023 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:13.415433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "add46b9a-e4ce-4087-abe4-fe0da839c023", "name": "network-vif-deleted", "tag": "8630bc0b-f935-41f9-a5c8-39bae62eed7a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:13.426761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.428698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.429379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.452872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.453863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] Creating event network-vif-deleted:8630bc0b-f935-41f9-a5c8-39bae62eed7a for instance add46b9a-e4ce-4087-abe4-fe0da839c023 on n-h2-831194-21 Oct 04 17:55:13.460418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-bb2639a8-4a68-4512-b3d3-d55480e400a0 req-3f5106bc-e44a-45cb-a3e4-95faf4d4ba3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048742 Oct 04 17:55:13.461039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 765/1412] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:13.461331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.462899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.466105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ab2970f-0909-4912-9211-1a67852ca132 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1285 microversion: 2.32 time: 0.085694 Oct 04 17:55:13.467243 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 648/1413] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:13.473582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e933a00b-e992-4942-a9a1-67713c74c7ae tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] Calling method '.version_select at 0x7fbdbd7b6ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.478528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.494792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.495671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-163091202', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:13.500905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e933a00b-e992-4942-a9a1-67713c74c7ae tempest-VolumesAdminNegativeTest-1022533065 tempest-VolumesAdminNegativeTest-1022533065-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-507527062" status: 202 len: 0 microversion: 2.1 time: 0.031942 Oct 04 17:55:13.503419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 649/1414] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:55:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-507527062 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:13.509356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.509874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.519964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.520469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.520917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.521626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.523105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.523864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.530424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.531090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.531538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.532284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.532745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.533345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.580478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:13.700164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:13.793776 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-39b31803-c433-46b3-a115-c196f8450f3e tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 204 len: 0 microversion: 2.1 time: 0.286799 Oct 04 17:55:13.799626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 650/1415] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:13 2022] DELETE /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:13.807260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:13.810369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:13.827548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:13.830257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.830839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.831235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.831971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.832429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.832869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.845260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:13.845762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:13.846264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:13.876159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:14.032827 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fdc671b-986d-42d6-a5fc-b7399cf7b87a tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 204 len: 0 microversion: 2.1 time: 0.231095 Oct 04 17:55:14.034222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 651/1416] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:13 2022] DELETE /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:14.047580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:14.048488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:14.063041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.063697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.064269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.065371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.066060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.066754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.200094 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f5e84341-3bb3-45a8-b0b8-5f5f7d066eb8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-163091202" status: 200 len: 1513 microversion: 2.1 time: 0.732480 Oct 04 17:55:14.200848 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 766/1417] 10.222.0.42 () {58 vars in 1261 bytes} [Tue Oct 4 17:55:13 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-163091202 => generated 1513 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:14.228761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:14.233907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.234728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:14.240332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.242082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.242597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.243354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.243820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.244249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.380393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:14.513780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.545122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f3a12c6-bd63-444e-8dc8-cd4cd94ca8df tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1475 microversion: 2.1 time: 0.499743 Oct 04 17:55:14.547875 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 652/1418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:14 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1475 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:14.569683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:14.575506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:14.593342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.596279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.598082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.599565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.599974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.601615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.625776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.641159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:14.641682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:14.642238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:14.922348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.932149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.936855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:14.941785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9018cc6e-a02a-46fe-8851-6c5140fc15f9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.390945 Oct 04 17:55:14.943561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 653/1419] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:14 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:14.956457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:14.958975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:15.146774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:15.158277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:15.165548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:15.167845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f28dc18-890e-4197-8b40-5cf5ad4ce1a8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1285 microversion: 2.32 time: 0.221538 Oct 04 17:55:15.173586 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 654/1420] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:14 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:15.178588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2675c593-64c2-4f3f-afe2-95c16acfd0a0", "name": "network-vif-plugged", "status": "completed", "tag": "300ba45e-98fd-4b51-afc8-87c09c85ed51"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:15.201033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.211694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.212385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.225167 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] Creating event network-vif-plugged:300ba45e-98fd-4b51-afc8-87c09c85ed51 for instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 on n-h1-831194-21 Oct 04 17:55:15.231228 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-83764b41-c54b-4b33-b639-df7523c48baf req-d8c2fc39-3ba4-484e-a0f7-399053725fdf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056056 Oct 04 17:55:15.232414 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 655/1421] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:15.304762 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ba08a280-e7d2-439b-af98-c76fdc2fb7b1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4515 microversion: 2.1 time: 1.081304 Oct 04 17:55:15.318639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 767/1422] 10.222.0.42 () {58 vars in 1173 bytes} [Tue Oct 4 17:55:14 2022] GET /compute/v2.1/servers/detail?status=active => generated 4515 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:15.337327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:15.346560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:15.347396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.compute.servers [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Removing options 'limit' from query {{(pid=128850) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 17:55:15.349344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:15.360646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.361869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.362576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.363568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.364247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.364943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.439512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:15.448859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.449760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.450467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.572366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:15.574060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:15.584745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.585588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.586273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.587240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:15.587921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:15.589094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:15.989337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eed744ea-8cda-4bdc-b1be-5bc78a9fab6d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.656216 Oct 04 17:55:15.998623 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 656/1423] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 17:55:15 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:16.013453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.014791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:16.026187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.027704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.031411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.032576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.033926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.034817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.049718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.057553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92c44226-84b4-44da-8441-44e30d8cffd4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1475 microversion: 2.1 time: 0.489861 Oct 04 17:55:16.061428 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 768/1424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:15 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1475 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:16.066264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.081137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.086357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:16.096779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.097511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.098137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.099041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.110645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.111105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.141272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:16.158827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:16.178340 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-879ba90b-f4af-48eb-b2ed-ef47975dc522 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.115325 Oct 04 17:55:16.179984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 769/1425] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:16.197597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.204561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.205856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.servers [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Removing options 'limit' from query {{(pid=128849) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 17:55:16.207069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:16.213807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.214672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.215717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.216682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.217367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.218055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.260498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:16.310783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a596344-f74b-474b-aa32-cb5aa04aaa3a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.114172 Oct 04 17:55:16.322304 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 770/1426] 10.222.0.42 () {58 vars in 1150 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:16.335019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.336412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:16.351587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.356641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.357338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.358264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.358889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.359475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.574163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.593132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.598250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.599751 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a555b9ed-2d41-4c62-9d53-e981efda2ba6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1362 microversion: 2.25 time: 0.599405 Oct 04 17:55:16.618430 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 657/1427] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:15 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1362 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:16.634505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.649146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.650336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:16.662553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.663546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.664346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.666479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.667239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.668522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.674375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.696378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.698073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.699867 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9041a7c-0f68-4935-92f3-38d1bd899bee tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1583 microversion: 2.32 time: 0.375345 Oct 04 17:55:16.710905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 771/1428] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1583 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:16.747591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:16.840949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83d9f7f0-67f9-4b2e-9661-df9f0d56c52e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.217963 Oct 04 17:55:16.845450 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 658/1429] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers => generated 1010 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:16.860758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:16.878614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:16.879354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:16.891973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.892476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.892910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:16.893646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:16.902649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:16.903337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.095429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:17.096140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:17.100103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:17.129679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.130787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.131318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.140923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.141486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.144261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.195961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:17.410852 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-860a3af5-46e0-45df-b232-75eaded0083c tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.553748 Oct 04 17:55:17.426356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 772/1430] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:55:16 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:17.437303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:17.455552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:17.456999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.servers [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Removing options 'limit' from query {{(pid=128849) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 17:55:17.459248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:17.471284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.476445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.477094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.478800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.480763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.482686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.556009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1908ba1e-b5ca-4df8-8f8a-e06103889585 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.121876 Oct 04 17:55:17.569416 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 773/1431] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 17:55:17 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:55:17.581690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:17.596389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:17.599198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-163091202', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:17.613356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.616880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.617514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.620928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:17.622468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:17.626190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:17.881401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:18.024731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92cf9d66-3066-4fc4-85d3-e7bf84c39e94 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-163091202" status: 200 len: 345 microversion: 2.1 time: 0.453788 Oct 04 17:55:18.030877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 774/1432] 10.222.0.42 () {58 vars in 1240 bytes} [Tue Oct 4 17:55:17 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-163091202 => generated 345 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:18.046376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:18.047623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:18.056045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.056839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.057545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.058846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.059535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.060575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.102366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:18.111083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f04ab31a-221f-460c-9493-d70238137e9f tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1475 microversion: 2.1 time: 1.022910 Oct 04 17:55:18.155269 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 659/1433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:17 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1475 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:18.178054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:18.179146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:18.190656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.194344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.195016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.202913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:18.206462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:18.207153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:18.484410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:18.973462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.034353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.050648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.063514 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15e7fb01-1bce-4023-9293-7219a95c224d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1593 microversion: 2.32 time: 0.903098 Oct 04 17:55:19.068564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 660/1434] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:18 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1593 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:19.094450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:19.123985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.128053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.128603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.310975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Going to try to stop instance {{(pid=128850) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 17:55:19.411758 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f74d40bd-b929-484c-a36d-6c363d9db07a tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "POST /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b/action" status: 202 len: 0 microversion: 2.1 time: 0.341481 Oct 04 17:55:19.416191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 661/1435] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:55:19 2022] POST /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:19.429676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52bdd498-3f70-4009-96aa-5958a58325d3", "name": "network-vif-deleted", "tag": "5823281c-e1ca-42d0-804f-e35745ec0c09"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:19.452883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.453647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.456234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.490117 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] Creating event network-vif-deleted:5823281c-e1ca-42d0-804f-e35745ec0c09 for instance 52bdd498-3f70-4009-96aa-5958a58325d3 on n-h1-831194-21 Oct 04 17:55:19.502845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-13d56b0b-b7f0-4bf1-99d1-bc1ab86675fa req-854192b7-6316-4438-88e5-86687b912842 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078845 Oct 04 17:55:19.505722 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 662/1436] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:19.517796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.521209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.535868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.536390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.539070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.539841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.540558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.541326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.632749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.633473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.636260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.636823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lazy-loading 'fault' on Instance uuid 5b41563a-8ab1-4067-a385-5eb03bb6c725 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:19.753209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:19.766356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e71b7f4e-e21a-4a96-bd4c-10d27ba09096 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 200 len: 1309 microversion: 2.1 time: 0.256441 Oct 04 17:55:19.768766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 663/1437] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 1309 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:19.783219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:19.788849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:19.798418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.799207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.802116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:19.803052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:19.803769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:19.806286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.374281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.393367 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6472b69-bee6-4405-9561-1b747d909523 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1520 microversion: 2.1 time: 0.617271 Oct 04 17:55:20.395930 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 664/1438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:19 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1520 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:20.414419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.415617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:20.426389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.428283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.429630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.430857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.431596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.432286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.531422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.548002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.550118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.551503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4090ba95-f15f-4811-85cc-339963b4a9eb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1559 microversion: 2.25 time: 2.519388 Oct 04 17:55:20.569988 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 775/1439] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:18 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1559 bytes in 2538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:20.874906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:20.875981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:20.885195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.885723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.886191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.886911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:20.887370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:20.887792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:20.961076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.971961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.983964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:20.989601 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3941a850-7f0d-416a-839f-5d75d988781e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1660 microversion: 2.32 time: 0.592103 Oct 04 17:55:21.002643 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 665/1440] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1660 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:21.024907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.026863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 5b41563a-8ab1-4067-a385-5eb03bb6c725] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.038806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.043326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.045445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.051182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.051800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.052380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.090719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 HTTP/1.1 Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:55:21.092535 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. Oct 04 17:55:21.094281 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5b41563a-8ab1-4067-a385-5eb03bb6c725'} Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:21.095247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. Oct 04 17:55:21.096905 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.098595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:21.099367 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2dc1b889-9096-4c95-b7e2-4b98c670a55d tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725" status: 404 len: 111 microversion: 2.1 time: 0.095433 Oct 04 17:55:21.100241 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 666/1441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/5b41563a-8ab1-4067-a385-5eb03bb6c725 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:21.117531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.126510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 52bdd498-3f70-4009-96aa-5958a58325d3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.133728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.134250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.134684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.139580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.140525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.140525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.180537 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 HTTP/1.1 Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:55:21.182093 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. Oct 04 17:55:21.184189 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '52bdd498-3f70-4009-96aa-5958a58325d3'} Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:21.185077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. Oct 04 17:55:21.186461 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:21.187666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 52bdd498-3f70-4009-96aa-5958a58325d3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:21.187666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b39e520-c400-4561-a206-e2b79b559dac tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3" status: 404 len: 111 microversion: 2.1 time: 0.079744 Oct 04 17:55:21.187833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 667/1442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/52bdd498-3f70-4009-96aa-5958a58325d3 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:21.201292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1082ea8-fb1e-4d0f-bbd7-ca28c9948f23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.360936 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1082ea8-fb1e-4d0f-bbd7-ca28c9948f23 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/249e5257-650c-463b-9c13-33ebb9551c51" status: 204 len: 0 microversion: 2.1 time: 0.169638 Oct 04 17:55:21.362825 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 668/1443] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 17:55:21 2022] DELETE /compute/v2.1/os-server-groups/249e5257-650c-463b-9c13-33ebb9551c51 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:21.373048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.374025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.410853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.412942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.414739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.420513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.423163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.425002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.488608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:21.685450 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8081d62-1439-4ea3-bd7c-b7d50b21c485 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 204 len: 0 microversion: 2.1 time: 0.300259 Oct 04 17:55:21.686766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 669/1444] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:21 2022] DELETE /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:21.695375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.696584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.707134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.707683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.708351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.711694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.712426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.712832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.825210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 2675c593-64c2-4f3f-afe2-95c16acfd0a0 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:21.866759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b26148d1-6c51-4887-974b-5a952784f85f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 2054 microversion: 2.25 time: 1.288085 Oct 04 17:55:21.868306 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 776/1445] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:20 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 2054 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:21.879955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b41563a-8ab1-4067-a385-5eb03bb6c725", "name": "network-vif-deleted", "tag": "3281c1fb-60ff-47a0-a8b6-d29cd5a3125d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:21.903139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.904050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.905315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.939500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] Creating event network-vif-deleted:3281c1fb-60ff-47a0-a8b6-d29cd5a3125d for instance 5b41563a-8ab1-4067-a385-5eb03bb6c725 on n-h2-831194-21 Oct 04 17:55:21.951166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b24d1c29-3276-498f-aa6f-831baf5cece5 req-0eb04c4f-f06f-4878-9477-f3e318ad0cd6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080747 Oct 04 17:55:21.952670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 777/1446] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:21.958884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:21.959541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:21.968452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.968963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.969413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:21.970222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:21.970685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:21.971118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.019954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:22.029694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:22.040600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5bc50af8-8dba-4ef4-a493-dd83d5be3aed tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1520 microversion: 2.1 time: 0.352045 Oct 04 17:55:22.045794 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 670/1447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:21 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1520 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:22.050622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.059030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.083655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.084527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.085149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.086116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.086755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.087341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.209578 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-856d7314-5f20-4334-a481-5266c13062ce tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 204 len: 0 microversion: 2.1 time: 0.255250 Oct 04 17:55:22.210877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 778/1448] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:21 2022] DELETE /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:22.219420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.220199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.234490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.235004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.235450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.236177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.236638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.245494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.565915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 2675c593-64c2-4f3f-afe2-95c16acfd0a0 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:22.920191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92bdea09-7c25-4d45-a5c0-80c19a1a1380 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 2054 microversion: 2.25 time: 0.873074 Oct 04 17:55:22.921694 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 671/1449] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 2054 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:22.929672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:22.931024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:22.939571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.940742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.941458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:22.942780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:22.943378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:22.943874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.421237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.438975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.440211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.446589 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e90c1410-dba5-44f1-b125-1b5030d73417 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1660 microversion: 2.32 time: 1.229244 Oct 04 17:55:23.447234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 779/1450] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1660 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:23.460253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:23.466172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.466676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.467131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.467891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.468354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.468789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.506252 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d99f8ef3-50cd-46d9-889b-80d7029f7f13 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.046390 Oct 04 17:55:23.521917 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 780/1451] 10.222.0.42 () {60 vars in 1217 bytes} [Tue Oct 4 17:55:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:55:23.527873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:23.532319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:23.547688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.549947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.550850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.554717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.555366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.556146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.886317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:23.899672 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d183b889-ec92-4e67-8e03-5ba34e186947 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 200 len: 1473 microversion: 2.1 time: 0.974385 Oct 04 17:55:23.902479 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 672/1452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:22 2022] GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 1473 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:23.925925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831194-21", "block_migration": "auto"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:23.930688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:23.951550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.952276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.952851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.953905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:23.954490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:23.955184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:23.999855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'flavor' on Instance uuid 2675c593-64c2-4f3f-afe2-95c16acfd0a0 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:24.018717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Going to try to live migrate instance to n-h2-831194-21 {{(pid=128850) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:55:24.297331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.312863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6e80d98-94db-4ab5-8b84-7b162b305f87 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1520 microversion: 2.1 time: 0.783119 Oct 04 17:55:24.314108 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 781/1453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:23 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1520 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:24.472402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:24.473823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:24.484585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.485226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.485864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.486697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.488436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.492567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.624418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:24.869428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.884265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.890982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:24.892491 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5e4e98b-21f7-4875-b669-d2c6613160f5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1706 microversion: 2.32 time: 0.423894 Oct 04 17:55:24.893243 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 782/1454] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:24 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1706 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:55:24.929872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:24.930736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:24.946315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.947272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.948147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:24.949147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:24.949774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:24.951242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.277635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:25.286235 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b71e9452-ac45-44ea-8fa5-23a2b6c3f505 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 200 len: 1473 microversion: 2.1 time: 0.360327 Oct 04 17:55:25.286831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 783/1455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:24 2022] GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 1473 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:25.347222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:25.349337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:25.357753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.358745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.359366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.360293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:25.361177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:25.361764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:25.438188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:26.695848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:26.867415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:26.892625 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eee6dd24-8258-4ff6-9b7e-f0cf43825f78 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1520 microversion: 2.1 time: 1.554821 Oct 04 17:55:26.910489 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 784/1456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:25 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1520 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:26.918891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:26.920823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:26.944410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:26.946104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:26.947269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:26.951218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:26.952050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:26.953946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:27.004809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:28.655534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:28.666707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:28.679821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:28.681317 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15670fca-6d5e-4604-9891-6108c34ffae4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1752 microversion: 2.32 time: 1.769280 Oct 04 17:55:28.682650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 785/1457] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:26 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1752 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:28.687888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75e69b98-1b15-4b2c-998f-d7a7d2119f41", "name": "network-vif-deleted", "tag": "8eccd1db-8c16-49f0-87a5-ca529a4d2a59"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:28.709530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.710051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.710494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.736572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] Creating event network-vif-deleted:8eccd1db-8c16-49f0-87a5-ca529a4d2a59 for instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 on n-h1-831194-21 Oct 04 17:55:28.755182 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f5e77b83-7283-45f6-b4c1-0e2b90b37920 req-bb9fc090-684e-4d2d-a1be-2e5c134431ee service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070892 Oct 04 17:55:28.756113 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 786/1458] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:28.768141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:28.769098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:28.777044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.777821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.778965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.779877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.780517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.782441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.803568 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc HTTP/1.1 Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:28.821091 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. Oct 04 17:55:28.823496 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0a1c4eeb-7706-4a4a-b2d0-77a334e490cc'} Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:28.824497 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. Oct 04 17:55:28.826153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:28.829040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:28.830201 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b7e97d8-28a7-4012-9818-723dbd2533c5 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc" status: 404 len: 111 microversion: 2.1 time: 0.072662 Oct 04 17:55:28.832833 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 787/1459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:28 2022] GET /compute/v2.1/servers/0a1c4eeb-7706-4a4a-b2d0-77a334e490cc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:28.852497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:28.853455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:28.858047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:28.878180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.879726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.880739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:28.883142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:28.887614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:28.888301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.420384 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b923483-f7f0-4e7a-aba8-cbab2a061f0c tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0/action" status: 202 len: 0 microversion: 2.25 time: 5.516304 Oct 04 17:55:29.424979 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 673/1460] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:55:23 2022] POST /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0/action => generated 0 bytes in 5521 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:29.431339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:29.433410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:29.449711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.450976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.452906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.454545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.455821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.457350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.534841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:29.856028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:29.864263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac78d7d2-8795-4be6-8991-f20413ddb247 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1520 microversion: 2.1 time: 1.026879 Oct 04 17:55:29.870669 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 788/1461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:28 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1520 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:29.882123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:29.885473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 75e69b98-1b15-4b2c-998f-d7a7d2119f41] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:29.903153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.903997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.905376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.906660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:29.907347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:29.908018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:29.941992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 HTTP/1.1 Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:29.943986 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. Oct 04 17:55:29.945577 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '75e69b98-1b15-4b2c-998f-d7a7d2119f41'} Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:29.946498 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. Oct 04 17:55:29.947981 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:29.950980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 75e69b98-1b15-4b2c-998f-d7a7d2119f41 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:29.952081 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ee6be5d-4aa3-462b-99cb-a31e43725d37 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41" status: 404 len: 111 microversion: 2.1 time: 0.080090 Oct 04 17:55:29.953309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 789/1462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:29 2022] GET /compute/v2.1/servers/75e69b98-1b15-4b2c-998f-d7a7d2119f41 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:29.960763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:29.961650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:29.999051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.000092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.001005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.004490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.005297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.006035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.033292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef803f55-9bc4-4db1-a81c-2dd7a1dd6aa6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1860 microversion: 2.1 time: 0.606783 Oct 04 17:55:30.041995 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 674/1463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:29 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1860 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:30.047979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.048935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.060494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.061130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.061654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.062490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.063046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.063551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.511018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.529050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.531393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.533441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8a0d256-8e5d-4017-979b-b8771d8ca41c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1798 microversion: 2.32 time: 0.494921 Oct 04 17:55:30.534758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 675/1464] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:30 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1798 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:30.536761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.542172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a98808d7-faef-4097-b43b-e3221981ecf4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.552966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.554379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:30.555560 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d539d756-51df-48b3-bef8-67043319e92c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.601038 Oct 04 17:55:30.556116 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 790/1465] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:29 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:30.566719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": true, "disk_over_commit": false}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:30.575687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.590506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.591052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.591497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.592311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.593232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.593674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.596508 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a98808d7-faef-4097-b43b-e3221981ecf4 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/03c71245-b7bf-457f-be82-1815e51c4075" status: 204 len: 0 microversion: 2.1 time: 0.059726 Oct 04 17:55:30.597747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 676/1466] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 17:55:30 2022] DELETE /compute/v2.1/os-server-groups/03c71245-b7bf-457f-be82-1815e51c4075 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:30.610144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.611071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.628958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.629974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.630828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.631766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.632425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.633051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.676277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:30.786382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lazy-loading 'flavor' on Instance uuid 0aebe331-591b-4fc2-bb54-3f516d4453dd {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:30.877005 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77f008b0-2b87-4c4a-aa59-e8e2b2612262 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 204 len: 0 microversion: 2.1 time: 0.274191 Oct 04 17:55:30.878528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 677/1467] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:30 2022] DELETE /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:55:30.891262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:30.894258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:30.902366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128849) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:55:30.911022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.911531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.911972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:30.912890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:30.913544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:30.914179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.327826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:31.338414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5820489-0c52-4097-9a64-379cd5c59980 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1472 microversion: 2.1 time: 0.455057 Oct 04 17:55:31.339223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 678/1468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:30 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1472 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:31.354951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:31.355905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:31.366781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.367277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.367714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.368418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.368872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.369438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.850388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:31.864499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ec84cc0-c123-416d-a507-dcda9c2e1ad7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1497 microversion: 2.1 time: 0.521090 Oct 04 17:55:31.866983 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 679/1469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:31 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1497 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:31.879118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a1c4eeb-7706-4a4a-b2d0-77a334e490cc", "name": "network-vif-deleted", "tag": "52dee37a-3676-4954-a30f-4ad237b55f1c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:31.910742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.911267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.911725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.934833 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] Creating event network-vif-deleted:52dee37a-3676-4954-a30f-4ad237b55f1c for instance 0a1c4eeb-7706-4a4a-b2d0-77a334e490cc on n-h1-831194-21 Oct 04 17:55:31.934833 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-51801d5b-0ba9-4733-82ef-327ba864b9f5 req-c50b99bc-bc77-4a2a-944a-19f6d0d224c9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063240 Oct 04 17:55:31.934833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 680/1470] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:31.940244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:31.940961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:31.949284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.949795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.950421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:31.951602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:31.952345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:31.952952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:33.279346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:33.291658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:33.293199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:33.305005 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f882763-2e71-4cdb-986c-ffb137d16943 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1844 microversion: 2.32 time: 1.369506 Oct 04 17:55:33.306072 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 681/1471] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:31 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1844 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:33.324888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:33.325963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:33.335185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:33.336097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:33.336783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:33.337776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:33.339333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:33.342402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:33.475480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=22 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:34.064155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.076909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.078810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.080312 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74ac10fb-049d-4d70-b9f8-35164036cd7a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.772645 Oct 04 17:55:34.104831 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 682/1472] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:33 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:34.117810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:34.124075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:34.127922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:34.137563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.139042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.139737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.141349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.142076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.142749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.334416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:34.455114 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f49a4cae-90b9-4fdf-9543-fd23e5b9a316 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.348275 Oct 04 17:55:34.465706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 683/1473] 10.222.0.42 () {58 vars in 1154 bytes} [Tue Oct 4 17:55:34 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:34.473351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:34.475752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:34.483059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.484260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.485043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:34.486975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:34.487702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:34.488329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.153370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b63f236c86fc48dca2ec03eca543d7c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '468f9964fe8b4cd8a635b9ae8ae67fda', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:35.172092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c397dcd6-14d4-4496-8afa-f363319956b8 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 200 len: 1472 microversion: 2.1 time: 0.703161 Oct 04 17:55:35.174820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 684/1474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:34 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 1472 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:35.179857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:35.180884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:35.199264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.199776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.200224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.200968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.201432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.201895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:35.812507 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8afc5145-5bc8-4158-8975-63fce33fa677 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/action" status: 202 len: 0 microversion: 2.1 time: 5.251930 Oct 04 17:55:35.816079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 791/1475] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:55:30 2022] POST /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/action => generated 0 bytes in 5253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:35.819085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:35.849988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:35.850333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:35.850955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.040856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Going to try to start instance {{(pid=128849) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 17:55:36.133684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca0cf238-c0de-4594-894c-a33ea7197db8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "POST /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b/action" status: 202 len: 0 microversion: 2.1 time: 0.318541 Oct 04 17:55:36.134327 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 792/1476] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:55:35 2022] POST /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:55:36.444724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Calling method '.version_select at 0x7fbdbd286160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:36.546314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:55:36.547141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Neutron security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:55:36.547866 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] HTTP exception thrown: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.547866 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Request method failure captured: Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/f0437cd8-2f0e-4ae9-8fbc-5443c3789168 HTTP/1.1 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOWxcEVMi6PthrYZpdBhrlB2_WFZzJKjeMfpDLZ8iFE4DIv167Tlt6vq_la8hDD80AUKkfLpjvf_jkq7XaIWpZOWRwNh9NajA3AiadNeBDrf-AvKJfm1A25Zvb7fWVfj_1M4O2A1lKX3v_Y795j7TGiMiAyqvzMA8fR4CmlfQ4utsQ Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:36.550163 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_96aa51eb597e4d3286ec77589792c965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 12e27ec0b65941c79599755c655232f7 Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.551928 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'f0437cd8-2f0e-4ae9-8fbc-5443c3789168'} Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:36.553058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:55:36.555175 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.557451 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] Oct 04 17:55:36.560774 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:36.565856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Returning 404 to user: Security group f0437cd8-2f0e-4ae9-8fbc-5443c3789168 does not exist Oct 04 17:55:36.565856 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-fe75e93e-24ef-4873-9433-1fee7c00c68d'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:36.565856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f4d511b-8140-4511-96ff-f6df7260b0cb tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/f0437cd8-2f0e-4ae9-8fbc-5443c3789168" status: 404 len: 194 microversion: 2.1 time: 0.423898 Oct 04 17:55:36.565856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 793/1477] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:55:36 2022] DELETE /compute/v2.1/os-security-groups/f0437cd8-2f0e-4ae9-8fbc-5443c3789168 => generated 194 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:36.574992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2675c593-64c2-4f3f-afe2-95c16acfd0a0", "name": "network-vif-unplugged", "status": "completed", "tag": "300ba45e-98fd-4b51-afc8-87c09c85ed51"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:36.606011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:36.607582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:36.612937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.639465 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] Creating event network-vif-unplugged:300ba45e-98fd-4b51-afc8-87c09c85ed51 for instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 on n-h1-831194-21 Oct 04 17:55:36.658833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f4362beb-6c8d-4ea6-9685-5d69c7f8b030 req-1ef6b6a5-375e-4bdf-8ef1-c15bf61fa39a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093420 Oct 04 17:55:36.659742 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 794/1478] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:36.671465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:36.678426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:36.691621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:36.694845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:36.695580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.696592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:36.705103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:36.705972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.819576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:36.835333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:36.837488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:36.839029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f4c905a6-be68-4334-8f26-761f6d463ff9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1844 microversion: 2.32 time: 1.663202 Oct 04 17:55:36.840113 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 685/1479] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:35 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1844 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:36.845494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:36.846742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:36.853300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:36.854351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:36.854953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:36.855851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:36.856797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:36.857398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.296535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.313909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.315678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.317254 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81a777af-6b3f-4574-a4e5-d469fe052a8d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.656043 Oct 04 17:55:37.318428 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 795/1480] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:36 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:37.324217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.324999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:37.332168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.332956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.333744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.334821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.335975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.337002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.691811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.707079 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc5090e7-cc7f-4647-9cfd-82b1ad8813f1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.865407 Oct 04 17:55:37.707814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 686/1481] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:36 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:37.718544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:37.725038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.735189 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d009788-399b-4b03-9470-a08b72078cc2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1506 microversion: 2.1 time: 0.415302 Oct 04 17:55:37.736377 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 796/1482] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:37.738616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] [instance: 1e11f48b-fbc6-4dad-a052-8de1fb5361d5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:37.743658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e3d5162-6b31-4440-a62e-1c8e8f49e093 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.005309 Oct 04 17:55:37.757397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.758623 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 797/1483] 10.222.0.42 () {58 vars in 1164 bytes} [Tue Oct 4 17:55:37 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 17:55:37.760302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.760302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.769011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2e7608c-878c-420b-8788-1e4f5523d448 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Calling method '.version_select at 0x7fbdbd2acd30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.769415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.771305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.776380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.806766 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] HTTP exception thrown: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Request method failure captured: Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 HTTP/1.1 Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHLCVLKzxjNIpKE0W6Fv1godau27md3uQSRhSl_STER5poly0o2oKbNln9yccJAbr8_vtVR3hEs0UAE3JeHtRDJbpMas4NLB4YZxqPrdipesdtvEUoK63bmUGKWKTlVra_HpejeIh3bcy3dwIitWOFvJJLne6wD5PPNKYk7evdDlzOA Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:55:37.809102 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_468f9964fe8b4cd8a635b9ae8ae67fda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 468f9964fe8b4cd8a635b9ae8ae67fda Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-793026548 Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b63f236c86fc48dca2ec03eca543d7c9 Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersOnMultiNodesTest-793026548-project Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. Oct 04 17:55:37.810630 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1e11f48b-fbc6-4dad-a052-8de1fb5361d5'} Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:37.811477 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. Oct 04 17:55:37.812808 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:37.817307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] Returning 404 to user: Instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:37.818469 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c2d55539-85b3-43e4-8215-b18826c41219 tempest-ServersOnMultiNodesTest-793026548 tempest-ServersOnMultiNodesTest-793026548-project] 10.222.0.42 "GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5" status: 404 len: 111 microversion: 2.1 time: 0.108731 Oct 04 17:55:37.819667 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 687/1484] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/servers/1e11f48b-fbc6-4dad-a052-8de1fb5361d5 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:37.870365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:37.871321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:37.881883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.886942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.887537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:37.890030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:37.890675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:37.891365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.770344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2e7608c-878c-420b-8788-1e4f5523d448 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 1.006057 Oct 04 17:55:38.777688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.781637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 798/1485] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:38.787807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.788497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:38.797956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.798156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.798387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.798893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.799568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:38.799708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.800124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.800565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.801009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-693f21c8-1273-4053-a3cf-980051bf8dd4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1844 microversion: 2.32 time: 0.936343 Oct 04 17:55:38.801645 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 688/1486] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:37 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1844 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:55:38.812161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:38.813051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:38.825114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.836781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.837525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:38.838596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:38.839267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:38.839923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.345423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.359508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.366565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:39.369352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c03ba07-e8e4-4b9d-94a3-0a29f880f22a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.586063 Oct 04 17:55:39.371757 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 799/1487] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:39.387032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e11f48b-fbc6-4dad-a052-8de1fb5361d5", "name": "network-vif-deleted", "tag": "4786d7fc-35b2-4b7a-acde-5b4e1a90a129"}, {"name": "network-changed", "server_uuid": "2675c593-64c2-4f3f-afe2-95c16acfd0a0", "tag": "300ba45e-98fd-4b51-afc8-87c09c85ed51"}, {"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "c0e2a82b-d291-45a2-a17a-2b9ae86d6207"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:39.417441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.424361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.424361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.465357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Creating event network-vif-deleted:4786d7fc-35b2-4b7a-acde-5b4e1a90a129 for instance 1e11f48b-fbc6-4dad-a052-8de1fb5361d5 on n-h1-831194-21 Oct 04 17:55:39.468444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Creating event network-changed:300ba45e-98fd-4b51-afc8-87c09c85ed51 for instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 on n-h1-831194-21 Oct 04 17:55:39.469246 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] Creating event network-changed:c0e2a82b-d291-45a2-a17a-2b9ae86d6207 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:39.487732 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-88edf05b-4321-41ee-b59c-8a03c20ede9c req-a5757dcb-7c39-4545-ae12-809e03b44c7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.110522 Oct 04 17:55:39.491299 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 800/1488] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:39.499936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:39.502046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:39.520492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.521925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.523657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:39.524520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:39.527919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:39.528503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.110964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:40.124286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc4db854-1f1a-4082-9a08-9c581a7349d2 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1510 microversion: 2.1 time: 0.628276 Oct 04 17:55:40.142981 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 801/1489] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:39 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1510 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:40.157401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Calling method '.version_select at 0x7fbdbd239280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.700454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:55:40.701228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 04 17:55:40.701228 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Request method failure captured: Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-security-groups/be248c34-34ad-4d31-a0e0-98cd640d01b7 HTTP/1.1 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOWxcEVMi6PthrYZpdBhrlB2_WFZzJKjeMfpDLZ8iFE4DIv167Tlt6vq_la8hDD80AUKkfLpjvf_jkq7XaIWpZOWRwNh9NajA3AiadNeBDrf-AvKJfm1A25Zvb7fWVfj_1M4O2A1lKX3v_Y795j7TGiMiAyqvzMA8fR4CmlfQ4utsQ Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:40.703504 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_96aa51eb597e4d3286ec77589792c965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 12e27ec0b65941c79599755c655232f7 Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: exception: Insufficient rights for removing default security group. Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.705225 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'be248c34-34ad-4d31-a0e0-98cd640d01b7'} Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:40.706189 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 04 17:55:40.707800 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:40.709873 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-b13ccf7d-4cc7-47b2-81ec-24b96049f4bb'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:40.712113 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3957ad0-2214-405e-a2b8-3e27df5ee210 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/be248c34-34ad-4d31-a0e0-98cd640d01b7" status: 400 len: 182 microversion: 2.1 time: 0.561487 Oct 04 17:55:40.713749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:40.719261 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 802/1490] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:55:40 2022] DELETE /compute/v2.1/os-security-groups/be248c34-34ad-4d31-a0e0-98cd640d01b7 => generated 182 bytes in 575 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:55:40.725048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35cfb0e0-19f1-4119-8dd5-d1346c18716c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.916660 Oct 04 17:55:40.725324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.731613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 689/1491] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:38 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:40.732741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:40.737390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.753056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.753945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.754652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.755632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.756325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.756987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.757136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:40.757476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.compute.servers [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Removing options 'limit' from query {{(pid=128850) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 17:55:40.767025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:40.768138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.770302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.770749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.773695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.774220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.779667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.781299 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a083c36-9e10-446b-93e6-fe74a5a281e8 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.048371 Oct 04 17:55:40.782400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 690/1492] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:55:40.815480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:40.816670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:40.831811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.833927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.834388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:40.837057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:40.838416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:40.840324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.082724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.092907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.096641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.098139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d5bedac-9632-4768-a4d5-0ce675a8d383 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1865 microversion: 2.32 time: 0.377741 Oct 04 17:55:41.117435 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 803/1493] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1865 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:41.123838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Calling method '.version_select at 0x7fbdbd33faf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.173556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:55:41.174480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Neutron security group 66117bfa-cffc-4737-8b45-a03f55c540a5 not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:55:41.175216 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] HTTP exception thrown: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.175216 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Request method failure captured: Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-security-groups/66117bfa-cffc-4737-8b45-a03f55c540a5 HTTP/1.1 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOWxcEVMi6PthrYZpdBhrlB2_WFZzJKjeMfpDLZ8iFE4DIv167Tlt6vq_la8hDD80AUKkfLpjvf_jkq7XaIWpZOWRwNh9NajA3AiadNeBDrf-AvKJfm1A25Zvb7fWVfj_1M4O2A1lKX3v_Y795j7TGiMiAyqvzMA8fR4CmlfQ4utsQ Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:55:41.177373 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_96aa51eb597e4d3286ec77589792c965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 12e27ec0b65941c79599755c655232f7 Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.179138 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '66117bfa-cffc-4737-8b45-a03f55c540a5'} Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.180215 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:55:41.183007 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.185165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Returning 404 to user: Security group 66117bfa-cffc-4737-8b45-a03f55c540a5 does not exist Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-cbf65497-a398-47e1-90e5-b27ae32c157e'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc898475-0f22-447e-923f-c69a0fb6adfa tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "GET /compute/v2.1/os-security-groups/66117bfa-cffc-4737-8b45-a03f55c540a5" status: 404 len: 194 microversion: 2.1 time: 0.069435 Oct 04 17:55:41.194409 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 804/1494] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/os-security-groups/66117bfa-cffc-4737-8b45-a03f55c540a5 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:41.200922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.201898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:41.230440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.230932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.231580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.232283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.232731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.233310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.410514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.422021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.424070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.427729 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0eb4e642-713e-44b2-b400-2bf2dc561d38 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.644045 Oct 04 17:55:41.429026 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 691/1495] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:40 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:41.434854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Action: 'update', calling method: .version_select at 0x7fbdbd7bcdc0>, body: {"security_group": {"name": "tempest-sg-1889819554", "description": "tempest-description-1716633740"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:41.537993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:41.547352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7fb658a3-816b-447e-bbeb-17d77295d515 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1510 microversion: 2.1 time: 0.356299 Oct 04 17:55:41.548889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 805/1496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1510 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:41.576140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.577028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:41.583881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.586083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.586716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.588480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.589663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.590305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.598611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:55:41.599542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Neutron security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 not found {{(pid=128850) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:55:41.600914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] HTTP exception thrown: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.600914 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Request method failure captured: Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/os-security-groups/8e35bae6-5f56-451e-b9c2-f196a55cd283 HTTP/1.1 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 102 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHOWxcEVMi6PthrYZpdBhrlB2_WFZzJKjeMfpDLZ8iFE4DIv167Tlt6vq_la8hDD80AUKkfLpjvf_jkq7XaIWpZOWRwNh9NajA3AiadNeBDrf-AvKJfm1A25Zvb7fWVfj_1M4O2A1lKX3v_Y795j7TGiMiAyqvzMA8fR4CmlfQ4utsQ Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:55:41.603340 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96aa51eb597e4d3286ec77589792c965"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_96aa51eb597e4d3286ec77589792c965"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 96aa51eb597e4d3286ec77589792c965 Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-169572071 Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 12e27ec0b65941c79599755c655232f7 Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-169572071-project Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: {"security_group": {"name": "tempest-sg-1889819554", "description": "tempest-description-1716633740"}} Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:55:41.604938 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '8e35bae6-5f56-451e-b9c2-f196a55cd283', 'body': {'security_group': {'name': 'tempest-sg-1889819554', 'description': 'tempest-description-1716633740'}}} Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:55:41.605814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 04 17:55:41.607129 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.608436 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] Oct 04 17:55:41.609729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:41.614566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] Returning 404 to user: Security group 8e35bae6-5f56-451e-b9c2-f196a55cd283 does not exist Oct 04 17:55:41.614566 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7ab8189d-93dc-42e0-ba45-4ab45d0c75b2'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:41.615876 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15685550-d77b-4951-879c-b96d0bebc414 tempest-SecurityGroupsNegativeTestJSON-169572071 tempest-SecurityGroupsNegativeTestJSON-169572071-project] 10.222.0.42 "PUT /compute/v2.1/os-security-groups/8e35bae6-5f56-451e-b9c2-f196a55cd283" status: 404 len: 194 microversion: 2.1 time: 0.185515 Oct 04 17:55:41.630766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 692/1497] 10.222.0.42 () {60 vars in 1290 bytes} [Tue Oct 4 17:55:41 2022] PUT /compute/v2.1/os-security-groups/8e35bae6-5f56-451e-b9c2-f196a55cd283 => generated 194 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:41.754254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:41.756629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:41.763532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.764425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.765219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.766303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:41.766997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:41.767640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:41.797239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:41.996153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:42.010075 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1a66d60-89d6-4f91-b855-0c3aac949872 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1510 microversion: 2.1 time: 0.439269 Oct 04 17:55:42.011516 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 806/1498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1510 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:42.021880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "e715b681-6d3d-42b7-bf4c-9dab4479a0ba"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:42.036451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.037386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.038974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.046615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:42.063736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] Creating event network-changed:e715b681-6d3d-42b7-bf4c-9dab4479a0ba for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:42.070455 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-fb4f346d-4050-4467-a9db-95e17df953a3 req-fdb301fe-dca4-464d-b8a0-ceedf13de7ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056675 Oct 04 17:55:42.071723 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 807/1499] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:42.090075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.092021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:42.112751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.113480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.114076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.114885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.115419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.115930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.404404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:42.413538 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27499ad3-ecd1-44a2-86ba-409c24b9a24d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1512 microversion: 2.1 time: 0.340048 Oct 04 17:55:42.415899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 808/1500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:42.444797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.446980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:42.454612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.455433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.456116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.457050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:42.457714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:42.458391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:42.848586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:42.865421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ba131ab-45aa-4648-b638-3d9c8a2b13ba tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.114846 Oct 04 17:55:42.866340 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 693/1501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:41 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:42.880396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:42.895577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:42.896264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:43.286538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.300724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.308863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:43.310597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff9d4bc4-961d-49b8-8a99-54e0c383ed51 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1865 microversion: 2.32 time: 0.882879 Oct 04 17:55:43.313386 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 809/1502] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1865 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:43.325539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:43.329210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:43.344692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.345502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.346838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.348974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.350924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.351606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.773484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.774319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.776204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:43.778251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:43.781082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:43.781809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.013040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:44.114085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec7453b8-5271-46c3-a042-1c3f9d9073c9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 1.243575 Oct 04 17:55:44.117551 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 694/1503] 10.222.0.42 () {58 vars in 1154 bytes} [Tue Oct 4 17:55:42 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:44.129397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:44.130483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:44.142182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.144382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.145178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.146927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.147921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.148820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.782816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.795084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.798970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.800221 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d2a8811-ea42-44b9-b022-300b4f1a4601 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 1.484405 Oct 04 17:55:44.800851 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 810/1504] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:43 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:44.818518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:44.819203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:44.836072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.836828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.837982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.838912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.839383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.839819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.891242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:44.904199 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6f5037c-3d27-423c-b43b-4faa910292bb tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.784962 Oct 04 17:55:44.905407 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 695/1505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:44.919945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:44.921638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:44.931628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.932560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.933214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:44.934179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:44.934799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:44.935414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.461245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:45.479468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:45.481124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:45.482544 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24abd4ea-75c5-4f12-b70d-1957b621708f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1886 microversion: 2.32 time: 0.575947 Oct 04 17:55:45.483545 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 696/1506] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1886 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:45.731793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:45.755807 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-abe1ea7c-4e91-47c5-a36a-0504342e5847 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1510 microversion: 2.1 time: 0.953730 Oct 04 17:55:45.772695 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 811/1507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:44 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1510 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:45.784326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.784951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:45.793714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.794741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.795349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.800404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.801129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.801730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.830078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:45.831006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:45.849750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.850387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.851759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:45.852916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:45.855069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:45.855936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.278499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.294845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9316a8f4-549b-4624-a269-96ea00fbe81d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1510 microversion: 2.1 time: 0.514279 Oct 04 17:55:46.295757 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 697/1508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1510 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.305596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.306790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.327731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:46.331186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.331927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.332984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.334228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.334922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.335553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.516272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.530759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.532252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.541580 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8e32136-85ca-40e5-8bf6-aa03eba89d04 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 0.711592 Oct 04 17:55:46.543807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 812/1509] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:45 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:46.567083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "a67950f7-a222-4066-81f1-b63ffdaaf39d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:46.591834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.592609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.607489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.643267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] Creating event network-changed:a67950f7-a222-4066-81f1-b63ffdaaf39d for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:46.655037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f1a289a5-77b5-4b24-b6e4-88534a026bca req-22091c27-0c3f-4262-8209-36f956ce9763 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109785 Oct 04 17:55:46.659970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 813/1510] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:46.702532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.705809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.722121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.723050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.723855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.724968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.725658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.726379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.925065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:46.940525 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-43911151-32dd-4a4e-9e5a-57fb2b997b2d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.643161 Oct 04 17:55:46.942943 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 698/1511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:46.968355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:46.969088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:46.996081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.996775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:46.997399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:46.998706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:46.999338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:47.000074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.765401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.773807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.780998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.787182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.789759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c45ce6f-c926-4793-bac3-ed889b628358 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1886 microversion: 2.32 time: 0.845734 Oct 04 17:55:47.795091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-312f4773-b5da-44e6-9b6b-c18ae0dbdb66 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1512 microversion: 2.1 time: 1.118973 Oct 04 17:55:47.796218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 814/1512] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1512 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:47.806859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 699/1513] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:46 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1886 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:47.810427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.811322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:47.817663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:47.822962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:47.823432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.824190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:47.824642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:47.824769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:47.825076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.838976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:47.839800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:47.846096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:47.846656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:47.847244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.848359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:47.848827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:47.849254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:47.906793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:48.058593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:48.083583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:48.084347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:48.085115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.133286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:49.145979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:49.147437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:49.148609 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a31dc80-5333-4a0d-a4a4-9d735d96b56c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 1.351249 Oct 04 17:55:49.149167 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 815/1514] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:47 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:49.185114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:49.199439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:49.218851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.230181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.231042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.232044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.232738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.233396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.310028 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b005ea5-9faf-4c9e-a6c4-5573a01463f1 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 4515 microversion: 2.1 time: 1.492251 Oct 04 17:55:49.311190 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 700/1515] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:55:47 2022] GET /compute/v2.1/servers/detail => generated 4515 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:55:49.316138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:49.316843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:49.328798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.330387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.331475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:49.335140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:49.335877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:49.336546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.033171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.050109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.053961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.057437 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ab1b3bf-2552-45e5-824e-155f8c20ab55 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1886 microversion: 2.32 time: 0.745003 Oct 04 17:55:50.065025 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 701/1516] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1886 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:50.079707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.090153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.095147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:50.227303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.243776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-590c7084-3577-4724-99b1-e82a27013263 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.080850 Oct 04 17:55:50.246316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 816/1517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:49 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:50.280028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "e910d5c6-456a-4049-803a-bd29699c9db8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:50.311319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.313522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.314153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.353230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] Creating event network-changed:e910d5c6-456a-4049-803a-bd29699c9db8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:50.374999 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-43b94f2f-22b4-47ce-8a3e-c78b44ad10fc req-e673b811-30cc-4a43-a251-3b16b1a76fdb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112516 Oct 04 17:55:50.377656 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 817/1518] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:50.411147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.415500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:50.443437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.452277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.453663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.456369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.457128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.458225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.468117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.469610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.470453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.472958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.474411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.476513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.608752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:50.717846 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42ef99cb-5797-4982-8421-25150c6f206e tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.650974 Oct 04 17:55:50.733946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 702/1519] 10.222.0.42 () {58 vars in 1150 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:50.747662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:50.760019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:50.763010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:50.774156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.776991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.778877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.784349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:50.785526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:50.787032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:50.960111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:51.051609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0e41c517-c8f8-41b4-9c38-2c1c33d8768b tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.316213 Oct 04 17:55:51.060418 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 703/1520] 10.222.0.42 () {58 vars in 1212 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:51.066897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:51.074140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.085166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:51.093470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.094384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.095186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.096102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.096921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.097702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.252971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:51.347443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42f078b0-e352-479e-931d-fef95afa3592 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.285545 Oct 04 17:55:51.351296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 704/1521] 10.222.0.42 () {58 vars in 1196 bytes} [Tue Oct 4 17:55:51 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:51.361394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:51.362450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:51.380685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.382482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.384498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.385781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.386894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.388630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.396120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.413463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.418852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.421587 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-443d5576-d82d-498c-a935-fef523fe00bb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1569 microversion: 2.25 time: 1.040212 Oct 04 17:55:51.425332 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 818/1522] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:50 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1569 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:51.437654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:51.438760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:51.451652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.452183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.452669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.453387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.454129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.454845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.866912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.884853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.889888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.891421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f2c0230-f0a8-4ce5-90ef-08723a34c7e2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.538319 Oct 04 17:55:51.892172 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 705/1523] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:51 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:51.916556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:51.922417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:51.923159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': '-163091202', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:51.929498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.930096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.930615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:51.931456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:51.932291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:51.932795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.042989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:52.126709 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c9f1724-5f43-41c7-8c9e-e8147b724a41 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=-163091202" status: 200 len: 345 microversion: 2.1 time: 0.217911 Oct 04 17:55:52.128564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 706/1524] 10.222.0.42 () {58 vars in 1156 bytes} [Tue Oct 4 17:55:51 2022] GET /compute/v2.1/servers?name=-163091202 => generated 345 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:52.144284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.153594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:52.154844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:52.161276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.162036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.162919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.164237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.165020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.166455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.337971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:52.416003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:52.420407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c210789-d58b-4527-aee4-d0f16658ab26 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.281117 Oct 04 17:55:52.420780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 707/1525] 10.222.0.42 () {58 vars in 1154 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:52.425575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "5c7a6da1-ba4c-454e-8f5c-970dfade82c8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:52.436412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.436905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.437336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.450042 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] Creating event network-changed:5c7a6da1-ba4c-454e-8f5c-970dfade82c8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:52.455870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-83292526-1677-4866-9d02-94e9bbc66571 req-6985ee85-a801-4fe0-8433-30e7b34c8be9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033368 Oct 04 17:55:52.457515 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 708/1526] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:52.465150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.473545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:52.474882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-16309120', 'deleted': False, 'project_id': 'abb1b2887bb64298a7538044a6624b23'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:55:52.484797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.485684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.486444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.488527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.489409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.490257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.627954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:55:52.728592 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3866c92b-9530-4c8f-bbb7-1e0d6314aeaa tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-16309120" status: 200 len: 345 microversion: 2.1 time: 0.268130 Oct 04 17:55:52.736515 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 709/1527] 10.222.0.42 () {58 vars in 1226 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-16309120 => generated 345 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:52.737993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.738854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:52.747478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.748109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.748638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.749428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:52.749993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:52.751567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:52.938588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:52.954694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31e5738c-c2b8-4ba4-b67f-5d56dd6d0459 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.525658 Oct 04 17:55:52.955390 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 819/1528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:51 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:52.971913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:52.980263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.013568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.014868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.015523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.016677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.019834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.020686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.086367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:53.198541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04895b0d-fa0d-489a-900b-b3cac21b2c95 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 204 len: 0 microversion: 2.1 time: 0.239453 Oct 04 17:55:53.203248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 820/1529] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:52 2022] DELETE /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:53.215226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.229382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.229991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.246005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.250343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.250856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.252390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.252540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.253348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.254291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.254916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.256199 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-799af434-f766-4a0b-b888-91c53fd1e9f6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1559 microversion: 2.25 time: 0.524111 Oct 04 17:55:53.258132 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 710/1530] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:52 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1559 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:53.272476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.273424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.283616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.288128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.288799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.289737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.290494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.292839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.814327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.823652 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96bae6cc-1031-4753-b91a-57d6edccc2ba tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1518 microversion: 2.1 time: 0.562769 Oct 04 17:55:53.824358 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 711/1531] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1518 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:53.856069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5430433-ad10-4354-9102-00d894d2e7af tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '.version_select at 0x7fbdbda9f280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.859965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5430433-ad10-4354-9102-00d894d2e7af tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.860462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5430433-ad10-4354-9102-00d894d2e7af tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.860903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5430433-ad10-4354-9102-00d894d2e7af tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:53.874483 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5430433-ad10-4354-9102-00d894d2e7af tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1958 microversion: 2.25 time: 0.024877 Oct 04 17:55:53.875079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 712/1532] 10.222.0.42 () {60 vars in 1184 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/os-migrations => generated 1958 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:53.932673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.951195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.955696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:53.959966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b248300-952e-43c0-b79e-9ec99b01e273 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.755373 Oct 04 17:55:53.975082 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 821/1533] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:53.988729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:53.989630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:53.998082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:53.998889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:53.999512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.000397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.001021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.001755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.143645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1831999276", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "c33ce19a-c198-46b8-a446-c121fdf53f1c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:54.275054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] validate_networks() for [('c33ce19a-c198-46b8-a446-c121fdf53f1c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:54.396051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 2675c593-64c2-4f3f-afe2-95c16acfd0a0 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:55:54.430938 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdc5ab49-1c2f-44c4-8336-56eabc2cf7f4 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 2054 microversion: 2.25 time: 0.448791 Oct 04 17:55:54.432396 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 822/1534] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:53 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 2054 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:54.450657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:54.451730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:54.471086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.471590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.471809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.472518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:54.472997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:54.475879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:54.685162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:54.687511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:54.695363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08d6d28a-6fe5-433d-aaca-7910c365d6e4 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.261528 Oct 04 17:55:54.695974 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 823/1535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:54 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:54.717881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-780949439", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "0d00d17a-1f2f-4d1c-a39a-93ff893f6b91"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:54.780457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] validate_networks() for [('0d00d17a-1f2f-4d1c-a39a-93ff893f6b91', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:55:55.478872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:55.479580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:55.480098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:55.480520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:55.481100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:55.499387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.499868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.501025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.501991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.502608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.510694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.544554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:55.561712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for user 606a8a3f1311407498ad45ed8d78e558 and project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:55.585149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:55.588255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:55.710303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dcf6ce57-f941-44c2-a897-75cdea0280a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.986667 Oct 04 17:55:55.713227 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 824/1536] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:55:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:55:55.723905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:55.728181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:55.747613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.751704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.754967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:55.756071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:55.756701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:55.770558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.038763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.052533 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df0ff8c6-3c10-4018-9831-9024baa06b72 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 200 len: 1476 microversion: 2.1 time: 0.334001 Oct 04 17:55:56.078689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 825/1537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:55 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 1476 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:56.089366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.090741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:56.113514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.121855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.122399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.130859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.131841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.132530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.715461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.727238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.737101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.739312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-460797fa-8c9b-4c6e-b4d4-bf13e6e2053a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.659297 Oct 04 17:55:56.740541 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 826/1538] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:56.754497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.755735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:56.852758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.897408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.902514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:56.903716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff22f2ff-c277-4d0b-9a6d-7e2f5d9684e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1261 microversion: 2.25 time: 0.161797 Oct 04 17:55:56.910045 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 827/1539] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:56.916135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:56.917029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:56.930101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.931980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.932450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:56.933233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:56.933766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:56.934310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.159389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:55:57.160032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:55:57.162365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:55:57.162943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:55:57.163443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:55:57.190396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.191415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.192112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.193116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.193806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.194489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.224485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=19 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:57.278933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:57.279639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:55:57.295773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for user 2e3ae7cc3d854e0690d8354dbca1e6c6 and project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:55:57.297668 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0dc66329-7af9-46ad-9b31-2987dc385525 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.385966 Oct 04 17:55:57.302006 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 828/1540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:56 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:57.309347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d42aeef-9c12-447c-ac25-fc9bcde5ec1f", "name": "network-vif-deleted", "tag": "112197ff-9427-4f44-ab55-41caaeed780a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:57.324674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:55:57.329223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:55:57.353719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.354232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.354666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.402941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] Creating event network-vif-deleted:112197ff-9427-4f44-ab55-41caaeed780a for instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f on n-h2-831194-21 Oct 04 17:55:57.416234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-37f38d94-76d6-4e76-9f67-42f45bf47828 req-8e8bce9c-0461-42c6-b13e-16e346f501ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109060 Oct 04 17:55:57.419032 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 829/1541] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:57.455410 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12e26fce-3285-43fb-9507-f6021701fbcf tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.572745 Oct 04 17:55:57.456453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 713/1542] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:55:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:55:57.457144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "9ee68e4b-b282-44d0-9a38-8266e4d20a88"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:55:57.465406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.466344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.473963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.474798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.475433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.476347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.477030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.478308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.509073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.511071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.512011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.540999 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] HTTP exception thrown: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Request method failure captured: Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f HTTP/1.1 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHNVUO_B1UhivIjLgqLtVthZAYiPq9bla7hrADLpyefz7ILPEI9Nb7Z8-SMApT9xCLBy-YWlV5nWutRGmWvniCw6sg24JeIw1Dg3YffrzM5d7hirXyGVQ3QNVO0VbbF2nIscARWKJ8PeqG2JogVYLsDoegiELbpvGWm-EwWB7W0j4LM Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:55:57.552231 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abb1b2887bb64298a7538044a6624b23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: bdb5e71c56fa43c8aa71bc62264aaf69 Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. Oct 04 17:55:57.553917 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4d42aeef-9c12-447c-ac25-fc9bcde5ec1f'} Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:55:57.554746 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. Oct 04 17:55:57.556874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:55:57.558160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Returning 404 to user: Instance 4d42aeef-9c12-447c-ac25-fc9bcde5ec1f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:55:57.558160 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a463767-1dc6-46e0-b102-5b46a44687e9 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f" status: 404 len: 111 microversion: 2.1 time: 0.099524 Oct 04 17:55:57.560014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] Creating event network-changed:9ee68e4b-b282-44d0-9a38-8266e4d20a88 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:55:57.580680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 714/1543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/4d42aeef-9c12-447c-ac25-fc9bcde5ec1f => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:55:57.583116 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e922509f-2f33-45ce-bdb5-1a24e27a5c9b req-60cb5757-68ee-4f45-a4c5-c9e2a7b778f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159817 Oct 04 17:55:57.586502 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 830/1544] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:55:57.592164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19690f35-55c8-4168-852e-6b6884394eaa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.600859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.605244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19690f35-55c8-4168-852e-6b6884394eaa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.607886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.630252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:55:57.632465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.640426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.640995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.643406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.646246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.646784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.735999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:55:57.908286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed1be561-c538-406d-9708-48bb77008e93 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "DELETE /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 204 len: 0 microversion: 2.1 time: 0.319390 Oct 04 17:55:57.909134 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 831/1545] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:55:57 2022] DELETE /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:55:57.924537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:57.929676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:57.952152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.953516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.954154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:57.957562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:57.959612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:57.961206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.216561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19690f35-55c8-4168-852e-6b6884394eaa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.229960 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19690f35-55c8-4168-852e-6b6884394eaa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1208 microversion: 2.1 time: 0.647450 Oct 04 17:55:58.231770 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 715/1546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1208 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:58.245455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.248064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.262886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.263466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.264628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.273488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.275282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.276206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.564215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.587367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.591385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.592617 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-340f8012-fc9c-4059-9682-317acbf8a65d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.682083 Oct 04 17:55:58.593181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 832/1547] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:57 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:58.622022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.623011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.630326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.630828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.631272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.631990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.632452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.632884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.730446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.741559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.743942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:58.745355 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bb753ae7-c6d7-4a9d-99c0-9ee2af9f5e68 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1313 microversion: 2.25 time: 0.131745 Oct 04 17:55:58.748678 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 833/1548] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1313 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:55:58.755647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:58.756409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:58.764741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.765169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.765610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:58.766622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:58.767085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:58.767827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.010399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:59.021492 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14b8757b-a7de-477c-afcc-078563880dc1 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.271448 Oct 04 17:55:59.022398 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 834/1549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:59.261073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:59.262235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:59.276482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.276993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.277438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.278188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.278648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.279079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.427359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:59.436970 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0740e1c8-5367-49c0-a9e8-454a94b93c84 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1260 microversion: 2.1 time: 0.181987 Oct 04 17:55:59.452256 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 835/1550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:59 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:59.614789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:55:59.628304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eb8afb95-856c-4762-987f-5f602fd27265 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1516 microversion: 2.1 time: 1.395219 Oct 04 17:55:59.638998 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 716/1551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:55:58 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1516 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:55:59.640674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:59.640674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:59.668427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.669587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.676591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.679255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.681028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.681605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.780398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:55:59.780736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:55:59.792356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.792748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.793399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:55:59.796765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:55:59.797463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:55:59.798112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.289907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.301242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.302968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.304186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be2cc511-c086-40e9-9eab-1b67967a2262 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1313 microversion: 2.25 time: 0.528726 Oct 04 17:56:00.317969 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 717/1552] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:59 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1313 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:56:00.317969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:00.317969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:00.330549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.331042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.331762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.332676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.334104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.334761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.757019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.767824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.770067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.771314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5ef6c7f-510e-489d-bb65-ba15a9eab29b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.145243 Oct 04 17:56:00.771894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 836/1553] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:55:59 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:00.796300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "name": "network-vif-unplugged", "status": "completed", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:00.824943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.825558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.826159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.840971 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] Creating event network-vif-unplugged:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h2-831194-21 Oct 04 17:56:00.846240 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6d90fff6-b052-4890-a529-19577ad49d4e req-c5546ead-d131-4e3d-b8f9-52912e69477c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062660 Oct 04 17:56:00.846917 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 837/1554] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:00.852427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:00.853550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:00.860410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.860988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.861509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.862380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.862909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.863417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.963755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:00.972360 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99297d49-8349-41d3-8869-b794a4dcf46b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1266 microversion: 2.1 time: 0.124008 Oct 04 17:56:00.972941 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 838/1555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:00 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:00.983955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:00.984896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:00.993152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.993989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.994832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:00.995763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:00.996472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:00.996909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.178913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.189860 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eebda879-b927-4cd1-b34f-97e8ad3de9cf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.883511 Oct 04 17:56:01.190467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 718/1556] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:00 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:01.334700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:01.335314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:01.342536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.343324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.344019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.344993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.345681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.346386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.360304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.368344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-51a1069a-b0d4-4d4f-bc67-fb58acd67db7 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1516 microversion: 2.1 time: 0.393627 Oct 04 17:56:01.369708 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 839/1557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:00 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1516 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:01.584055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.599652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.601536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:01.603684 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e686c21-98dd-474b-8df8-eaaec8ba70dc tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1319 microversion: 2.25 time: 0.272916 Oct 04 17:56:01.614203 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 719/1558] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:56:01.805277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:01.805998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:01.816166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.818450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.820350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.821948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:01.822605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:01.823199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:01.999359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.000010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.018321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.018834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.019282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.020012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.020473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.020909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.180972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.196758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.200130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.201639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-021d8470-b1ab-4576-88ad-8540150e527d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.401566 Oct 04 17:56:02.202569 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 840/1559] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:02.234901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.235527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.242132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.242785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.243508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.244220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.244678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.245110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.278802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.289059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e293303e-13e6-40ef-a435-05eb56f224f6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1266 microversion: 2.1 time: 0.293843 Oct 04 17:56:02.290764 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 720/1560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:01 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:02.392708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.393317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.403696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.404501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.405198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.406162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.406836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.407496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.412119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.428172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe73023c-a5ca-47d6-8152-294e473c71c9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.213848 Oct 04 17:56:02.439063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 841/1561] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:02.464141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.465034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.465728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.466431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lazy-loading 'fault' on Instance uuid 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:02.632139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:02.633538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:02.640386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.646232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.649862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.652873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.654629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.655200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.674560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:02.675696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.699328 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1f98c4d-526c-4b80-822f-2cf2b7916b2d tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 200 len: 1310 microversion: 2.1 time: 0.310391 Oct 04 17:56:02.700864 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 721/1562] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:02.741280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.756155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.759264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:02.760654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54a09122-bacd-42e9-b6ab-707341640f81 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1319 microversion: 2.25 time: 0.133135 Oct 04 17:56:02.761242 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 842/1563] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:02 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1319 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:02.870530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d", "name": "network-vif-deleted", "tag": "4f958882-a06e-4880-bd3b-1d991dd8546e"}, {"name": "network-changed", "server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:02.883618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:02.884627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:02.885393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:02.904448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Creating event network-vif-deleted:4f958882-a06e-4880-bd3b-1d991dd8546e for instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d on n-h2-831194-21 Oct 04 17:56:02.905494 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] Creating event network-changed:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h2-831194-21 Oct 04 17:56:02.914095 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1a786f2b-4a48-4fa5-b5cb-773a5cc93e8d req-01126a7a-9214-4dc5-8be0-11e082c44c60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.048115 Oct 04 17:56:02.915789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 722/1564] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:03.231621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.233343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.245455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.246828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.247685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.248886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.249360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.250045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.315705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.317352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.327574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.328256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.328708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.330133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.330754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.332019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.566217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.578089 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e880bd88-4dfe-4280-9a13-04ab5550bb1c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1266 microversion: 2.1 time: 0.268041 Oct 04 17:56:03.582691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 723/1565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:03.592953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.593971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.603199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.603671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.604330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.605295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.605858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.606351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.674334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.698785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.722746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:03.723806 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c2e5a85-4016-411d-ab0a-2a5f86d6d8e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.497756 Oct 04 17:56:03.730568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 843/1566] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:03.748156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.750857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.773483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.777164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.777692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.779671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.782009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.782631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.829814 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] HTTP exception thrown: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Request method failure captured: Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d HTTP/1.1 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHNVUO_B1UhivIjLgqLtVthZAYiPq9bla7hrADLpyefz7ILPEI9Nb7Z8-SMApT9xCLBy-YWlV5nWutRGmWvniCw6sg24JeIw1Dg3YffrzM5d7hirXyGVQ3QNVO0VbbF2nIscARWKJ8PeqG2JogVYLsDoegiELbpvGWm-EwWB7W0j4LM Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:56:03.837293 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abb1b2887bb64298a7538044a6624b23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: bdb5e71c56fa43c8aa71bc62264aaf69 Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. Oct 04 17:56:03.839356 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d'} Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:03.840444 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. Oct 04 17:56:03.842246 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:03.843940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Returning 404 to user: Instance 442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:03.845137 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72f2f9f7-1d1a-452f-8382-36a3a52f2b13 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d" status: 404 len: 111 microversion: 2.1 time: 0.110219 Oct 04 17:56:03.845718 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 844/1567] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/442f62f5-eaa0-4f9a-8e1c-9381f1d28d8d => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:03.857379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:03.863355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:03.877509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.878053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.878499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:03.883853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:03.884463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:03.885191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.030523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.042528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.048592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.049767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-86e3b4db-ccbc-4359-a9f5-661d37c93a1d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1319 microversion: 2.25 time: 0.199998 Oct 04 17:56:04.050377 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 845/1568] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:04.083253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "78e075c1-d1f1-4533-bab5-3813daaa8bae"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:04.098126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.098328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.098775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.117331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] Creating event network-changed:78e075c1-d1f1-4533-bab5-3813daaa8bae for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:04.124941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f9b89686-4c2c-4cd9-834b-16743c148255 req-49aae6b2-e58b-4c1b-ba5c-04d523482b0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052665 Oct 04 17:56:04.126188 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 846/1569] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:04.131572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.132518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.142265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.143035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.144084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.144936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.145515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.146087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.205022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:04.334367 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-501fcaea-c567-4162-a29a-61c1306d6564 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 204 len: 0 microversion: 2.1 time: 0.206361 Oct 04 17:56:04.335091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 847/1570] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:04 2022] DELETE /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:04.345291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.346267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.353774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.354547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.355170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.356101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.356737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.357171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.633989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.651854 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-95eff4f7-e5a4-446f-a9db-09fb2ad44a55 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1516 microversion: 2.1 time: 0.310824 Oct 04 17:56:04.652779 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 848/1571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1516 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:04.681244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.683794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.706987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.707867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.713045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.714150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.714892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.715590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.741373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:04.755353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6823c468-f846-40fe-8293-60cd41c58317 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.170285 Oct 04 17:56:04.761879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 724/1572] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:03 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:04.768529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:04.775518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:04.788328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.789736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.793956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:04.795305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:04.796196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:04.797756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.057407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.093187 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5abec079-4207-4094-b139-ab00096aa9f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 0.423532 Oct 04 17:56:05.094771 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 849/1573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:05.105332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.106371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.130019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.135011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.135719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.141618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.145034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.146436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.465615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.474959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.480279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.486445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ddd602a-c5ba-4642-a046-3b3487c36ac5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.389661 Oct 04 17:56:05.487124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 850/1574] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:05.501244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.519823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.525001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:05.526682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75bfadc9-525e-494f-8d66-a76e55d443b9 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.763497 Oct 04 17:56:05.527735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:05.527903 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 725/1575] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:04 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:05.683393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.684101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.699385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.709514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.710704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.712845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.717178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.719555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.803928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-009ac97d-2a79-4d7a-ba9e-30956aba1bf9 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Calling method '.version_select at 0x7fbdbd259b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.894982 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-009ac97d-2a79-4d7a-ba9e-30956aba1bf9 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.379231 Oct 04 17:56:05.895570 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 851/1576] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:05.910299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:05.911375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:05.926839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.927349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.927793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:05.928801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:05.929331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:05.933526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.697820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:06.698828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:06.720768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16c2aad5-b79b-4d7f-8007-370e24645ae2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.814888 Oct 04 17:56:06.723166 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 852/1577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:06.738310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e05e4b95-ccb1-4a16-9bb6-d81dbf7ad0d6 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Action: 'create', calling method: .version_select at 0x7fbdbd7289d0>, body: {"pool": "non_exist_pool"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:06.745958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4863bc64-4ff5-4ffb-a8b1-70f9b64b936f tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1516 microversion: 2.1 time: 1.067559 Oct 04 17:56:06.749540 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 726/1578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:05 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1516 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:06.772634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:06.779538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:06.813898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:06.817779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:06.824637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.826520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:06.828907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:06.829937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:06.861919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:07.091279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e05e4b95-ccb1-4a16-9bb6-d81dbf7ad0d6 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] HTTP exception thrown: Floating IP pool not found. Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e05e4b95-ccb1-4a16-9bb6-d81dbf7ad0d6 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Request method failure captured: Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 26 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO1xBGchgkc-nqTszti6SKp1iIFEiXAbob0OEvtS3Gqp3ZIaplaoqsjm6G9qFFXXt44KJOd7eXVipzLP8Pde_vSEOZ-dbiWrQaOAz4kPvmFtjzyxzKX5_q0eVNuVbhUQSiFulHzK_IT9lubVV-eK3JxelIlqx-azMpUHIOJCRFD1CM Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 3606d0b0c5124c018defe6ed61d6b2f6 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:56:07.094503 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 3606d0b0c5124c018defe6ed61d6b2f6 Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsNegativeTestJSON-558214945-project Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 65c8effb37604c60853040adf0de10a9 Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-558214945-project Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: {"pool": "non_exist_pool"} Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: exception: Floating IP pool not found. Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 04 17:56:07.097960 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:07.100273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e05e4b95-ccb1-4a16-9bb6-d81dbf7ad0d6 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Returning 404 to user: Floating IP pool not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:07.105119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e05e4b95-ccb1-4a16-9bb6-d81dbf7ad0d6 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.372475 Oct 04 17:56:07.107107 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 853/1579] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:56:06 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 374 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:56:07.124026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:07.125047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:07.147464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:07.149649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:07.164078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:07.167946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:07.171101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:07.171930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:07.246897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:08.012037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:08.050675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:08.059504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab03842d-6e55-47fd-b5ff-d703b3b5777d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 1.302246 Oct 04 17:56:08.062947 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 727/1580] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:06 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:08.097881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:08.100698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:08.134972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.139881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.142215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.148135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.149815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.150921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.233532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:08.531787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:08.572268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:08.576123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:08.578612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-85eeb0e1-c25c-499e-a262-8fa7fe346ade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 1.476171 Oct 04 17:56:08.580368 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 854/1581] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:07 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:08.594252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Calling method '.version_select at 0x7fbdbd20f5e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:08.808064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 450390db-1df9-46c0-96f2-e11a2d93f47f could not be found", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:56:08.808767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] HTTP exception thrown: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Request method failure captured: Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-floating-ips/450390db-1df9-46c0-96f2-e11a2d93f47f HTTP/1.1 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO1xBGchgkc-nqTszti6SKp1iIFEiXAbob0OEvtS3Gqp3ZIaplaoqsjm6G9qFFXXt44KJOd7eXVipzLP8Pde_vSEOZ-dbiWrQaOAz4kPvmFtjzyxzKX5_q0eVNuVbhUQSiFulHzK_IT9lubVV-eK3JxelIlqx-azMpUHIOJCRFD1CM Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 3606d0b0c5124c018defe6ed61d6b2f6 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:56:08.810810 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3606d0b0c5124c018defe6ed61d6b2f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 3606d0b0c5124c018defe6ed61d6b2f6 Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-558214945 Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsNegativeTestJSON-558214945-project Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 65c8effb37604c60853040adf0de10a9 Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-558214945-project Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: exception: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '450390db-1df9-46c0-96f2-e11a2d93f47f'} Oct 04 17:56:08.812319 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:56:08.813390 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 450390db-1df9-46c0-96f2-e11a2d93f47f could not be found Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5802c2bd-0769-4bb1-a3cf-f7f67265f0b7'] Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f. Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:08.814790 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:08.816244 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:08.817581 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f Oct 04 17:56:08.817581 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:08.817581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] Returning 404 to user: Floating IP not found for ID 450390db-1df9-46c0-96f2-e11a2d93f47f {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:08.817581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57aa1e59-d0be-425a-b96b-145b683bcaa2 tempest-FloatingIPsNegativeTestJSON-558214945 tempest-FloatingIPsNegativeTestJSON-558214945-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/450390db-1df9-46c0-96f2-e11a2d93f47f" status: 404 len: 111 microversion: 2.1 time: 0.230145 Oct 04 17:56:08.817581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 855/1582] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:56:08 2022] DELETE /compute/v2.1/os-floating-ips/450390db-1df9-46c0-96f2-e11a2d93f47f => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:08.832100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:08.832733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:08.855467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.855980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.856531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:08.857154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:08.857759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:08.858326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.408336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:09.421887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:09.423753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:09.425666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-246985e2-ff04-4374-ac71-40c483664ea1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.360933 Oct 04 17:56:09.426957 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 728/1583] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:08 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:09.440408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:09.443915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:09.460340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.462078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.462528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.463250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.467994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.468564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.626156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:09.640629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28ecdd7a-86fc-48bd-8709-62aea7a59030 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1474 microversion: 2.1 time: 0.209030 Oct 04 17:56:09.658262 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 729/1584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:09 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1474 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:09.673064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:09.675640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:09.685130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.685892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.686519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:09.687386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:09.688001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:09.691761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.146366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.160592 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78abadde-ad78-4335-a1a8-43ef997970e9 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 1.340957 Oct 04 17:56:10.170345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 856/1585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:08 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:10.175980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.179027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.202210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.203150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.203852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.204770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.209627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.212818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.862647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.885654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.887975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.890191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-802d8e7c-c635-4f53-8d42-c37188f772a0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.717881 Oct 04 17:56:10.909136 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 857/1586] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:10 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:10.919505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b76737c-cdb8-4cbf-8237-6a9311f42a7b", "name": "network-vif-deleted", "tag": "4d75f825-6256-415f-8ee4-83ef26b5a4fb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:10.928776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:10.935155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.935979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.937766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.955047 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] Creating event network-vif-deleted:4d75f825-6256-415f-8ee4-83ef26b5a4fb for instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b on n-h2-831194-21 Oct 04 17:56:10.955545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00d4d1d2-13e5-47a1-8f4b-c331a372b3d4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 1.294924 Oct 04 17:56:10.956645 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 730/1587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:09 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:10.966473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.973420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.974064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ee6afc65-6cd1-4c10-8ad2-c11d28f45165 req-f96d7c0e-be80-44e9-8e52-87c125510ac5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062960 Oct 04 17:56:10.974827 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 858/1588] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:10.983788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:10.985538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:10.996076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.996496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:10.997221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:10.997917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:10.999486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.000197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.000921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.002903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.004170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.004942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.005746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.005909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.093542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.096081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.096657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.097392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lazy-loading 'fault' on Instance uuid 2b76737c-cdb8-4cbf-8237-6a9311f42a7b {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:11.238697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdb5e71c56fa43c8aa71bc62264aaf69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abb1b2887bb64298a7538044a6624b23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:11.252751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e720fbce-634b-488d-84a1-e5e6c5cdfff6 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 200 len: 1310 microversion: 2.1 time: 0.273292 Oct 04 17:56:11.280755 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 859/1589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:10 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 1310 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:11.285926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12fcdafe-41b2-42ee-832e-350f2f537be8", "tag": "bb60f577-1777-4d1f-a184-62a3642069b3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:11.299163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.299652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.300089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.317527 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] Creating event network-changed:bb60f577-1777-4d1f-a184-62a3642069b3 for instance 12fcdafe-41b2-42ee-832e-350f2f537be8 on n-h1-831194-21 Oct 04 17:56:11.323563 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a918a0b8-7438-4855-9071-5afb54404b6b req-efb3e331-bade-466d-b84a-a286c9d7cc3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041379 Oct 04 17:56:11.326665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 860/1590] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:11.339908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:11.340637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:11.351192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.352541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.353000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:11.353816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:11.354359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:11.355069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.013847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.029633 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e2fe04c2-5562-47d0-88f2-896fc4fc8ee5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.701680 Oct 04 17:56:12.047120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 861/1591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:11 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:12.059316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:12.060187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:12.073086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.073874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.074510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.076659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.077316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.078039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.283517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.300766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.302583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.305901 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1589055-3864-4d3e-9ec4-ed028cc49be1 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.346629 Oct 04 17:56:12.320468 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 731/1592] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:10 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:12.326393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:12.327642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:12.336032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.343279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.344129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.345102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.346292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.346898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.579579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.581939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:12.593222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.595251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.596723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6851c92-7d44-4f69-b022-b5c9aa2acff8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.547640 Oct 04 17:56:12.597554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 862/1593] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:12 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:12.604373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:12.605640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] [instance: 2b76737c-cdb8-4cbf-8237-6a9311f42a7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:12.612985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.613751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.614453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.615780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:12.616469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:12.617989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:12.646237 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] HTTP exception thrown: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Request method failure captured: Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b HTTP/1.1 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHNVUO_B1UhivIjLgqLtVthZAYiPq9bla7hrADLpyefz7ILPEI9Nb7Z8-SMApT9xCLBy-YWlV5nWutRGmWvniCw6sg24JeIw1Dg3YffrzM5d7hirXyGVQ3QNVO0VbbF2nIscARWKJ8PeqG2JogVYLsDoegiELbpvGWm-EwWB7W0j4LM Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:56:12.649208 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/abb1b2887bb64298a7538044a6624b23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_abb1b2887bb64298a7538044a6624b23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: abb1b2887bb64298a7538044a6624b23 Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1840117685 Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: bdb5e71c56fa43c8aa71bc62264aaf69 Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ListServerFiltersTestJSON-1840117685-project Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. Oct 04 17:56:12.651188 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2b76737c-cdb8-4cbf-8237-6a9311f42a7b'} Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:12.652109 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. Oct 04 17:56:12.653449 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:56:12.657096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] Returning 404 to user: Instance 2b76737c-cdb8-4cbf-8237-6a9311f42a7b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:12.658262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8bed8e2d-4af9-48d7-959e-dc52fdfb0244 tempest-ListServerFiltersTestJSON-1840117685 tempest-ListServerFiltersTestJSON-1840117685-project] 10.222.0.42 "GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b" status: 404 len: 111 microversion: 2.1 time: 0.059410 Oct 04 17:56:12.659469 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 863/1594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:12 2022] GET /compute/v2.1/servers/2b76737c-cdb8-4cbf-8237-6a9311f42a7b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:12.964724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:12.986928 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92f1876f-758d-4e65-8006-052923c29ebb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 0.664695 Oct 04 17:56:12.988607 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 732/1595] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:12 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:13.058560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.059190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:13.065646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.066494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.066887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.067771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.068403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.069033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.348496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.353562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:13.362979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.366350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.368712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.369539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.370270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.370725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.774065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:13.782927 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa933f0d-347d-45c4-82ec-83c6a5856407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.728430 Oct 04 17:56:13.783514 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 864/1596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:13.788866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:13.789962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:13.797517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.798463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.799144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:13.800104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:13.800818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:13.801318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.010308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.020016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.021896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.023851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74aab484-b73c-48c6-9e6f-fa08b70f9029 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.681486 Oct 04 17:56:14.024505 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 733/1597] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:14.029272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2f0c9c-dbce-4c4d-bc66-be240ab6553a", "tag": "d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:14.039640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.040355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.041002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.054309 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] Creating event network-changed:d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c for instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a on n-h2-831194-21 Oct 04 17:56:14.059919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bb675261-6d9a-4e54-be14-af12d7e22d66 req-9ca1fc61-26ae-4551-a348-179206ce46fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Oct 04 17:56:14.060955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 734/1598] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:14.067090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.067908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:14.075057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.076097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.076828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.077814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.078580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.079244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.288037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.304676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.306840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.309274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce088e08-60c1-49c9-96a8-d871467bd106 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.524316 Oct 04 17:56:14.310408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 865/1599] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:13 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:14.579556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:14.589987 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd79be95-ee3e-458f-a0d5-8fb306837e89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 0.527367 Oct 04 17:56:14.591617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 735/1600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:14 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:14.812668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:14.814070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:14.823225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.824393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.826452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:14.827950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:14.828730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:14.829423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:15.050732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:15.052182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:15.073053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:15.074758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:15.076168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:15.079081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:15.079748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:15.080661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:15.695919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:15.708328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbc74d18-bd45-4e9a-8d2c-4fa92e9de627 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.900505 Oct 04 17:56:15.712017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 866/1601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:14 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:15.838597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1004578306", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "8c806019-95ae-42d2-95ad-2b299cb37bb4"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:15.979240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] validate_networks() for [('8c806019-95ae-42d2-95ad-2b299cb37bb4', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:16.254051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:16.265476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:16.267549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:16.268896 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cbb1a880-afec-4042-b593-2c54ec13af45 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.222178 Oct 04 17:56:16.282251 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 736/1602] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:15 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:16.294517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:16.296006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:16.302791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:16.303499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:16.304183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:16.305146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:16.305764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:16.306384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.261797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:17.271312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:17.272803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:17.274319 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a30de2fd-b9cf-4ae0-a1cb-5d5d4238737d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.990547 Oct 04 17:56:17.275134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 737/1603] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:16 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:17.279891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:17.280708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:17.286487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:17.288159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.288965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.289921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.292415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.293088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.293724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.640829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:17.651705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97c8af07-d111-445e-adbb-961e163bc07c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 0.375360 Oct 04 17:56:17.653005 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 738/1604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:17 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:17.658436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:17.659369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:17.666588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.667415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.668074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.669044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.669748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.670636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.708219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:17.709387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:17.710209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:17.711401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:17.712057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:17.731309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.733636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.734337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.738819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.739660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.740606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.766233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Getting quotas for project 17b155d8d2e34cd3b27cf3233969d281. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:17.774056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Getting quotas for user ad4f3b5b31bb49118ac47cece94b802c and project 17b155d8d2e34cd3b27cf3233969d281. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:17.794935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:17.798540 n-d-831194-21 devstack@n-api.service[128849]: WARNING nova.utils [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1004578306 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-100457830 Oct 04 17:56:17.799753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:17.921881 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6c56781-a5bb-4adf-a1ca-b11de96076b5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.207011 Oct 04 17:56:17.924925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 867/1605] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:17.944003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:17.945264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:17.954971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.955706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.956370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:17.957662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:17.958378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:17.958977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:18.026086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:18.052967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c3acfaa-5168-4869-8b06-1bd6d2dda637 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1717 microversion: 2.1 time: 0.390823 Oct 04 17:56:18.057615 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 739/1606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:17 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1717 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:18.077971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6854851-0cee-47d7-b813-1b8771f601cf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:18.081702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6854851-0cee-47d7-b813-1b8771f601cf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:18.215849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d6854851-0cee-47d7-b813-1b8771f601cf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:18.226556 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6854851-0cee-47d7-b813-1b8771f601cf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1232 microversion: 2.1 time: 0.165101 Oct 04 17:56:18.243334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 740/1607] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:18 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1232 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:18.304293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:18.305066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:18.327063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:18.329560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:18.330049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:18.338620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:18.338620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:18.348528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:18.504160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:18.515284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:18.516739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:18.530066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8994bb6d-c299-487b-bc13-11bc7e7efd75 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.589318 Oct 04 17:56:18.530859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 868/1608] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:17 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:18.676936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:18.682969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:18.693097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:18.693887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:18.695311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:18.700475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:18.703736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:18.704456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:18.987312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.001305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.008155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.011742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1743714-31dc-40c4-88fd-6dd70d69d7ae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.710700 Oct 04 17:56:19.013644 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 741/1609] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:18 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:19.079342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.079947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.092015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.092522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.092961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.093666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.094152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.094575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.238597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.254277 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c96ade1-da5e-4b5f-9f9a-58236d9d8c40 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 0.581002 Oct 04 17:56:19.262468 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 869/1610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:18 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:19.286918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.289667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.303407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:19.307410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.309783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.310583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.311592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.314101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.314978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.421392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.432149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-968f3288-f4dd-4608-8527-d664c784f7c3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1707 microversion: 2.1 time: 0.355983 Oct 04 17:56:19.433113 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 742/1611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1707 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:19.456536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5121923-4ae9-4aeb-b1dd-862e37c7e433 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '.version_select at 0x7fbdbe034790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.460760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5121923-4ae9-4aeb-b1dd-862e37c7e433 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.461402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5121923-4ae9-4aeb-b1dd-862e37c7e433 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.462138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5121923-4ae9-4aeb-b1dd-862e37c7e433 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.475201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5121923-4ae9-4aeb-b1dd-862e37c7e433 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.022925 Oct 04 17:56:19.497735 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 743/1612] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:19.504265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.509050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.530850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.531952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.533014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.536001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.537168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.538139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.779863 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3c9a589-dc33-4a94-82c8-2747a997c3af tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1860 microversion: 2.1 time: 0.272100 Oct 04 17:56:19.780562 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 744/1613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1860 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:19.816400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.819749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.824379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:19.829347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.831071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.831838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.832230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-590b9fbb-c02b-46fc-970a-bc048b7fdad7 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1228 microversion: 2.1 time: 0.567690 Oct 04 17:56:19.834178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.834856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.836233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.838267 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 870/1614] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1228 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:19.849701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:19.850376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:19.865035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.866026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.867273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:19.868549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:19.869355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:19.869969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.198993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.219053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.228841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.230659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58e7a69f-ef05-4180-8249-84063aace163 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.426913 Oct 04 17:56:20.235464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 745/1615] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:20.260231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:20.261752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:20.300157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.305338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.306110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.308399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.310209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.311643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.363152 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e066f13-bf15-4394-8b4f-6f58c8c75e01 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1860 microversion: 2.1 time: 0.523712 Oct 04 17:56:20.370197 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 871/1616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:19 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1860 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:20.411439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:20.411972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:20.445711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.459432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.463994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.464712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.465195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.465640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.776711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.781572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:20.796318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.815334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:20.820679 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02adee77-4414-4142-96f8-e3ba31870819 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.581600 Oct 04 17:56:20.863453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 746/1617] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:20 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:20.884171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12fcdafe-41b2-42ee-832e-350f2f537be8", "name": "network-vif-plugged", "status": "completed", "tag": "bb60f577-1777-4d1f-a184-62a3642069b3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:20.905637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.906519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.907103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.920192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] Creating event network-vif-plugged:bb60f577-1777-4d1f-a184-62a3642069b3 for instance 12fcdafe-41b2-42ee-832e-350f2f537be8 on n-h1-831194-21 Oct 04 17:56:20.926595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b4657512-b431-4669-bd4a-a67c72b9047f req-5b5adc27-0a83-4437-bde4-ba62dbcb8f34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061213 Oct 04 17:56:20.927503 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 747/1618] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:20.945494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:20.947757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:20.956099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.956864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.957476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:20.958579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:20.959202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:20.959828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:21.151945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'services' on Instance uuid 0aebe331-591b-4fc2-bb54-3f516d4453dd {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:21.304006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a31b68e-ba1e-4c6f-8906-f487ad8d1c1a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments/9397ac4c-4ce2-4528-8abe-07476907f664" status: 202 len: 0 microversion: 2.1 time: 0.374456 Oct 04 17:56:21.305918 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 748/1619] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 17:56:20 2022] DELETE /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments/9397ac4c-4ce2-4528-8abe-07476907f664 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:21.313489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:21.315024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:21.329026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:21.336288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:21.336288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:21.336288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:21.337250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:21.337250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:21.478768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:21.492029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-615571ae-f193-4fc8-a2ac-d452f01e1b48 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1290 microversion: 2.1 time: 0.180637 Oct 04 17:56:21.493659 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 749/1620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:21 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1290 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:21.503784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:21.507840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:21.520892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:21.521407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:21.521874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:21.523206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:21.523681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:21.529656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.022628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.056404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f3a764b-95a6-4fa3-a61a-b3d44ceeecec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1308 microversion: 2.1 time: 1.684922 Oct 04 17:56:22.065793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 872/1621] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:20 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1308 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:22.090786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:22.093896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:22.110222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.117387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.122665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.123302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.128528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.131351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.132794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.133702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.134305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.145493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd863e66-de93-42fc-8021-03516a92a69c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.649932 Oct 04 17:56:22.162004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 750/1622] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:21 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:22.173520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:22.177887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:22.190682 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e8117ae-574b-4861-ad27-c4e3bc6e1c6e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123655 Oct 04 17:56:22.191572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 873/1623] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:22 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:22.196177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.197073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.199769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.201636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.202323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.205120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.522008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:22.523811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:22.534098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.535058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.543398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.544698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:22.545371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:22.546627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:22.566823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.584369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.590998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:22.592318 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-241aba0c-ea55-40d8-b5e5-8f4948be9c69 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.428837 Oct 04 17:56:22.597473 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 751/1624] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:22 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:23.074433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2f0c9c-dbce-4c4d-bc66-be240ab6553a", "name": "network-vif-plugged", "status": "completed", "tag": "d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:23.090913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.091393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.091837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.136085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] Creating event network-vif-plugged:d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c for instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a on n-h2-831194-21 Oct 04 17:56:23.142800 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ca71ce77-6537-4f03-adcc-d0cec72fb371 req-f7cd3d64-e71f-4bd6-95c5-cc831badf88a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071855 Oct 04 17:56:23.143658 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 752/1625] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:23.156083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.157102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.169051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.171443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.172067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.172985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.173599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.175417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.312771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:23.328101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-720d8f4c-fd50-4d0e-823a-edb689427027 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1290 microversion: 2.1 time: 0.812070 Oct 04 17:56:23.342096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 874/1626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:22 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1290 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:23.357860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.358503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.369528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.370064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.370504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.371218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.371674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.372100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.524520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:23.534931 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8492bf3-fc73-4b75-8e10-f5fddc9e5df9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1487 microversion: 2.1 time: 0.387596 Oct 04 17:56:23.554719 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 753/1627] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1487 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:23.566118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.568408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.589496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.590555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.590984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.592417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.593226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.594392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.656216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3da6729f-e7c8-4f19-8bd8-1a7dd6006e29 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099296 Oct 04 17:56:23.657854 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 754/1628] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:23.665656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:23.666567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.673659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.674414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.675326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.676278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.676988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.677686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.779547 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5de9e77-d90c-403c-a766-39cb785138ee tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8/action" status: 202 len: 0 microversion: 2.1 time: 0.120044 Oct 04 17:56:23.781164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 755/1629] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:23 2022] POST /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:56:23.790420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:23.791652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:23.807816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.808950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.809871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:23.810928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:23.811661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:23.813150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.003970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.032726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.036458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.057614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74b8ffec-86e8-41ff-836f-0c33f37eb0db tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1361 microversion: 2.25 time: 0.274068 Oct 04 17:56:24.060889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 756/1630] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:24.082243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:24.082243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:24.096214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.096718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.101545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.107361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.109302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.110150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.327596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.345987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.356052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.357401 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8957b35-29d7-4084-bf25-9d33a1e26094 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.014081 Oct 04 17:56:24.360337 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 875/1631] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:23 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:24.376164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:24.380302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:24.396396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.397682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.400255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.401578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.401916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:24.402965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.405656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.421493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-66b1105a-1d5b-4df0-8e99-046bdaaa02f2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 200 len: 1472 microversion: 2.1 time: 0.351880 Oct 04 17:56:24.422549 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 757/1632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:24 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 1472 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:24.451960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-378789790"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:24.456249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:24.480954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.482076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.484329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.486464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.487583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.488793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.957603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2cae5ccc-248c-411a-ac09-662d7f1e2364 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8/action" status: 202 len: 0 microversion: 2.1 time: 0.511368 Oct 04 17:56:24.959222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 758/1633] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:56:24 2022] POST /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:56:24.966894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:24.971179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:24.983501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.984506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.985251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:24.986791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:24.987532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:24.988321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.031395 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b64194b-619e-48e1-bed9-2c4ad07065d8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068917 Oct 04 17:56:25.032387 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 759/1634] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:24 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:25.038729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-165259bb-dfef-4578-a10e-5aa52c550247 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbda9fee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.106951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-165259bb-dfef-4578-a10e-5aa52c550247 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.072833 Oct 04 17:56:25.108084 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 760/1635] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:25.115774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.117146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:25.126559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.127227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.127860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.128817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.129769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.130321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.557902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.576179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.593714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:25.596805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92848090-7455-4e58-bce0-fecc9147806a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1557 microversion: 2.25 time: 0.486567 Oct 04 17:56:25.598553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 761/1636] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1557 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:25.611501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:25.614217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:25.628599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.629748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.631029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.632237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:25.633353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:25.634084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:25.987733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:26.000907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b77fb6a6-6d2e-4049-9ac0-30ff5ee80b88 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 1.636960 Oct 04 17:56:26.003088 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 876/1637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:24 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:26.032118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.032785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:26.058929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.066516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.067375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.068749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.069796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.070537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.277168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:26.281369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:26.296738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:26.298775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:26.301112 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f822213-c4e2-4dff-8473-be0fb9af6db6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.700259 Oct 04 17:56:26.302160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 762/1638] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:25 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:26.307974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.310822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:26.330254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.333506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.336097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.339699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.340947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.346600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.456756 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b9ab300-3b1e-4940-8d7b-b2e3128aca4c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153177 Oct 04 17:56:26.463164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 763/1639] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:26.469843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c63ba758-0d2d-479a-a36e-cdccf5888541 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbe1d9550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.558941 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c63ba758-0d2d-479a-a36e-cdccf5888541 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.094357 Oct 04 17:56:26.568565 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 764/1640] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:26.740621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:26.768103 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-145f2923-28e3-426b-9539-1c8d8f39eff6 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 2051 microversion: 2.25 time: 0.747520 Oct 04 17:56:26.790048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 877/1641] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 2051 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:26.801737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:26.802707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:26.819337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.819820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.820259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:26.821144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:26.821964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:26.822696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.035063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.036223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.057285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.058531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.059969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.062997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.063999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.066694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.123191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:27.168687 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7f7de1b1-679b-471b-9a94-c49039508dfa tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 2051 microversion: 2.25 time: 0.372931 Oct 04 17:56:27.184836 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 765/1642] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:26 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 2051 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:27.201702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.220706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.221798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.222915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.224163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.224817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.226255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.276290 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6b4efb8-c574-4919-9115-7690cd9dd0bd tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.078032 Oct 04 17:56:27.296271 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 766/1643] 10.222.0.42 () {60 vars in 1217 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 17:56:27.301681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:27.302954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.312209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.313062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.313814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.314756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.315848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.316635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.418963 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b59e3661-2d66-4d0f-bd54-71bea060c790 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a/action" status: 202 len: 0 microversion: 2.25 time: 0.121081 Oct 04 17:56:27.423728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 767/1644] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:56:27 2022] POST /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:27.437618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.439717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.460784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.461373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.461820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.462590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.463043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.465059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.756450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:27.787043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:27.849210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:27.886320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:27.893241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:27.898234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7927c9b0-032f-4ba5-a42f-532e7fbc70af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.477160 Oct 04 17:56:27.899097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 768/1645] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:27.935822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:27.936835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:27.965520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.968148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.971029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:27.978240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:27.978979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:27.983332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.223043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:28.223766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:28.238267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0f5516f-b046-42ec-93c1-7ad5c7fb2ada tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 1.209341 Oct 04 17:56:28.239427 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 878/1646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.246589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.250078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.256147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:28.257440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.258149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.258816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.259825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.260458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.261079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.298820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12397c13-481a-42be-9088-1e7a28671e7d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 2036 microversion: 2.25 time: 0.381927 Oct 04 17:56:28.299336 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 769/1647] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:27 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 2036 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:28.317247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b143b62-2796-4e72-83ff-259a65353f2f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbdbf4700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:28.335919 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7e55a8a-4a68-4066-a5ba-c3ddef9d9397 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094938 Oct 04 17:56:28.337236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 879/1648] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:28 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:28.348501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": "auto"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:28.352131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:28.361977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.362677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.363323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.364720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:28.365613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:28.367002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:28.410449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:28.428742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'flavor' on Instance uuid 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:28.431529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b143b62-2796-4e72-83ff-259a65353f2f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.130735 Oct 04 17:56:28.432126 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 770/1649] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:28 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:28.445957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128849) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:56:29.202705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a259e51-01f8-4ee3-b6b5-008de60aa355 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Action: 'create', calling method: .version_select at 0x7fbdbe2d4d30>, body: {"keypair": {"name": "tempest-keypair-53372890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNke3uTZ1mNWypUl0r1qXQ37ZPvkXuPV1B1K2jlfgt+xNLUYpxSUoATfdZ0EkPI1VX6eajuma/jIAUjxJulHY82gl6Gm84wo3uLDaeKe+eT+O6nzHfNWYzvLxYq/BKdbgQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:29.295286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2a259e51-01f8-4ee3-b6b5-008de60aa355 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:29.322363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2a259e51-01f8-4ee3-b6b5-008de60aa355 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for user 13b3aaa5c74d408b828248e5f4f8b3e8 and project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:29.361908 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a259e51-01f8-4ee3-b6b5-008de60aa355 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.500605 Oct 04 17:56:29.362575 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 771/1650] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:56:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:56:29.369346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:29.370305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:29.378648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.379441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.380047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.381117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.382373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.383154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.858982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:29.871306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:29.884000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:29.886857 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-406ad033-1cc2-40e9-ae9f-9c82da08ee40 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.522616 Oct 04 17:56:29.901536 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 772/1651] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:29 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:29.923433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:29.924337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:29.932568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.933375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.934139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:29.935034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:29.935665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:29.936265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.023897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:31.041296 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83a9c411-6216-4d17-bbbe-274f06494abf tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 1.123574 Oct 04 17:56:31.042123 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 773/1652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:29 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:31.058486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:31.060972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:31.073070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.074159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.077023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.078074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.078923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.080870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.158956 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86c10b76-d66f-445d-80d9-f5d799386b09 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115686 Oct 04 17:56:31.160264 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 774/1653] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:31 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:31.165684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d12cef56-5551-49be-98d0-afdbbce9a962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbdc84160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:31.256166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d12cef56-5551-49be-98d0-afdbbce9a962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.094608 Oct 04 17:56:31.257984 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 775/1654] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:31 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:31.270872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12fcdafe-41b2-42ee-832e-350f2f537be8", "name": "network-vif-plugged", "status": "completed", "tag": "bb60f577-1777-4d1f-a184-62a3642069b3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:31.296452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.297398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.298451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.342348 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] Creating event network-vif-plugged:bb60f577-1777-4d1f-a184-62a3642069b3 for instance 12fcdafe-41b2-42ee-832e-350f2f537be8 on n-h1-831194-21 Oct 04 17:56:31.359145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-212ca8f9-73a5-4c79-a04f-ad91de7aa84f req-6d21fe2a-db90-4232-a480-ff4c0de8c8b9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097318 Oct 04 17:56:31.359784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 776/1655] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:31.393690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:31.400215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:31.424033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.425511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.426808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:31.431746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:31.433664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:31.435556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.277131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6284c806-c67d-4706-bc78-661156d25bf7 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a/action" status: 202 len: 0 microversion: 2.25 time: 3.938504 Oct 04 17:56:32.281777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 880/1656] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:56:28 2022] POST /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a/action => generated 0 bytes in 3944 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:32.292770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e247a29a-302d-4a21-9146-b325591fe572", "tag": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:32.355033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.355147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.355506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.389695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:32.398479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] Creating event network-changed:82dd0488-e2eb-4f8f-9507-8a9a568fc6ac for instance e247a29a-302d-4a21-9146-b325591fe572 on n-h2-831194-21 Oct 04 17:56:32.422078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:32.436170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:32.437994 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b4a961d-6027-45fa-8606-d4d2bde3192f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.076811 Oct 04 17:56:32.439557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-67e3b201-679c-4dac-a75c-d72832dd1d20 req-0f480c18-7888-49da-b194-6fa44e22e7ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147013 Oct 04 17:56:32.447144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 881/1657] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:32.452906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:32.464877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 777/1658] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:31 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:32.473077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:32.485243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:32.490773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:32.494646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.495147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.495622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.496351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.496812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.497244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.501236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.502013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.502787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.504808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.505470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.506124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.574026 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85bc44d6-6fe6-406d-a792-887dc60a2834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106450 Oct 04 17:56:32.582381 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 778/1659] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 17:56:32 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:56:32.591066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b695c5f4-c0c5-43f6-93d8-c32b041b7dd1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd15e430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:32.669657 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b695c5f4-c0c5-43f6-93d8-c32b041b7dd1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.085392 Oct 04 17:56:32.674057 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 779/1660] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:32 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:32.692771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:32.695704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:32.707216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.708108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.709020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:32.711576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:32.712232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:32.712873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.403258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:33.419425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:33.431510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:33.448898 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd014d8b-94fa-43df-a704-8a650de57b7e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1567 microversion: 2.25 time: 0.760262 Oct 04 17:56:33.454200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 780/1661] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:32 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1567 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:33.474694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:33.476095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:33.483880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.484843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.485526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:33.486515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:33.487265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:33.488112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.367164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:34.394061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c010e01-9b76-459c-8f05-3db0ec992e22 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 1.939403 Oct 04 17:56:34.440356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 882/1662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:32 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 1951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:34.440356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0cae9e85-65bf-4d15-9c79-168ed642043e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd20ff70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:34.551768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0cae9e85-65bf-4d15-9c79-168ed642043e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1413 microversion: 2.1 time: 0.151535 Oct 04 17:56:34.552901 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 883/1663] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:34 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:34.561220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:34.562149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:34.571697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.572382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.572998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.573998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:34.575006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:34.575624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:34.846728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:34.887324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:34.889864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:34.894170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e24830db-89f5-4d7d-b48b-6ab427a42fa7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.425601 Oct 04 17:56:34.895487 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 781/1664] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:33 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:35.421948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:35.422627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:35.439174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.439862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.440317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.442544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.443003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.448739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.627606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:35.637065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:35.645699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:35.659349 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1fa1c98-048c-49e5-b83c-6d581b4839f4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1567 microversion: 2.25 time: 1.099075 Oct 04 17:56:35.662983 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 884/1665] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:34 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1567 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:35.668220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0bcab9e-4268-48b2-abef-bb5a24237c61 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd1c5670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:35.836224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:35.851133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3dbc32b4-c5c5-47c4-a0a8-f3e22e41dee3 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 0.429863 Oct 04 17:56:35.852512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 782/1666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:35 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:56:35.926336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:35.927307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:35.940169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.941135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.941741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:35.943590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:35.946216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:35.947579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:37.237903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:37.316804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:37.336730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:37.339069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:37.340580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6855b6de-6988-4b1f-b29c-3fb5785b2ce6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 1.418591 Oct 04 17:56:37.341718 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 783/1667] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:35 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:37.361788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:37.362775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:37.375921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:37.376778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:37.377487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:37.378509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:37.379196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:37.380476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:37.391164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:38.189168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:38.207227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:38.210147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:38.211598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c918ec2f-bfb9-4775-ac38-aa5f6258637e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1567 microversion: 2.25 time: 0.868661 Oct 04 17:56:38.214126 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 784/1668] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:37 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1567 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:38.219087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:38.223709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:38.242880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.245357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.246713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.248973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:38.249719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:38.250711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:38.684783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:38.696532 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c0a7e09-a094-458f-9b71-3d36f8edc0f6 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 0.481039 Oct 04 17:56:38.702701 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 785/1669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:38 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:38.720663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-534514718", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1d78baf0-94b4-4ca4-af52-68a3a65e6111"}], "security_groups": [{"name": "tempest-securitygroup--1412474761"}], "key_name": "tempest-keypair-53372890", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:39.339021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:44.571407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=29 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:45.636899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:48.688979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:48.763737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:56:52.076129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0bcab9e-4268-48b2-abef-bb5a24237c61 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1422 microversion: 2.1 time: 16.411621 Oct 04 17:56:52.086313 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 885/1670] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:35 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1422 bytes in 16422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:52.091534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:52.092459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.099809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.101428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.102109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.103031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.103664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.104282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.140509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] validate_networks() for [('1d78baf0-94b4-4ca4-af52-68a3a65e6111', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:52.316355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.326359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.328089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.329250 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4de6d28a-3390-4a1a-8155-c24838f3bf37 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.241913 Oct 04 17:56:52.329997 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 886/1671] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:52 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:52.334813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2f0c9c-dbce-4c4d-bc66-be240ab6553a", "name": "network-vif-unplugged", "status": "completed", "tag": "d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:52.344385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.344868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.345300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.357417 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] Creating event network-vif-unplugged:d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c for instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a on n-h1-831194-21 Oct 04 17:56:52.362696 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0cf5a0d7-1c54-4a5d-b129-03f52e90c75f req-8b88c8a2-d55a-4d88-82b3-ca1c4a33c6cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031395 Oct 04 17:56:52.363498 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 887/1672] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:52.370569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:52.371519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.377890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.378400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.378845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.379545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.380000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.380647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.576285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.596119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.598099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.601447 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0f53dea1-7432-4fa5-a216-f70d40ce1876 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1542 microversion: 2.25 time: 0.236272 Oct 04 17:56:52.606990 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 888/1673] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:52 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1542 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:52.613033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:52.613863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:52.624233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.624866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.625507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.626655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.627188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.627867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.802340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:52.817275 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ffac453-0aa7-4c9d-a89f-55912490af30 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1332 microversion: 2.1 time: 0.208663 Oct 04 17:56:52.819528 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 889/1674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:52 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1332 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:52.872817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:52.888041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for user 13b3aaa5c74d408b828248e5f4f8b3e8 and project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:52.902779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:52.903195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:52.903861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:52.904263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:52.904848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:52.909341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1437819970", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "8b9d78a7-66e3-42b0-bd34-13b6e6505f19"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:52.919097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.919788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.920985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.921770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:52.922489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:52.923095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:52.945514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:52.952690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Getting quotas for user 13b3aaa5c74d408b828248e5f4f8b3e8 and project 96c00a0a4bf244878cabf24f3b1bdd82. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:52.966774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:52.969925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:52.989982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] validate_networks() for [('8b9d78a7-66e3-42b0-bd34-13b6e6505f19', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:53.030926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-778c3d8c-7fbb-4051-84a3-249f8758465a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 14.327027 Oct 04 17:56:53.033088 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 786/1675] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:38 2022] POST /compute/v2.1/servers => generated 407 bytes in 14330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:53.038943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e247a29a-302d-4a21-9146-b325591fe572", "name": "network-vif-plugged", "status": "completed", "tag": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:53.049713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.050582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.051188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.105095 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] Creating event network-vif-plugged:82dd0488-e2eb-4f8f-9507-8a9a568fc6ac for instance e247a29a-302d-4a21-9146-b325591fe572 on n-h2-831194-21 Oct 04 17:56:53.128224 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fbd5d2ef-be49-4da1-b7e1-3dd5bbc6568f req-20028974-2f72-4de2-8ab5-5f510048bdbe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091577 Oct 04 17:56:53.129040 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 787/1676] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:53.231295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] Calling method '.version_select at 0x7fbdbd16b1f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.307258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 471239eb-c966-4934-b10d-091b8dfbbd43 could not be found", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:56:53.307973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] HTTP exception thrown: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] Request method failure captured: Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-floating-ips/471239eb-c966-4934-b10d-091b8dfbbd43 HTTP/1.1 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPbIMaWNofU_k-jxXEiVNvJdlvSfCkbO-Zip1dACGTgz23YNeewRkvpdTZwHSAbbZnxEF54M1qOUXK8J9_ZIQBr7t0oBSzbL8CEKBS39PkPSyU3Y8oPr_hxkSWN0Kvc67TfAAqiwRmXaUGi78ya1BmZz-zViRyyU7tCOpdXCqDEbL0 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a84320c8a2c54d96af3d33a89f2f87e1 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1632044669 Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:56:53.310026 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a84320c8a2c54d96af3d33a89f2f87e1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a84320c8a2c54d96af3d33a89f2f87e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a84320c8a2c54d96af3d33a89f2f87e1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a84320c8a2c54d96af3d33a89f2f87e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1632044669 Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a84320c8a2c54d96af3d33a89f2f87e1 Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1632044669 Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dfe9fd1d4c8d437babd9a02ac7ee249a Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: exception: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43 Oct 04 17:56:53.311918 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '471239eb-c966-4934-b10d-091b8dfbbd43'} Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.313113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 471239eb-c966-4934-b10d-091b8dfbbd43 could not be found Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c83d970b-f3d3-4848-b752-53e2ae06783a'] Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43. Oct 04 17:56:53.315599 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43 Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:56:53.317204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43 Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] Returning 404 to user: Floating IP not found for ID 471239eb-c966-4934-b10d-091b8dfbbd43 {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec1b25d7-d5ce-4bc7-9369-9aefb30e3638 tempest-FloatingIPDetailsNegativeTestJSON-1632044669 tempest-FloatingIPDetailsNegativeTestJSON-1632044669-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/471239eb-c966-4934-b10d-091b8dfbbd43" status: 404 len: 111 microversion: 2.1 time: 0.181344 Oct 04 17:56:53.319686 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 788/1677] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/os-floating-ips/471239eb-c966-4934-b10d-091b8dfbbd43 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:56:53.324497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9194e35d-a63d-4d32-93ab-f0420e3681c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd15e1f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.441301 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9194e35d-a63d-4d32-93ab-f0420e3681c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 200 len: 1422 microversion: 2.1 time: 0.127253 Oct 04 17:56:53.454044 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 789/1678] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 1422 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:53.461625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6488f53-0d38-4979-9da0-31897292e446 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '.version_select at 0x7fbdbd16bb80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.470439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6488f53-0d38-4979-9da0-31897292e446 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.471204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6488f53-0d38-4979-9da0-31897292e446 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.472002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6488f53-0d38-4979-9da0-31897292e446 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.492040 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6488f53-0d38-4979-9da0-31897292e446 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 2136 microversion: 2.25 time: 0.032659 Oct 04 17:56:53.493288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 790/1679] 10.222.0.42 () {60 vars in 1184 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/os-migrations => generated 2136 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:53.513505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1abdd4e7-2366-4a6b-af1b-6161c207539e tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.514329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1abdd4e7-2366-4a6b-af1b-6161c207539e tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:53.639861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1abdd4e7-2366-4a6b-af1b-6161c207539e tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:53.650729 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1abdd4e7-2366-4a6b-af1b-6161c207539e tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1267 microversion: 2.1 time: 0.155629 Oct 04 17:56:53.667273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 791/1680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:53.679320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:53.680361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:53.689854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.691143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.691782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.693939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.694620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.695839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.880298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:53.881133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:53.882784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:53.883674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:53.884392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:53.898784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.899832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.900498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.901451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:53.902129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:53.904077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:53.930840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Getting quotas for project 11115d232e364cff9ca6675cd6b2b2fd. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:53.938407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Getting quotas for user 6e7ea7d1c20e44dba9f187869ddf3079 and project 11115d232e364cff9ca6675cd6b2b2fd. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:53.962932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Going to run 3 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:53.966368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:54.008767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=e80ebeb2-7538-4c14-97b8-5644a8710b53,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:54.056186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=a98142af-4396-4595-96a3-d5bbb5310166,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:54.150027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:54.173679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:54.176428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-386ca8ac-8aba-4704-b731-c22545d50614 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.354181 Oct 04 17:56:54.178043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:54.178877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 890/1681] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:54.180138 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3935d7f7-3e9d-45ad-ba9e-112e5b144e59 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.511254 Oct 04 17:56:54.180883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 792/1682] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:53 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:54.188185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dce38ce5-0a3a-403c-bda5-571b303d067b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd21bca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.212344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.214822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:54.247452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.249609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.251663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.255512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.256523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.259486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.775221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:56:54.809382 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-87e012ef-01f9-481d-8416-241418fa0f52 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 2036 microversion: 2.25 time: 0.627280 Oct 04 17:56:54.827127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 793/1683] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 2036 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:54.842460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:54.843091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:54.851515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.852243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.852840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.853938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:54.854582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:54.854846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:54.987556 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dce38ce5-0a3a-403c-bda5-571b303d067b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 204 len: 0 microversion: 2.1 time: 0.807504 Oct 04 17:56:54.989587 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 891/1684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:54 2022] DELETE /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:54.995465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.000341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:55.001816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:56:55.030170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.030926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.031614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.032693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.034165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.034864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.068618 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34a37347-2b6a-4bd0-8d12-4c842349a3e2 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.077749 Oct 04 17:56:55.074492 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 892/1685] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/servers => generated 1018 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.085379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b2f0c9c-dbce-4c4d-bc66-be240ab6553a", "tag": "d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:55.094503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.095251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.095877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.118465 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] Creating event network-changed:d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c for instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a on n-h1-831194-21 Oct 04 17:56:55.124105 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0243bd40-6fd8-46ab-814f-99d387dacb47 req-6edb8a21-2238-4587-9ff1-93d42a44044d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047950 Oct 04 17:56:55.125297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 893/1686] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:56:55.131885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.133005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:55.140177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.140924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.141366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.142093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.142864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.143296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.403421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:55.424002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82e05afe-0600-4c0c-9b2e-58801d4ffae0 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1319 microversion: 2.1 time: 0.292805 Oct 04 17:56:55.428638 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 894/1687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:55 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1319 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.444335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-044178bc-356f-4f41-81cb-842fd4fcdcf1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: .version_select at 0x7fbdbd21eb80>, body: {"keypair": {"name": "tempest-keypair-338829499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1axXeiUZe/fqI5jDD1pmhw9DM2vk2cw7uYTBcPvfK146Xa+6nmWymspOY8znS8sSNrCde2+OjQSvkhH7PzTm06TynUE7BnaxY/DNys8GtIMm6t6qwQ4w0taky5NkmSRQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:55.543864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-044178bc-356f-4f41-81cb-842fd4fcdcf1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for project b9a0ab319603408d99c87a900deb5a0f. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:55.561359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-044178bc-356f-4f41-81cb-842fd4fcdcf1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for user 606a8a3f1311407498ad45ed8d78e558 and project b9a0ab319603408d99c87a900deb5a0f. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:55.633187 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-044178bc-356f-4f41-81cb-842fd4fcdcf1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.203052 Oct 04 17:56:55.634352 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 895/1688] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 17:56:55 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 204 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 17:56:55.648688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.650920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:55.686125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.686875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.687490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.688408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:55.689033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:55.689653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:55.760334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:56:55.819815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:55.828717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2eaef9db-0c3d-4096-a70b-ae7cfcbb018a tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1536 microversion: 2.1 time: 1.000331 Oct 04 17:56:55.829312 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 794/1689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:54 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1536 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:55.846611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f439557a-e4c7-4e77-b48f-47fc66005a5b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:55.847547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f439557a-e4c7-4e77-b48f-47fc66005a5b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:55.915638 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff13f41a-3644-4a52-a992-335c8fe43b89 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 204 len: 0 microversion: 2.1 time: 0.276790 Oct 04 17:56:55.921000 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 896/1690] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:56:55 2022] DELETE /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:56:55.966154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "e715b681-6d3d-42b7-bf4c-9dab4479a0ba"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "78e075c1-d1f1-4533-bab5-3813daaa8bae"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "e910d5c6-456a-4049-803a-bd29699c9db8"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "c0e2a82b-d291-45a2-a17a-2b9ae86d6207"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "a67950f7-a222-4066-81f1-b63ffdaaf39d"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "5c7a6da1-ba4c-454e-8f5c-970dfade82c8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:55.972418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f439557a-e4c7-4e77-b48f-47fc66005a5b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:55.992721 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f439557a-e4c7-4e77-b48f-47fc66005a5b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1223 microversion: 2.1 time: 0.162319 Oct 04 17:56:55.998672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 795/1691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:55 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1223 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:56.011869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:56.012962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:56.014060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:56.016223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:56.017257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:56.053052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:56.056112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:56.058672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:56.061048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:56.062734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:56.066585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:56.094750 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:e715b681-6d3d-42b7-bf4c-9dab4479a0ba for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.095282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:78e075c1-d1f1-4533-bab5-3813daaa8bae for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.095782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:e910d5c6-456a-4049-803a-bd29699c9db8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.096279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:c0e2a82b-d291-45a2-a17a-2b9ae86d6207 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.096777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:a67950f7-a222-4066-81f1-b63ffdaaf39d for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.097264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] Creating event network-vif-plugged:5c7a6da1-ba4c-454e-8f5c-970dfade82c8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:56:56.114789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-13b8b648-45f4-4b8c-b24e-50f5e948e285 req-cb66986a-a921-4254-8d68-ec6153588863 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.190021 Oct 04 17:56:56.117877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 897/1692] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:56.131324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2b3ddc1-2115-4b1d-a800-0a500b4df5ac tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'create', calling method: .version_select at 0x7fbdbd1c5790>, body: {"pool": "4b08c814-5b8b-45b1-8ff6-fdc843dc9787"} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:56.823968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:56.837482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:56.840973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:56.842507 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7df6f3fc-073a-4b3f-967e-7ce6153ebbb5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.842508 Oct 04 17:56:56.843772 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 796/1693] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:56:55 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:56:56.850425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-863354127", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "c33ce19a-c198-46b8-a446-c121fdf53f1c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:56:56.920804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] validate_networks() for [('c33ce19a-c198-46b8-a446-c121fdf53f1c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:56:58.478142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:56:58.479360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:56:58.480192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:56:58.480804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:56:58.481436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:56:58.501580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.504387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.508791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:58.509908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.512369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.513119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:58.617059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:56:58.640458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for user 2e3ae7cc3d854e0690d8354dbca1e6c6 and project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:56:58.674930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:56:58.681421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:56:58.750452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d06b91a-d7c9-487b-b62c-697096c0e595 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905214 Oct 04 17:56:58.751891 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 797/1694] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:56:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:56:58.763490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:58.764119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:58.775951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.776777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.777424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:58.778352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:58.778984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:58.779583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:59.812683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:56:59.829510 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a1e051d-9eb0-4a4f-b509-75c0ee9a6444 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 1.072730 Oct 04 17:56:59.830199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 798/1695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:58 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:56:59.845948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:56:59.846732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:56:59.863420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:59.865164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:59.865821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:56:59.869197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:56:59.869944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:56:59.870563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.121790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.147392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac84dadf-a64a-48b8-ac41-1c2534270ce6 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1281 microversion: 2.1 time: 0.316052 Oct 04 17:57:00.150672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 799/1696] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:56:59 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1281 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:00.160330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:00.165409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:00.176288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.179731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.180369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.181729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.182885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.183486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.595750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.609299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.610776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.618617 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a25640fe-a0bc-4a5d-88dd-b9e7d4013504 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.466700 Oct 04 17:57:00.619529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 800/1697] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:00 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:00.636002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-plugged", "status": "completed", "tag": "9ee68e4b-b282-44d0-9a38-8266e4d20a88"}, {"server_uuid": "12fcdafe-41b2-42ee-832e-350f2f537be8", "name": "network-vif-unplugged", "status": "completed", "tag": "bb60f577-1777-4d1f-a184-62a3642069b3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:00.655511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.656261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.656998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.674734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Creating event network-vif-plugged:9ee68e4b-b282-44d0-9a38-8266e4d20a88 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:57:00.679565 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] Creating event network-vif-unplugged:bb60f577-1777-4d1f-a184-62a3642069b3 for instance 12fcdafe-41b2-42ee-832e-350f2f537be8 on n-h1-831194-21 Oct 04 17:57:00.691583 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-44165ec4-356c-4c2d-ad96-b4485a6d7e75 req-fcef5b73-aa61-43a3-b8f4-25dfcb9abc4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.070640 Oct 04 17:57:00.693164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 801/1698] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:00.699350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:00.700065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:00.706515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.707048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.707501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.708230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.709216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.710429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.823541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:00.840981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-59cfe00a-ab47-4519-aadf-6c2e0df2132a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1259 microversion: 2.1 time: 0.146384 Oct 04 17:57:00.841585 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 802/1699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:00 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:00.848744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12fcdafe-41b2-42ee-832e-350f2f537be8", "name": "network-vif-deleted", "tag": "bb60f577-1777-4d1f-a184-62a3642069b3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:00.859112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.860077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.860691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.874740 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] Creating event network-vif-deleted:bb60f577-1777-4d1f-a184-62a3642069b3 for instance 12fcdafe-41b2-42ee-832e-350f2f537be8 on n-h1-831194-21 Oct 04 17:57:00.885919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8ff8bd96-9f58-4c5d-8f36-7de087cfd291 req-aab2b666-3c3d-4c54-a2c7-9dcc5ed036cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042717 Oct 04 17:57:00.887120 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 803/1700] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:00.893567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:00.894606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:00.901307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.902156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.902820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:00.903776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:00.904449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:00.905078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.406060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:01.419065 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-add7eb2d-b32d-43d4-8b69-ee982283fbd2 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.530046 Oct 04 17:57:01.420413 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 804/1701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:00 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:01.436726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:01.438017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:01.445167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.446007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.446670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.447621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.448317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.448964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.543156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:01.558739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-426adbee-8988-4835-b367-710be5cf30cf tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1281 microversion: 2.1 time: 0.135612 Oct 04 17:57:01.559389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 805/1702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:01 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:01.655998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:01.657416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:01.669685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.671708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.674527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:01.682379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:01.683241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:01.683686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.103825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.114730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.116747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.118083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c0aeffb1-f15e-4257-a88f-711927854928 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1874 microversion: 2.32 time: 0.470516 Oct 04 17:57:02.118685 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 806/1703] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:01 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1874 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:02.141618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:02.148412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:02.171188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.172213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.174189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.186182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.191909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.195489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.372143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:02.382938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e46caa8-8274-4acc-bb7e-b53ffc785613 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1265 microversion: 2.1 time: 0.263085 Oct 04 17:57:02.384340 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 807/1704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:02 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:02.443947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:02.446006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:02.455408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.456489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.457212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.459073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.459593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.460697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.911532 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2b3ddc1-2115-4b1d-a800-0a500b4df5ac tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.789441 Oct 04 17:57:02.912887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 898/1705] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:56:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:02.918994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:02.922839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:02.949411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.953140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.958112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:02.959893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:02.963720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:02.964450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:03.011818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:03.034726 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d101d067-c794-4ed8-b360-093f6c779db4 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.595567 Oct 04 17:57:03.063298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 808/1706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:02 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:03.068813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.53"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:03.074961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:03.087502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:03.088280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:03.088953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:03.090017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:03.090686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:03.091669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:03.123506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:57:03.124858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquired lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:57:03.185485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:03.200513 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97eef5f6-f21e-4d3c-aee6-2a3c095af14d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1281 microversion: 2.1 time: 0.286277 Oct 04 17:57:03.224087 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 899/1707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:02 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1281 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:03.224087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:03.224087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:03.234350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:03.235210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:03.235765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:03.236611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:03.237158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:03.237694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.406715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:04.434853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:04.437487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:04.440977 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c554f80-42eb-45c9-bdf9-86ef09416c5f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2824 microversion: 2.32 time: 1.230240 Oct 04 17:57:04.441567 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 900/1708] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:03 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2824 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:04.471020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:04.471639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:04.489947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.490440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.490880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:04.491592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:04.492047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:04.492470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.042338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:05.187339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:05.216304 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e2ebdaa-be03-45e2-8be2-233f1a483bdd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.743313 Oct 04 17:57:05.217748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 901/1709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:04 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:05.236986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:05.237679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.248470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.249118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.249692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.251471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.251851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.252539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.596329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:05.850207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:05.860353 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-144650b5-3019-4e2f-b1f2-6be41b2f817a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.640797 Oct 04 17:57:05.883344 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 902/1710] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:05 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:05.889647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80ebeb2-7538-4c14-97b8-5644a8710b53", "tag": "29379d6f-9372-4521-a608-5101f889cb24"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:05.906064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.906858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.907510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.926790 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] Creating event network-changed:29379d6f-9372-4521-a608-5101f889cb24 for instance e80ebeb2-7538-4c14-97b8-5644a8710b53 on n-h2-831194-21 Oct 04 17:57:05.940096 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d0680d8f-6619-4599-bb91-4528b05aa07f req-cf7a3817-1ea4-48b4-b694-6fccd24b21d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054536 Oct 04 17:57:05.942051 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 903/1711] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:05.952262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:05.953021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:05.961408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.961935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.962379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:05.963636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:05.964096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:05.965043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.452112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:06.468424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef101ba8-f9bd-49b5-84b7-a3d2b1ffe831 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.523120 Oct 04 17:57:06.470985 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 904/1712] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:05 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:06.479443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:06.481512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:06.492610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.494055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.495545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.499243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:06.499767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:06.502241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Building network info cache for instance {{(pid=128850) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:57:06.502722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:06.777963 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78a99367-16fc-4690-bb0d-9b055f27f7a2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.304976 Oct 04 17:57:06.779944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 905/1713] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 17:57:06 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df/os-interface => generated 1828 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:06.785890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1870225647", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ddc88b3c-c71e-4266-969e-2a17e558023b"}], "block_device_mapping_v2": [{"uuid": "64f1569e-da62-45d2-b98f-75ca9bf3bd43", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:06.904375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] validate_networks() for [('ddc88b3c-c71e-4266-969e-2a17e558023b', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:07.617762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Updating instance_info_cache with network_info: [{"id": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac", "address": "fa:16:3e:43:3f:df", "network": {"id": "8c806019-95ae-42d2-95ad-2b299cb37bb4", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2088899677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17b155d8d2e34cd3b27cf3233969d281", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap82dd0488-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128850) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:57:07.628990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:07.635428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Releasing lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128850) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:07.638281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80628035-20bb-4069-b279-9c1b42b8b08d tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 202 len: 0 microversion: 2.1 time: 4.572685 Oct 04 17:57:07.641795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 809/1714] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:03 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 0 bytes in 4575 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:57:07.649568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1301967156", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "0d00d17a-1f2f-4d1c-a39a-93ff893f6b91"}], "security_groups": [{"name": "tempest-securitygroup--1677414772"}], "key_name": "tempest-keypair-338829499", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:07.831432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] validate_networks() for [('0d00d17a-1f2f-4d1c-a39a-93ff893f6b91', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:08.269303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:08.270869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:08.270869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:08.271208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:08.271725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:08.288811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.289317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.290288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.291496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.292312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.292980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.312413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:08.318617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for user 606a8a3f1311407498ad45ed8d78e558 and project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:08.333868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:08.336718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:08.370023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:08.396705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b79d2471-429b-42d1-90ca-3667ba3efc52 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 0.756245 Oct 04 17:57:08.398254 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 810/1715] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:57:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:57:08.403789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a53d6f-50be-4f98-8538-f9fc28345505", "tag": "d4e0fbcd-a0cc-4db5-af79-69322c31f4d1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:08.417002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.417739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.418408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.430630 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] Creating event network-changed:d4e0fbcd-a0cc-4db5-af79-69322c31f4d1 for instance 00a53d6f-50be-4f98-8538-f9fc28345505 on n-h2-831194-21 Oct 04 17:57:08.437703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-edaeac56-1273-4445-a2d1-b6a23c88d5f5 req-b2f15f18-b569-4922-bdac-59b213dc1fe0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037951 Oct 04 17:57:08.438949 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 811/1716] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:08.447591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:08.448587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:08.459026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.460617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.461106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:08.461853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:08.462324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:08.464565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.040020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:09.050390 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50735ef6-c86d-4f96-af6f-917df2dfbe18 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.609895 Oct 04 17:57:09.066157 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 812/1717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:08 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:09.072111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.073464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.081613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.083676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.084682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.086870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.088212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.088946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.258538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:09.259611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:09.260095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:09.260515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:09.261001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:09.277638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.284985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.285583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.287155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.287637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.288074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.293610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:09.310633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-556628dc-da10-41d3-95bb-9d17c9ab97a9 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.242615 Oct 04 17:57:09.330238 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 813/1718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:09.344962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.347870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.366065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:09.366429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.366979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.367424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.369047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.369510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.369965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.381162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Getting quotas for user ea6b89bd15d0468a920310645029d5d1 and project b7916c0d165d40f38d13d012e9dc627c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:09.486721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:09.489820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64f1569e-da62-45d2-b98f-75ca9bf3bd43',volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:09.564649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:09.574804 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f11abc1a-1a8e-48c5-a027-c0cceb69e24a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.243173 Oct 04 17:57:09.590751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 814/1719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:09.596546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1034118b-ee50-48ab-b89c-acb9a2e8a923 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'create', calling method: .version_select at 0x7fbdbd176430>, body: {"pool": "4b08c814-5b8b-45b1-8ff6-fdc843dc9787"} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:09.689399 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d763f91c-20fd-423f-9895-471fa51dc38a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.908047 Oct 04 17:57:09.690665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 906/1720] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:09.696306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bae59853-8da0-4004-a56e-d44726a17207", "tag": "aa961dc3-afee-40c5-88a7-00bb35b6700c"}, {"name": "network-changed", "server_uuid": "e247a29a-302d-4a21-9146-b325591fe572", "tag": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:09.709228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.710103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.710726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.726560 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Creating event network-changed:aa961dc3-afee-40c5-88a7-00bb35b6700c for instance bae59853-8da0-4004-a56e-d44726a17207 on n-h1-831194-21 Oct 04 17:57:09.741993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] Creating event network-changed:82dd0488-e2eb-4f8f-9507-8a9a568fc6ac for instance e247a29a-302d-4a21-9146-b325591fe572 on n-h2-831194-21 Oct 04 17:57:09.753038 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ad89f434-d953-4925-a570-8426d6fb1c35 req-df476a79-75e4-4540-b6a4-d2b1064f3817 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060955 Oct 04 17:57:09.756084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 907/1721] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:09.763135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:09.764897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:09.773877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.774632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.775438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:09.776350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:09.777388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:09.778035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.187025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.205143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.215253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.217634 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a6ab918-4d15-43d3-ac51-6ea7a05401a8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1337 microversion: 2.25 time: 0.460020 Oct 04 17:57:10.219752 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 908/1722] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:09 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1337 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:10.240684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca13f978-eade-4bab-8d85-77222011ef30 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.241639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca13f978-eade-4bab-8d85-77222011ef30 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:10.462903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca13f978-eade-4bab-8d85-77222011ef30 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.479579 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca13f978-eade-4bab-8d85-77222011ef30 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1053 microversion: 2.1 time: 0.255920 Oct 04 17:57:10.482153 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 909/1723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:10 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1053 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:10.495268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.495989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:10.512660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=13,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:10.517534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.519869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.523569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.524344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.524815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.525257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.588932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:10.936937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:10.945177 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-734b1fd3-856a-4445-9ad7-50b57d4b47d8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.460563 Oct 04 17:57:10.958473 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 910/1724] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:10 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:10.966644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:10.967512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:10.978813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.979572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.980172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:10.981041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:10.981655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:10.982273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.199048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:11.208851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebb2b632-cd35-4cfd-a784-f4d3aa3ffb11 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.248731 Oct 04 17:57:11.209414 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 911/1725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:10 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:11.225066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98142af-4396-4595-96a3-d5bbb5310166", "tag": "6b646275-15df-4894-bd2d-941f9064ae82"}, {"name": "network-changed", "server_uuid": "a545ac96-c0e9-41e2-8607-7eeabe520182", "tag": "68f11906-328d-4d33-973a-0ca801f2a9ad"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:11.226446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.226931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.227365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.241584 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Creating event network-changed:6b646275-15df-4894-bd2d-941f9064ae82 for instance a98142af-4396-4595-96a3-d5bbb5310166 on n-h2-831194-21 Oct 04 17:57:11.242139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] Creating event network-changed:68f11906-328d-4d33-973a-0ca801f2a9ad for instance a545ac96-c0e9-41e2-8607-7eeabe520182 on n-h1-831194-21 Oct 04 17:57:11.250868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6d20ec02-242f-44ff-9779-e3326bb5eeef req-61e7e77c-9011-49e4-9e61-07f6a313bb5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040238 Oct 04 17:57:11.251784 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 912/1726] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:11.258257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.259320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:11.266332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.266826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.267263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.268167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.268627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.269227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.425527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:11.435917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c2455a6-aa63-4b76-9078-9bd260b29c10 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.182762 Oct 04 17:57:11.437576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 913/1727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:11 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:11.622622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Calling method '.version_select at 0x7fbdbd1fd0d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.636846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.637689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.638359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.639315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.640463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.641057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.669958 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c2cb556-3836-4ea3-90e0-dd1b6d47a637 tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] 10.222.0.42 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.230689 Oct 04 17:57:11.671219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 914/1728] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Oct 4 17:57:11 2022] GET /compute/v2.1/limits => generated 511 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:11.677148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80ebeb2-7538-4c14-97b8-5644a8710b53", "name": "network-vif-plugged", "status": "completed", "tag": "29379d6f-9372-4521-a608-5101f889cb24"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:11.700819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.705151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.712561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.725149 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] Creating event network-vif-plugged:29379d6f-9372-4521-a608-5101f889cb24 for instance e80ebeb2-7538-4c14-97b8-5644a8710b53 on n-h2-831194-21 Oct 04 17:57:11.734274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-16a2dad5-d9dd-437a-8f1e-0dd2f7e8b861 req-5f0bcbb1-d932-4aa9-af36-9da4fd7b9cbb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061360 Oct 04 17:57:11.739754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 915/1729] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:11.746164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.747277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:11.755087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.756046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.756791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.757920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.758617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.759435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.908690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:11.930644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:11.932116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:11.933255 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e832c0f8-6eb9-43ef-9d7c-321a0a2c45a3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1343 microversion: 2.25 time: 0.192049 Oct 04 17:57:11.936384 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 916/1730] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:11 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1343 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:11.960136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:11.961586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:11.969446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.970037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.970715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:11.971929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:11.972549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:11.973028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:12.100936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:12.118628 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-282facc9-19ce-419a-9d63-3c904ba1b5f5 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1151 microversion: 2.1 time: 0.180821 Oct 04 17:57:12.131619 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 917/1731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:11 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1151 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:12.142719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-519906601", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:12.227687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:12.798511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Getting quotas for project c54d8abf96644ee6a38aded97c657915. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:12.807589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Getting quotas for user e4511aa5598a423c97432829fc9feecd and project c54d8abf96644ee6a38aded97c657915. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:12.846996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Request method failure captured: Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 1751 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHP2i8acGPZI_3BZtyChnFFqxit0RVtIkUaKS-Pc2j_QIAiIgFF5JMM-P56yR_N1rrO4dkAm6fWTvxyQhV3CBjJK5AQiUV6566rQwLOB9tfuvUZd0Qe8fhN7eg1Rhgh6YMHuIc_C-Ggms0uYm-Q3gZhgIadMiLWm5q-g-8duYbcYHho Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c54d8abf96644ee6a38aded97c657915 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1638779304 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c54d8abf96644ee6a38aded97c657915"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c54d8abf96644ee6a38aded97c657915"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c54d8abf96644ee6a38aded97c657915"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c54d8abf96644ee6a38aded97c657915"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1638779304 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c54d8abf96644ee6a38aded97c657915 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1638779304 Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e4511aa5598a423c97432829fc9feecd Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-519906601", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:57:12.859369 n-d-831194-21 devstack@n-api.service[128849]: exception: Maximum number of metadata items exceeds 128 Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-519906601', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:12.862226 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:12.870234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fafe9e35-af2e-48e2-a5f7-27fc7aa2f4ce tempest-AbsoluteLimitsNegativeTestJSON-1638779304 tempest-AbsoluteLimitsNegativeTestJSON-1638779304-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.728163 Oct 04 17:57:12.875903 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 918/1732] 10.222.0.42 () {60 vars in 1148 bytes} [Tue Oct 4 17:57:12 2022] POST /compute/v2.1/servers => generated 87 bytes in 740 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:57:12.891158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:12.894461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:12.909500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:12.910358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:12.912979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:12.913963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:12.917873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:12.918711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.769443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:13.781605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-899e21f3-7c13-41ee-9f82-be4d5b66715e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.902048 Oct 04 17:57:13.782279 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 919/1733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:12 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:13.804989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:13.813286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:13.831200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.831907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.833226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:13.834191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:13.834829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:13.835460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.191960 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1034118b-ee50-48ab-b89c-acb9a2e8a923 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.599805 Oct 04 17:57:14.194375 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 815/1734] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:57:09 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:14.244033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.247624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.249450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.277449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36033188-75ca-4913-85f4-a403de917153 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.478813 Oct 04 17:57:14.278393 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 920/1735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:13 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:14.283784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.284942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.285185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.287704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.290528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.291663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.293118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.293986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.304454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.304971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.305418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.306176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.306632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.307148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.538319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.548264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.550248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.552553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ee42b27-2f35-4db4-a8d7-10335cf4b12d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.273009 Oct 04 17:57:14.553997 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 921/1736] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:14.570877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.571517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.580203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.580966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.581578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.582874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.583794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.584406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.736706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.756684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1daac7f0-fb85-4918-81c7-a24523b1ad21 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1169 microversion: 2.1 time: 0.201275 Oct 04 17:57:14.779797 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 922/1737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1169 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:14.804239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "tag": "c0e2a82b-d291-45a2-a17a-2b9ae86d6207"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:14.819735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.820870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.820870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.858005 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] Creating event network-changed:c0e2a82b-d291-45a2-a17a-2b9ae86d6207 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 17:57:14.873561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e69ee3f2-5a7f-4949-a7cf-cfafeffaf6b8 req-ea5c82c7-0aa6-4d8c-a20f-cc817f259b5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091751 Oct 04 17:57:14.876598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 923/1738] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:14.887374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae59853-8da0-4004-a56e-d44726a17207", "name": "network-vif-plugged", "status": "completed", "tag": "aa961dc3-afee-40c5-88a7-00bb35b6700c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:14.910297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:14.911585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:14.911720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:14.945906 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] Creating event network-vif-plugged:aa961dc3-afee-40c5-88a7-00bb35b6700c for instance bae59853-8da0-4004-a56e-d44726a17207 on n-h1-831194-21 Oct 04 17:57:14.952935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:14.960008 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-664c174d-372d-4f00-ad3a-243e1cbf20bb req-f81d8e0c-0205-4b34-9182-1ab4c39c653b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081123 Oct 04 17:57:14.965394 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 924/1739] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:14.974412 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ad28aa5-58ff-4e65-9760-b21372dab2f8 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.763071 Oct 04 17:57:14.975256 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 816/1740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:14.980563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:14.981478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:14.998778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: .version_select at 0x7fbdbf7aad30>, body: {"addFloatingIp": {"address": "172.25.5.14"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:15.006186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:15.030873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.034107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.034971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.037623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.039036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.039207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.039808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.045270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.048454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.050014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.051410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.052167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.135656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:57:15.136576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquired lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:57:15.792005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:15.812512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f89484f1-89c2-41e0-9e1a-cb7c60b5db2e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.835876 Oct 04 17:57:15.813397 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 817/1741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:14 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:15.822287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:15.823267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:15.835527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.838493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.839131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:15.840029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:15.845128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:15.845862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.238128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787.", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:57:16.239559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Releasing lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:16.240658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] HTTP exception thrown: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.240658 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Request method failure captured: Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action HTTP/1.1 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 45 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO-E1hVZ5fgigq7nUEEc5ltq4CP5WtwB1KnCy8N2UWvnbW5FzpHKOkmBC_V7weaskiVErVYFojFirWf9nRWOfgEechv714yg1rdFRw5x6mQFzjtWjwl_NCaojFrtM7S_KScpqYXzExP1obJzoc8wyh-U_B6M_mc2yk6yFD-zqqLoAE Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad4f3b5b31bb49118ac47cece94b802c Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: {"addFloatingIp": {"address": "172.25.5.14"}} Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e247a29a-302d-4a21-9146-b325591fe572', 'body': {'addFloatingIp': {'address': '172.25.5.14'}}} Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:57:16.244062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] Oct 04 17:57:16.249062 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:16.256313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Returning 400 to user: Cannot associate floating IP 172.25.5.14 (5adf9697-2124-4ca9-ac01-c4652f05f907) with port 82dd0488-e2eb-4f8f-9507-8a9a568fc6ac using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 4b08c814-5b8b-45b1-8ff6-fdc843dc9787. Oct 04 17:57:16.256313 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-7b87619b-5c13-4696-906f-68471cca10f0'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:16.257632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6ac540d-7050-4975-968a-c6ce23e99ad5 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 400 len: 380 microversion: 2.1 time: 1.289494 Oct 04 17:57:16.258896 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 925/1742] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:14 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 380 bytes in 1293 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:16.267391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:16.269071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:16.279261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.280193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.281090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.282932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.283659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.284338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.352093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.397315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52ff359f-338f-4578-b418-083720f3b7cb tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.582528 Oct 04 17:57:16.406974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 818/1743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:15 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:16.420909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:16.421538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:16.444431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.446030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.448345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.449344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.454085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.454729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.537042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.551015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.553790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.555972 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe8f6ed1-67aa-4f7c-bc01-e3bb93bf470b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.294069 Oct 04 17:57:16.556858 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 926/1744] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:16 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:16.588493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:16.589231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:16.600228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.601261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.602817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.604151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.607199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.608402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.802494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:16.813189 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2edcddf-a4dd-4fff-8b58-0ab79fe39986 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.254621 Oct 04 17:57:16.814868 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 927/1745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:16 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:16.822101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:16.862665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:16.863463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:16.864089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:16.906375 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] Creating event network-changed:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h1-831194-21 Oct 04 17:57:16.912194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-da724f16-6360-4d78-97d5-ee55f7ca7e40 req-829e7400-5ad2-4d22-99b4-8f450c3d556d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095238 Oct 04 17:57:16.912905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 928/1746] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:16.919114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6079b3d-3423-4190-91c1-381d18f20601 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '.version_select at 0x7fbdbd1fdb80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:17.188877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:17.210643 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d808021-9edc-4ea7-9091-7c97a314ef0d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1211 microversion: 2.1 time: 0.802046 Oct 04 17:57:17.211825 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 819/1747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:16 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1211 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:17.217692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:17.219482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:17.228412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:17.229340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:17.230012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:17.231013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:17.231626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:17.232211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:17.842644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:17.857604 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-820c07f9-6c7c-449c-8534-b03ad5483611 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1307 microversion: 2.1 time: 0.644191 Oct 04 17:57:17.858941 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 820/1748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:17 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1307 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:17.871712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a53d6f-50be-4f98-8538-f9fc28345505", "name": "network-vif-plugged", "status": "completed", "tag": "d4e0fbcd-a0cc-4db5-af79-69322c31f4d1"}, {"server_uuid": "a98142af-4396-4595-96a3-d5bbb5310166", "name": "network-vif-plugged", "status": "completed", "tag": "6b646275-15df-4894-bd2d-941f9064ae82"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:17.891706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:17.897647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:17.898534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:17.936506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Creating event network-vif-plugged:d4e0fbcd-a0cc-4db5-af79-69322c31f4d1 for instance 00a53d6f-50be-4f98-8538-f9fc28345505 on n-h2-831194-21 Oct 04 17:57:17.938819 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] Creating event network-vif-plugged:6b646275-15df-4894-bd2d-941f9064ae82 for instance a98142af-4396-4595-96a3-d5bbb5310166 on n-h2-831194-21 Oct 04 17:57:17.957013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e1211e85-a3e8-4701-a9a7-2745f31323c6 req-b2cfab77-2ed7-4f8c-97a8-5e7c981c2695 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.093511 Oct 04 17:57:17.964330 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 821/1749] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:17.973762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:17.975383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:17.984322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:17.985549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:17.986307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:17.987774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:17.988419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:17.989554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:18.303844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:18.327291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=26 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:18.712642 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6079b3d-3423-4190-91c1-381d18f20601 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/5adf9697-2124-4ca9-ac01-c4652f05f907" status: 202 len: 0 microversion: 2.1 time: 1.798451 Oct 04 17:57:18.713805 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 929/1750] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:57:16 2022] DELETE /compute/v2.1/os-floating-ips/5adf9697-2124-4ca9-ac01-c4652f05f907 => generated 0 bytes in 1800 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:18.720526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:18.722393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:18.740662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:18.742693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:18.743367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:18.744320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:18.746681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:18.749549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.040603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.071094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.073047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.074670 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31c1d7f4-033e-4b58-b182-41000c902ce0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.358755 Oct 04 17:57:19.078330 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 930/1751] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:18 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:19.088522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:19.089494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:19.097628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.098196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.098680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.099915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.102131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.104354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.195575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.205087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9bf75c86-e582-41c3-b5d1-b59391418bee tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 1.238519 Oct 04 17:57:19.209936 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 822/1752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:17 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:19.548206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:19.548940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:19.556227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.557218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.557922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.558854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.559596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.560236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.576681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.595865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-126e6d0b-66b9-472b-bf84-607e934b2068 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.513848 Oct 04 17:57:19.597163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 931/1753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:19 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:19.604693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.53"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:19.804899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:19.828551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-10a264e2-2891-435a-a7f2-a1e56e233711 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1211 microversion: 2.1 time: 0.616745 Oct 04 17:57:19.829353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 823/1754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:19 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1211 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:19.836223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:19.856413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.859436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.866313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.870401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:19.871653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.872368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.873156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.876448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:19.895761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.903240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.904244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:19.905184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:19.906383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:19.907203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.110084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:20.122386 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b3e006d-1bc2-4273-b2b1-79e90b38b007 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1486 microversion: 2.1 time: 0.291763 Oct 04 17:57:20.124068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 824/1755] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:19 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1486 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:20.129293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df74761e-98eb-4e85-b208-f52678075b2a", "tag": "68eac1d1-f4b1-4baa-b456-d71061eecc70"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:20.142673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.143210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.144017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.159171 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] Creating event network-changed:68eac1d1-f4b1-4baa-b456-d71061eecc70 for instance df74761e-98eb-4e85-b208-f52678075b2a on n-h2-831194-21 Oct 04 17:57:20.165126 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4bee2707-4669-4c53-b385-5bb50786b531 req-f5abdc2b-3b27-441f-a680-d5f7efd102e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039579 Oct 04 17:57:20.165741 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 825/1756] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:20.172736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a545ac96-c0e9-41e2-8607-7eeabe520182", "name": "network-vif-plugged", "status": "completed", "tag": "68f11906-328d-4d33-973a-0ca801f2a9ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:20.184189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.184958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.185400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.198788 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] Creating event network-vif-plugged:68f11906-328d-4d33-973a-0ca801f2a9ad for instance a545ac96-c0e9-41e2-8607-7eeabe520182 on n-h1-831194-21 Oct 04 17:57:20.206172 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a4fa1732-70b7-4ce3-9e7a-844214ac5467 req-b6c45a0c-cc4b-47e3-92d0-e925b9295f4e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037291 Oct 04 17:57:20.206788 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 826/1757] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:20.213486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:20.214239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:20.220886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.221377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.221818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.222636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.223093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.223563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.395570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:20.424962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:20.437778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:20.446747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17493959-3098-4de3-b530-5106238dacea tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.233818 Oct 04 17:57:20.447570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 827/1758] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:20 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:20.476674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:20.500284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.502322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.504122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.543812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Going to try to stop instance {{(pid=128850) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 17:57:20.618962 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-283c6911-4785-4b0e-88bd-a2dd40d1080c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207/action" status: 202 len: 0 microversion: 2.1 time: 0.168930 Oct 04 17:57:20.619671 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 828/1759] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:20 2022] POST /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:20.626639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:20.627452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:20.636063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.636833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.639371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.640337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:20.641012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:20.641657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:20.673314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:20.986414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:57:20.987646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquired lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:57:21.228316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:21.237153 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2b3ecd4-7cbc-4177-9881-58d7c9916533 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1393 microversion: 2.1 time: 0.616204 Oct 04 17:57:21.241176 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 829/1760] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:20 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1393 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:21.248707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:21.262923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:21.269415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.270834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.271513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:21.272387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.273519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.274153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:21.646204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:21.652345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:21.663541 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2fe3d843-725d-4b20-8519-592105d67f17 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1323 microversion: 2.1 time: 0.418508 Oct 04 17:57:21.683113 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 830/1761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:21 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1323 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:21.693538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:21.695181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:21.701613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.702469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.703103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:21.704660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:21.705342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:21.706021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.043573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.056982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83ccd4a8-cabb-4b3c-a300-6b0808d02875 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.367946 Oct 04 17:57:22.057953 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 831/1762] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:21 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:22.062919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:22.070852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:22.094519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.095290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.095905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.097682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.098264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.098782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.345299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.355033 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02e08151-9499-49bd-818c-394e0c69da04 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1211 microversion: 2.1 time: 0.295663 Oct 04 17:57:22.355687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 832/1763] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:22 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1211 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:22.360983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:22.361595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:22.369179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.370022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.370496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.371194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.371816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.372481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.527958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Building network info cache for instance {{(pid=128849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 17:57:22.716338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.729352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.734414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:22.739728 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9878b21-aa12-4250-b230-ee04a8113898 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.381969 Oct 04 17:57:22.756068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 833/1764] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:22 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:22.769757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:22.771698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:22.780039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.781052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.781767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.782734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:22.783465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:22.784114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:22.825216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=14 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:23.328015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:23.336934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f8088e1-44ca-4afa-a03e-b41aae155c95 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1575 microversion: 2.1 time: 0.574059 Oct 04 17:57:23.357866 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 834/1765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:22 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1575 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:23.357866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e247a29a-302d-4a21-9146-b325591fe572", "tag": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:23.380002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.380860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.384250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.412059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] Creating event network-changed:82dd0488-e2eb-4f8f-9507-8a9a568fc6ac for instance e247a29a-302d-4a21-9146-b325591fe572 on n-h2-831194-21 Oct 04 17:57:23.419432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-eb641925-6156-4da6-9b1c-dc65bb4e3a62 req-ddb228c5-384c-408b-9e76-c1171fc8a433 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072721 Oct 04 17:57:23.421104 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 835/1766] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:23.432991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Updating instance_info_cache with network_info: [{"id": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac", "address": "fa:16:3e:43:3f:df", "network": {"id": "8c806019-95ae-42d2-95ad-2b299cb37bb4", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2088899677-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "17b155d8d2e34cd3b27cf3233969d281", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap82dd0488-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 17:57:23.440744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:23.451239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:23.457107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:23.459941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Releasing lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:23.467552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25eebfb6-e278-43d5-8b0c-4249a13c6124 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 202 len: 0 microversion: 2.1 time: 3.868993 Oct 04 17:57:23.472388 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 932/1767] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:19 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 0 bytes in 3874 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 17:57:23.487775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.490898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:23.492104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.492774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.494717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.495364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:23.496104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.498482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.514343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.514849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.515296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.516009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.526609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.527389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.786295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:23.803154 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24013072-5be4-41cc-8163-d2b02dca02b4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.323883 Oct 04 17:57:23.804071 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 933/1768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:23 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:23.814357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:23.815162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:23.831845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.836440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.837195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:23.838332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:23.838972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:23.839615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.134769 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e25606d2-05b9-4ef9-87ca-004074932c60 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.328469 Oct 04 17:57:24.135441 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 934/1769] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 17:57:23 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505/os-interface => generated 285 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:24.140988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:24.141610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:24.155703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.157424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.157897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.162844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.163297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.163758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.363444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:24.372574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22d4df79-fa40-4469-aca1-52b00a74a514 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1517 microversion: 2.1 time: 0.949845 Oct 04 17:57:24.389960 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 836/1770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:23 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1517 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:24.396188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3097eaa4-b088-4e92-bb3b-6880605e234e tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '.version_select at 0x7fbdbd0f9e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:24.474603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:24.491561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db3fa32c-3ad7-4ebd-98f3-f1b81936a36c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.354940 Oct 04 17:57:24.492959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 935/1771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:24 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:24.498354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:24.499627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:24.510692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.511605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.512305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.513345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.513854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.514591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.742263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:24.753049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:24.756276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:24.757444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83f2a33c-659a-4773-92e5-7169f4050776 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.263347 Oct 04 17:57:24.758325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 936/1772] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:24 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:24.763181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:24.764175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:24.775765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.776411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.776866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:24.777592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:24.780235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:24.780684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.013944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:25.024737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f2699d7-4abf-485b-8240-7482dbed0ada tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166" status: 200 len: 1516 microversion: 2.1 time: 0.265129 Oct 04 17:57:25.037854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 937/1773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:24 2022] GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 => generated 1516 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:25.037854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.037854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.049917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.050422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.050902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.051686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.052255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.052700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.232759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:25.241662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b984c8ec-4b6d-42b3-a794-cc7985da2355 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.212740 Oct 04 17:57:25.242654 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 938/1774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:25.249468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.250993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.261129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.261920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.262501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.263371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.264116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.264689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.443546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:25.451955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f83386ff-55ec-4a2e-80f3-690fe833ef7a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1516 microversion: 2.1 time: 0.207718 Oct 04 17:57:25.452550 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 939/1775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1516 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:25.476157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.476659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.483078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.483604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.484045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.484758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.485215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.485648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.518197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:25.618408 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27c498a8-f931-4a2d-b647-057fa8fa7f6e tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 204 len: 0 microversion: 2.1 time: 0.145986 Oct 04 17:57:25.619107 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 940/1776] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:25 2022] DELETE /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:25.629779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.630655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.637917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.638580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.639176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.640035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.640716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.641221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.786490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:25.794707 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-559dbc0e-e3f2-4c5a-af63-dacd14bb573b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.170518 Oct 04 17:57:25.795675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 941/1777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:25.799918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.800720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.807404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.807900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.808431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.809133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.809587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.810053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.949460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:25.957134 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-425ae8bf-9bc9-40f6-99ec-d36eceb23ebc tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1522 microversion: 2.1 time: 0.160685 Oct 04 17:57:25.959135 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 942/1778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:25.963492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:25.964104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:25.970870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.971338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.971965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:25.972886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:25.973358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:25.973806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.128533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:26.139705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:26.141294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:26.142642 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d90f13f3-97ab-4c1c-9d3e-50d423c252c7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.182888 Oct 04 17:57:26.143294 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 943/1779] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:25 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:26.267625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:26.268604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:26.276726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.277564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.278331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.279215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.281999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.282877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.419816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:26.427690 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45a0994f-5b19-4a4f-a752-d4757ec5e00e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.164156 Oct 04 17:57:26.428266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 944/1780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:26 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:26.698770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "name": "network-vif-plugged", "status": "completed", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:26.712816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.713735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.714429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.728293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] Creating event network-vif-plugged:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h1-831194-21 Oct 04 17:57:26.734750 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-773e802e-e749-4248-8f8b-adac40c8ac6d req-72698b9d-4b5b-4ca7-9194-af8edcc37bc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046803 Oct 04 17:57:26.737096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 945/1781] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:26.819395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:26.820101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:26.827635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.828079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.828514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:26.829226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:26.829681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:26.830338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.094372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.103622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-668e631b-42bc-4f3d-ba7c-175833162341 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.288890 Oct 04 17:57:27.113954 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 946/1782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:26 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:27.113954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:27.113954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:27.117351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.117930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.118308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.119013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.119468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.119902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.319133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3097eaa4-b088-4e92-bb3b-6880605e234e tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/ee99256c-94cf-4a2a-936c-6d9fe8ac7ee0" status: 202 len: 0 microversion: 2.1 time: 2.925966 Oct 04 17:57:27.322921 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 837/1783] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:57:24 2022] DELETE /compute/v2.1/os-floating-ips/ee99256c-94cf-4a2a-936c-6d9fe8ac7ee0 => generated 0 bytes in 2932 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:27.330992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:27.331690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:27.351018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.351352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.351842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.352573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.353170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.354743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.620204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.630501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b930daa5-971b-4210-8e3b-c26627753cb4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1522 microversion: 2.1 time: 0.524544 Oct 04 17:57:27.631087 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 947/1784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:27 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:27.636011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c67595d-9a91-41cd-a49f-fb8787bdcc1b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c67595d-9a91-41cd-a49f-fb8787bdcc1b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Request method failure captured: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action HTTP/1.1 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 34 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO-E1hVZ5fgigq7nUEEc5ltq4CP5WtwB1KnCy8N2UWvnbW5FzpHKOkmBC_V7weaskiVErVYFojFirWf9nRWOfgEechv714yg1rdFRw5x6mQFzjtWjwl_NCaojFrtM7S_KScpqYXzExP1obJzoc8wyh-U_B6M_mc2yk6yFD-zqqLoAE Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad4f3b5b31bb49118ac47cece94b802c Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: {"addFloatingIp": {"address": ""}} Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e247a29a-302d-4a21-9146-b325591fe572', 'body': {'addFloatingIp': {'address': ''}}} Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '' Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:57:27.640178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 04 17:57:27.646954 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:27.648784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c67595d-9a91-41cd-a49f-fb8787bdcc1b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:27.649632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c67595d-9a91-41cd-a49f-fb8787bdcc1b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 400 len: 142 microversion: 2.1 time: 0.017359 Oct 04 17:57:27.650220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 948/1785] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:27 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 142 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:27.654826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:27.655429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:27.664671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.665158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.665593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.666338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.666783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.667204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.703654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.718799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.720641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.722093 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b53b9bd9-e57e-443f-a0a3-495b174449de tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.397575 Oct 04 17:57:27.722794 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 838/1786] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:27 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:27.728726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:27.729760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:27.744439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.746486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.749074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.750148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.751025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.753138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.822423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:27.825008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:27.831883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9e66d20-4d3c-4f7a-879a-2c793d0aef48 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.180502 Oct 04 17:57:27.832462 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 949/1787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:27 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:27.837702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00a53d6f-50be-4f98-8538-f9fc28345505", "tag": "d4e0fbcd-a0cc-4db5-af79-69322c31f4d1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:27.855466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.856378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.856817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.870047 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] Creating event network-changed:d4e0fbcd-a0cc-4db5-af79-69322c31f4d1 for instance 00a53d6f-50be-4f98-8538-f9fc28345505 on n-h2-831194-21 Oct 04 17:57:27.875891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c927a913-dbd6-4c00-8c0b-cfb3aacef621 req-788a9006-f058-424e-bd57-2adbf85253b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041018 Oct 04 17:57:27.876627 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 950/1788] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:27.882010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:27.884715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:27.892046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.892527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.892965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.893664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:27.894136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:27.894576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:27.923303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 17:57:27.923805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquired lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 17:57:28.046521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Releasing lock "refresh_cache-e247a29a-302d-4a21-9146-b325591fe572" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 17:57:28.047316 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] HTTP exception thrown: floating IP not found Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Request method failure captured: Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action HTTP/1.1 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 41 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO-E1hVZ5fgigq7nUEEc5ltq4CP5WtwB1KnCy8N2UWvnbW5FzpHKOkmBC_V7weaskiVErVYFojFirWf9nRWOfgEechv714yg1rdFRw5x6mQFzjtWjwl_NCaojFrtM7S_KScpqYXzExP1obJzoc8wyh-U_B6M_mc2yk6yFD-zqqLoAE Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad4f3b5b31bb49118ac47cece94b802c Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: exception: floating IP not found Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e247a29a-302d-4a21-9146-b325591fe572', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 04 17:57:28.049782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 04 17:57:28.055610 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.058491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Returning 404 to user: floating IP not found {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:28.059587 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2aa89e37-e6e3-42ee-8b5b-be6c63c629cc tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 404 len: 67 microversion: 2.1 time: 0.181682 Oct 04 17:57:28.060272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 951/1789] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:27 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 67 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:57:28.070633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b27445e6-396f-4147-ad64-e1217a920614 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:28.120331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b27445e6-396f-4147-ad64-e1217a920614 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b27445e6-396f-4147-ad64-e1217a920614 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Request method failure captured: Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action HTTP/1.1 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 44 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHO-E1hVZ5fgigq7nUEEc5ltq4CP5WtwB1KnCy8N2UWvnbW5FzpHKOkmBC_V7weaskiVErVYFojFirWf9nRWOfgEechv714yg1rdFRw5x6mQFzjtWjwl_NCaojFrtM7S_KScpqYXzExP1obJzoc8wyh-U_B6M_mc2yk6yFD-zqqLoAE Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad4f3b5b31bb49118ac47cece94b802c Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: exception: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e247a29a-302d-4a21-9146-b325591fe572', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 04 17:57:28.123171 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b27445e6-396f-4147-ad64-e1217a920614 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:28.128505 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b27445e6-396f-4147-ad64-e1217a920614 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action" status: 404 len: 88 microversion: 2.1 time: 0.058881 Oct 04 17:57:28.130891 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 952/1790] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:28 2022] POST /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572/action => generated 88 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 17:57:28.136406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.137265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.144668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.146270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.146715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.147424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.147876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.148447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.212805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:28.225368 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be861d56-1647-4948-b2e1-d9892b767e33 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1575 microversion: 2.1 time: 0.500561 Oct 04 17:57:28.241942 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 839/1791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:27 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1575 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:28.241942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.241942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.247777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.248411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.248958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.249773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.250361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.250892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.283698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:28.328519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:28.340070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9feef6f-dc02-41f0-a7d5-5c1466938682 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.207635 Oct 04 17:57:28.354742 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 953/1792] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:28.386723 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6698f97-593a-476b-8cdc-85ebde3976f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 204 len: 0 microversion: 2.1 time: 0.154671 Oct 04 17:57:28.387487 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 840/1793] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:28 2022] DELETE /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:28.397552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.398581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.402255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:28.406684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.407523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.408302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.410451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.411172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.412031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.575322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:28.585659 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0978b00-e817-4da7-b5e6-4fa091b2385b tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1542 microversion: 2.1 time: 0.193068 Oct 04 17:57:28.602212 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 954/1794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1542 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:28.660497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.662121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.674763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.676333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.676747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.678646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.679281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.679872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.751317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:28.751888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:28.766471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.766980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.767423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.768186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:28.768643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:28.769077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:28.996202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.007009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-64568cc5-c165-42bf-872d-2bc0af481c38 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1480 microversion: 2.1 time: 0.353824 Oct 04 17:57:29.007521 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 841/1795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1480 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:29.016576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:29.018128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:29.029277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.040804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.041724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.042305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.043377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.044098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.045371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.046548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.052415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.053595 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1208d28-2e93-47b6-a428-88e865626766 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1411 microversion: 2.25 time: 0.306770 Oct 04 17:57:29.057942 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 955/1796] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:28 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1411 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:57:29.366220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:29.366779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:29.375264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.376073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.376927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.377707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.378262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.378790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.383644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.392623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c7ff9612-9d0b-4178-bd28-0e834216c073 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.381068 Oct 04 17:57:29.394872 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 842/1797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:29 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:29.529459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.539185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df12d9c0-7bd8-411e-9983-f1a8ef9c721f tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.178868 Oct 04 17:57:29.540256 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 956/1798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:29 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:29.609254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:29.609894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:29.616944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.617543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.618053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.618913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.619756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.620191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.625111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3cbb8998-d085-493f-bcac-8c4c751ed777 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbe2d4160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-467853791", "description": "tempest-description-610136134"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:29.784094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:29.793101 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3cbb8998-d085-493f-bcac-8c4c751ed777 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.224016 Oct 04 17:57:29.803347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0e030db1-b7df-414e-99cf-0a22318b38f2 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1542 microversion: 2.1 time: 0.189578 Oct 04 17:57:29.804593 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 957/1799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:29 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1542 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:29.805874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 843/1800] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:57:29 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:29.809356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a591cf81-d350-40bb-868f-000e3556840b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd1b5e50>, body: {"security_group_rule": {"parent_group_id": "f887b9ca-997b-4947-9657-60e64d2be5aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:29.893154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80ebeb2-7538-4c14-97b8-5644a8710b53", "name": "network-vif-deleted", "tag": "29379d6f-9372-4521-a608-5101f889cb24"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:29.903939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:29.904692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:29.905122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:29.919259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] Creating event network-vif-deleted:29379d6f-9372-4521-a608-5101f889cb24 for instance e80ebeb2-7538-4c14-97b8-5644a8710b53 on n-h2-831194-21 Oct 04 17:57:29.924146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9c4ce235-d0f9-494f-8fe3-eb0f90b5d5e8 req-f1fcf19f-686c-4f1c-8f58-7cdf06cf66a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035356 Oct 04 17:57:29.925046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 844/1801] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:57:30.013577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a591cf81-d350-40bb-868f-000e3556840b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.208173 Oct 04 17:57:30.014614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 958/1802] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:29 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:30.030300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99378939-506a-4663-8621-e260916d1515 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbdc25820>, body: {"security_group_rule": {"parent_group_id": "f887b9ca-997b-4947-9657-60e64d2be5aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:30.034822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.035689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.061709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.062208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.062645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.063366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.063825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.064251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.145585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.149072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-99378939-506a-4663-8621-e260916d1515 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99378939-506a-4663-8621-e260916d1515 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 138 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: {"security_group_rule": {"parent_group_id": "f887b9ca-997b-4947-9657-60e64d2be5aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: exception: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f887b9ca-997b-4947-9657-60e64d2be5aa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:30.150723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99378939-506a-4663-8621-e260916d1515 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: This rule already exists in group f887b9ca-997b-4947-9657-60e64d2be5aa {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99378939-506a-4663-8621-e260916d1515 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.127284 Oct 04 17:57:30.156230 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 845/1803] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:30 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:30.157042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.157751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.163165 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c95e5e86-1a57-4cec-acf8-1dfe86d2c840 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1308 microversion: 2.1 time: 0.132563 Oct 04 17:57:30.163843 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 959/1804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1308 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:30.174061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.174371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12eeb3d7-12de-4c31-adae-d0ad86767024 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd21eaf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.174531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.174531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.174531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.174531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.174531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.343185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12eeb3d7-12de-4c31-adae-d0ad86767024 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/dc6eeb10-fc79-48db-93e3-69a24964d963" status: 202 len: 0 microversion: 2.1 time: 0.178084 Oct 04 17:57:30.348991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 960/1805] 10.222.0.42 () {58 vars in 1287 bytes} [Tue Oct 4 17:57:30 2022] DELETE /compute/v2.1/os-security-group-rules/dc6eeb10-fc79-48db-93e3-69a24964d963 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:30.354838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e7d0592-27d2-4b14-a0cc-9c09623f5d90 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd19c820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-95426972", "description": "tempest-description-2038040648"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:30.415510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.451892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.457098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.462082 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27e46495-8725-4d5a-9f16-31c1bdf9bbc0 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1608 microversion: 2.25 time: 0.306736 Oct 04 17:57:30.478447 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 846/1806] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1608 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:57:30.491066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.494758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.511010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.512415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.514817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.515740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.516440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.518382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.606190 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e7d0592-27d2-4b14-a0cc-9c09623f5d90 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.255488 Oct 04 17:57:30.606982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 961/1807] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:57:30 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:30.629728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.631383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.649264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.650089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.652498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.654222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.655628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.656155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.757789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbebf91c-b2fd-4603-96e1-1a39350ffa2b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.140355 Oct 04 17:57:30.759027 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 962/1808] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:57:30.767539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:30.769935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:30.779257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.779888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.780428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.781478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:30.782193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:30.782749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:30.948659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:30.961408 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3209f1ac-a56e-4edb-bb2e-23dbc22afdec tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.480317 Oct 04 17:57:30.964216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 847/1809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:30.971977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7199ba23-7942-445b-a3a0-fe0b0d4af829 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd07a790>, body: {"security_group_rule": {"parent_group_id": "6844cb02-8ce2-47e1-a8ee-2935f144dbee", "ip_protocol": "tcp", "from_port": 15135165, "to_port": 22}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.179024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7199ba23-7942-445b-a3a0-fe0b0d4af829 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Invalid port range 15135165:22. Former value cannot be greater than the later Oct 04 17:57:31.181495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7199ba23-7942-445b-a3a0-fe0b0d4af829 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 144 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: {"security_group_rule": {"parent_group_id": "6844cb02-8ce2-47e1-a8ee-2935f144dbee", "ip_protocol": "tcp", "from_port": 15135165, "to_port": 22}} Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid port range 15135165:22. Former value cannot be greater than the later Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6844cb02-8ce2-47e1-a8ee-2935f144dbee', 'ip_protocol': 'tcp', 'from_port': 15135165, 'to_port': 22}}} Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 15135165:22. Former value cannot be greater than the later Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 15135165:22. Former value cannot be greater than the later Oct 04 17:57:31.182186 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 15135165:22. Former value cannot be greater than the later Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.187998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7199ba23-7942-445b-a3a0-fe0b0d4af829 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: Invalid port range 15135165:22. Former value cannot be greater than the later {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:31.190775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7199ba23-7942-445b-a3a0-fe0b0d4af829 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 121 microversion: 2.1 time: 0.218075 Oct 04 17:57:31.196676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 848/1810] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:30 2022] POST /compute/v2.1/os-security-group-rules => generated 121 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:31.200454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:31.201084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:31.204426 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6da33f5-824d-4351-b4ff-8043c5d05a54 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.443125 Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.229854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.231217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 963/1811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:30 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:31.240082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:31.242160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:31.249749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.250751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.251741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.252846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.253573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.254299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.303424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.304507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.306183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:31.307158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lazy-loading 'fault' on Instance uuid e80ebeb2-7538-4c14-97b8-5644a8710b53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:31.555841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:31.559524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:31.578491 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70e5f36a-d672-45ee-91ef-3b936b7e5730 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1542 microversion: 2.1 time: 0.378549 Oct 04 17:57:31.587409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 849/1812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:31 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1542 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:31.595281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9870fb8-042e-4d91-b5f8-fb12d058807f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd16cc10>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1062244935", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.598574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d9870fb8-042e-4d91-b5f8-fb12d058807f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Security group id should be uuid Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9870fb8-042e-4d91-b5f8-fb12d058807f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 131 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1062244935", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group id should be uuid Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1062244935', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:31.602702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:31.609550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 04 17:57:31.609550 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:31.612094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9870fb8-042e-4d91-b5f8-fb12d058807f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: Security group id should be uuid {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:31.614505 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9870fb8-042e-4d91-b5f8-fb12d058807f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.024425 Oct 04 17:57:31.615902 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 850/1813] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:31 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:57:31.625957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f70fcf9f-bc65-4888-8266-7930e62b7025 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd0f9670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-807055805", "description": "tempest-description-593649764"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.648654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:31.660641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d682c6c-f488-4aaa-97bf-a820db8e2424 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 200 len: 1313 microversion: 2.1 time: 0.427632 Oct 04 17:57:31.665524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 964/1814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:31 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:31.921585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f70fcf9f-bc65-4888-8266-7930e62b7025 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.299734 Oct 04 17:57:31.930082 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 851/1815] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:57:31 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:31.936700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51d83b56-b17d-4248-a60a-0bafda80593a tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd1603a0>, body: {"security_group_rule": {"parent_group_id": "cbbc493e-085d-49e5-b895-329a05567420", "ip_protocol": "tempest-999-421982959", "from_port": 22, "to_port": 22}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.964290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e247a29a-302d-4a21-9146-b325591fe572", "name": "network-vif-deleted", "tag": "82dd0488-e2eb-4f8f-9507-8a9a568fc6ac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:31.981012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:31.981740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:31.982221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.006944 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] Creating event network-vif-deleted:82dd0488-e2eb-4f8f-9507-8a9a568fc6ac for instance e247a29a-302d-4a21-9146-b325591fe572 on n-h2-831194-21 Oct 04 17:57:32.014060 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3a6b7376-6cc9-491f-abd5-60f5df76ffe7 req-252248d5-bd88-46a1-a7df-14c016bbbf42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058246 Oct 04 17:57:32.020853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 852/1816] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:57:32.030334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.032776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:32.041650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.042260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.043254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.044050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.044515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.045559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.179421 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-51d83b56-b17d-4248-a60a-0bafda80593a tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Invalid IP protocol tempest-999-421982959. Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51d83b56-b17d-4248-a60a-0bafda80593a tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 156 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: {"security_group_rule": {"parent_group_id": "cbbc493e-085d-49e5-b895-329a05567420", "ip_protocol": "tempest-999-421982959", "from_port": 22, "to_port": 22}} Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid IP protocol tempest-999-421982959. Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cbbc493e-085d-49e5-b895-329a05567420', 'ip_protocol': 'tempest-999-421982959', 'from_port': 22, 'to_port': 22}}} Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-421982959. Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-421982959. Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.183030 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-421982959. Oct 04 17:57:32.193195 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.198442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51d83b56-b17d-4248-a60a-0bafda80593a tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: Invalid IP protocol tempest-999-421982959. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:32.199732 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-51d83b56-b17d-4248-a60a-0bafda80593a tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.267372 Oct 04 17:57:32.205685 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 965/1817] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:31 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:57:32.218147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2df1a0a7-f5da-4d8b-b19f-e8e5afb21e7f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd1551f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-466781485", "description": "tempest-description-1298009284"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:32.339968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:32.352723 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22fc6ee6-555c-4497-bff6-688cf11e1ff6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.329014 Oct 04 17:57:32.356592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 853/1818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:32.377180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.378992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:32.389229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.390016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.390695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.391626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.392471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.400187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.653673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:32.664580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa1bbd05-1592-4ace-ae47-147e2494fe8e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.306551 Oct 04 17:57:32.665479 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 854/1819] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:32.681375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.682630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:32.693116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.694140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.695093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.696371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.697116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.697751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.751390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.752247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.753066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.753858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lazy-loading 'fault' on Instance uuid e247a29a-302d-4a21-9146-b325591fe572 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:32.827551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2df1a0a7-f5da-4d8b-b19f-e8e5afb21e7f tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.620355 Oct 04 17:57:32.839614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 966/1820] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:57:32 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:32.839614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.839968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad4f3b5b31bb49118ac47cece94b802c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17b155d8d2e34cd3b27cf3233969d281', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:32.840238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:32.850629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e63db2ac-b2b8-4a47-9228-7b7974b11db8 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 200 len: 1322 microversion: 2.1 time: 0.182565 Oct 04 17:57:32.856466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.858917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.859400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.863363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.864452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.866758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.869445 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 855/1821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:32.875526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df74761e-98eb-4e85-b208-f52678075b2a", "name": "network-vif-plugged", "status": "completed", "tag": "68eac1d1-f4b1-4baa-b456-d71061eecc70"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:32.891809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.892376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.892916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.897689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] HTTP exception thrown: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 HTTP/1.1 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e80ebeb2-7538-4c14-97b8-5644a8710b53'} Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.899338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 404 to user: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09b6beb5-ed5e-4166-9b3b-570960a70ddb tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 404 len: 111 microversion: 2.1 time: 0.066174 Oct 04 17:57:32.908231 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 967/1822] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:32.917204 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] Creating event network-vif-plugged:68eac1d1-f4b1-4baa-b456-d71061eecc70 for instance df74761e-98eb-4e85-b208-f52678075b2a on n-h2-831194-21 Oct 04 17:57:32.922542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48346efc-bf4f-469f-af65-879c67e50db2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd160700>, body: {"security_group_rule": {"parent_group_id": "cc40073c-af10-45e1-b260-f748adc4e212", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:32.936079 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d42fb8ab-f771-4201-af88-63285983b666 req-c9dcb4b0-ca42-4c44-8037-0a36574367fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053418 Oct 04 17:57:32.937443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 856/1823] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:32.945604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:32.952506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:32.953884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:32.960223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.960835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.961379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:32.962262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:32.962825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:32.963359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.137197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-48346efc-bf4f-469f-af65-879c67e50db2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48346efc-bf4f-469f-af65-879c67e50db2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 138 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: {"security_group_rule": {"parent_group_id": "cc40073c-af10-45e1-b260-f748adc4e212", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'cc40073c-af10-45e1-b260-f748adc4e212', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:57:33.138755 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48346efc-bf4f-469f-af65-879c67e50db2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48346efc-bf4f-469f-af65-879c67e50db2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.232122 Oct 04 17:57:33.143378 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 968/1824] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:32 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:33.155371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a50dc257-9fb3-4f93-9e25-64df7419ce6e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd168ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1629375576", "description": "tempest-description-1661072190"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:33.173085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-837d7652-4b8d-4500-8a41-779f7583b12a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.233941 Oct 04 17:57:33.173807 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 857/1825] 10.222.0.42 () {58 vars in 1230 bytes} [Tue Oct 4 17:57:32 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:33.196279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:33.210388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.211421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.212073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.227733 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] Creating event network-changed:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h1-831194-21 Oct 04 17:57:33.235259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e9d9484b-109e-4210-a15e-9ca3c72541d9 req-00b7829a-0caa-4624-ba54-28147aa6b7b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042846 Oct 04 17:57:33.237617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 858/1826] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:33.248808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dba2aaf6-ab12-446f-b758-12445f108618 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dba2aaf6-ab12-446f-b758-12445f108618 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 17:57:33.255525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dba2aaf6-ab12-446f-b758-12445f108618 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dba2aaf6-ab12-446f-b758-12445f108618 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.019507 Oct 04 17:57:33.269507 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 859/1827] 10.222.0.42 () {58 vars in 1182 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:33.274731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.284386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.285165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:33.295612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.296092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.296525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.297249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.297705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.298148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.351427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:57:33.403120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdbd46cc-c5fb-48c0-bf6f-119318ba29e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.134346 Oct 04 17:57:33.404016 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 860/1828] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers => generated 683 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:33.408977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.409696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:33.416726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.417376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.418226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.419268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.419411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.419780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.505319 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a50dc257-9fb3-4f93-9e25-64df7419ce6e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.358092 Oct 04 17:57:33.515898 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 969/1829] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 17:57:33 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:33.522747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.532816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.533547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.servers [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Removing options 'limit' from query {{(pid=128849) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 04 17:57:33.534655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:33.541631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.542470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.543158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.544106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.544950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.545723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.594155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:57:33.623853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.629052 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f24313a1-978e-4d80-932d-6fdf1c7b0696 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.111728 Oct 04 17:57:33.631039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 970/1830] 10.222.0.42 () {58 vars in 1144 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:33.634595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf6719bb-0e57-4ce5-8719-486d6339d7be tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.229423 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 861/1831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-392e6ca4-405f-478d-bf7f-89b2d1255c2a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-392e6ca4-405f-478d-bf7f-89b2d1255c2a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '-1' Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.650286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-392e6ca4-405f-478d-bf7f-89b2d1255c2a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-392e6ca4-405f-478d-bf7f-89b2d1255c2a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010031 Oct 04 17:57:33.657122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 862/1832] 10.222.0.42 () {58 vars in 1142 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:33.660981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb6be27c-2d84-4976-9d05-6f527e956f10 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd1f7550>, body: {"security_group_rule": {"parent_group_id": "2b7e7638-1eda-40e6-b351-74d84c0d10ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 1084364939}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:33.663434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9166a8d-8c4f-41a2-b100-73d333ed2725 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9166a8d-8c4f-41a2-b100-73d333ed2725 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: action_args: {} Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'testing' Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 04 17:57:33.668163 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9166a8d-8c4f-41a2-b100-73d333ed2725 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9166a8d-8c4f-41a2-b100-73d333ed2725 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.011491 Oct 04 17:57:33.678275 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 863/1833] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:33.690638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b225cee8-f6c3-4c31-a643-84cc3d7435c0 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.700969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b225cee8-f6c3-4c31-a643-84cc3d7435c0 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.702414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b225cee8-f6c3-4c31-a643-84cc3d7435c0 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:33.709816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.compute.servers [None req-b225cee8-f6c3-4c31-a643-84cc3d7435c0 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Flavor 'non_existing_flavor' could not be found {{(pid=128850) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 04 17:57:33.711140 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b225cee8-f6c3-4c31-a643-84cc3d7435c0 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025453 Oct 04 17:57:33.717877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 864/1834] 10.222.0.42 () {58 vars in 1178 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:33.717877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.717877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:33.725563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.726297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.727131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.727950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.728535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.729015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.731834 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cb6be27c-2d84-4976-9d05-6f527e956f10 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb6be27c-2d84-4976-9d05-6f527e956f10 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 146 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: {"security_group_rule": {"parent_group_id": "2b7e7638-1eda-40e6-b351-74d84c0d10ea", "ip_protocol": "tcp", "from_port": 22, "to_port": 1084364939}} Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2b7e7638-1eda-40e6-b351-74d84c0d10ea', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1084364939}}} Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 Oct 04 17:57:33.733344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb6be27c-2d84-4976-9d05-6f527e956f10 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 400 to user: Invalid port range 22:1084364939. Valid TCP ports should be between 1-65535 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb6be27c-2d84-4976-9d05-6f527e956f10 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.102597 Oct 04 17:57:33.738817 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 971/1835] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:33 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:57:33.741594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.750837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.751515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:33.760891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.761378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.761821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.762568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.763026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.763471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.849629 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c193b2f3-faa9-4a91-b5bc-896f0158000b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.112028 Oct 04 17:57:33.850488 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 972/1836] 10.222.0.42 () {58 vars in 1174 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:33.855651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Action: 'create', calling method: .version_select at 0x7fbdbd172af0>, body: {"security_group_rule": {"parent_group_id": "a0c3df4a-a38e-442e-9909-0c24bc1d768c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:33.882176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG neutronclient.v2_0.client [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist", "detail": ""}} {{(pid=128849) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:57:33.882782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Neutron security group a0c3df4a-a38e-442e-9909-0c24bc1d768c not found {{(pid=128849) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 04 17:57:33.883423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.883423 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 138 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: {"security_group_rule": {"parent_group_id": "a0c3df4a-a38e-442e-9909-0c24bc1d768c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: exception: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a0c3df4a-a38e-442e-9909-0c24bc1d768c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:57:33.885399 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 404 to user: Security group a0c3df4a-a38e-442e-9909-0c24bc1d768c does not exist Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: Neutron server returns request_ids: ['req-28b802c4-5ff7-4c13-b2fa-c0653b33cee0'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00cee5e1-09b9-4aed-966e-7be0931d675e tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.035184 Oct 04 17:57:33.890089 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 973/1837] 10.222.0.42 () {60 vars in 1195 bytes} [Tue Oct 4 17:57:33 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:33.897476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.898070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.901622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:33.905314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.905797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.906318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.907357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.907811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.908296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.915870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:33.924778 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df613e48-aa40-409c-9a80-801c062ffd85 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1199 microversion: 2.1 time: 0.211219 Oct 04 17:57:33.925558 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 865/1838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1199 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:33.935028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:33.935960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] [instance: e247a29a-302d-4a21-9146-b325591fe572] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:33.939218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:33.960705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.963957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.964558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.965579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:33.966418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:33.967533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:33.985328 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] HTTP exception thrown: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Request method failure captured: Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 HTTP/1.1 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHO-E1hVZ5fgigq7nUEEc5ltq4CP5WtwB1KnCy8N2UWvnbW5FzpHKOkmBC_V7weaskiVErVYFojFirWf9nRWOfgEechv714yg1rdFRw5x6mQFzjtWjwl_NCaojFrtM7S_KScpqYXzExP1obJzoc8wyh-U_B6M_mc2yk6yFD-zqqLoAE Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_17b155d8d2e34cd3b27cf3233969d281"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 17b155d8d2e34cd3b27cf3233969d281 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ad4f3b5b31bb49118ac47cece94b802c Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e247a29a-302d-4a21-9146-b325591fe572'} Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. Oct 04 17:57:33.987834 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. Oct 04 17:57:33.993247 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:33.995960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] Returning 404 to user: Instance e247a29a-302d-4a21-9146-b325591fe572 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:33.997277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0662e1b9-44f7-4af7-8967-6fb4d1389b26 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372 tempest-FloatingIPsAssociationNegativeTestJSON-1570391372-project] 10.222.0.42 "GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572" status: 404 len: 111 microversion: 2.1 time: 0.067236 Oct 04 17:57:34.002366 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 866/1839] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers/e247a29a-302d-4a21-9146-b325591fe572 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:34.011077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbdb8cf70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.022924 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5506d0b0-7e2a-4a61-95d8-314ead0ea24b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.134053 Oct 04 17:57:34.024218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 974/1840] 10.222.0.42 () {58 vars in 1184 bytes} [Tue Oct 4 17:57:33 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:57:34.036956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.043131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:34.044230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:34.053507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.054141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.054724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.055908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.056467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.057130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.089592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG neutronclient.v2_0.client [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist", "detail": ""}} {{(pid=128850) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 04 17:57:34.090656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.security_group_api [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Neutron security group rule bffa58ca-41f0-45ef-a408-444210e94a46 not found {{(pid=128850) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 04 17:57:34.091188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] HTTP exception thrown: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.091188 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Request method failure captured: Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-security-group-rules/bffa58ca-41f0-45ef-a408-444210e94a46 HTTP/1.1 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQJQThgtGqpaIWN9dP4EIBCb6AfNRAWuZs08Xu6j6BMnxAH-RiULWxQOTEgG0YsPiwtYUGQKts0IdTUaGpaHTid3FkpJ-VPfv7z_82ez20tDetmhNOX3lc-Ap4bZIQHBxSlMuPKuFSJNiYVuV9DJEZH6eR0XwnroD475DiWOKz4Qe8 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8921b41334e54f9fbcbebfc9124e0d9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8921b41334e54f9fbcbebfc9124e0d9c Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d35327f5daa1445496a76e1eff85ae15 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: exception: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'bffa58ca-41f0-45ef-a408-444210e94a46'} Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 04 17:57:34.093245 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Returning 404 to user: Security group rule bffa58ca-41f0-45ef-a408-444210e94a46 does not exist Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: Neutron server returns request_ids: ['req-7b05132a-dd4b-45c1-a133-a6ddf65074c5'] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:34.099191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3af1305c-76f8-465b-b781-6b84f96ed24b tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-group-rules/bffa58ca-41f0-45ef-a408-444210e94a46" status: 404 len: 199 microversion: 2.1 time: 0.090987 Oct 04 17:57:34.105893 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 867/1841] 10.222.0.42 () {58 vars in 1287 bytes} [Tue Oct 4 17:57:34 2022] DELETE /compute/v2.1/os-security-group-rules/bffa58ca-41f0-45ef-a408-444210e94a46 => generated 199 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:34.109357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-016603d3-44b2-4184-abfb-95bf7ff12053 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd07aee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.117601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:57:34.161257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:34.169388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.171295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.172077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.444683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4071667b-7502-4ce8-844d-456bc65f0eb5 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.411654 Oct 04 17:57:34.446266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 975/1842] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:34.475810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f08d939-4f81-4b19-a155-a84414dcd2e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.496591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1f08d939-4f81-4b19-a155-a84414dcd2e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:34.503898 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f08d939-4f81-4b19-a155-a84414dcd2e4 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.032187 Oct 04 17:57:34.504548 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 976/1843] 10.222.0.42 () {58 vars in 1178 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 17:57:34.521761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.530014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:34.530760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Searching by: {'deleted': False, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:57:34.537076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.537556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.538078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.538840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.539307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.539793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.574625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:57:34.608268 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a10f886-e89b-4f84-8f64-ddab7c28bd0c tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.091195 Oct 04 17:57:34.620275 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 977/1844] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/servers => generated 683 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:57:34.626217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.627433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:34.635508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.636372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.637225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.638440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.639122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.639770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.660077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] HTTP exception thrown: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 HTTP/1.1 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e80ebeb2-7538-4c14-97b8-5644a8710b53'} Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:34.663166 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:34.668275 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:34.672337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 404 to user: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:34.672337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-100d3de1-fd44-4b96-8584-25facbc22827 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 404 len: 111 microversion: 2.1 time: 0.050056 Oct 04 17:57:34.677427 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 978/1845] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:34 2022] DELETE /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:34.684073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.686933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:34.691404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-016603d3-44b2-4184-abfb-95bf7ff12053 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/2b7e7638-1eda-40e6-b351-74d84c0d10ea" status: 202 len: 0 microversion: 2.1 time: 0.589848 Oct 04 17:57:34.693421 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 868/1846] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:57:34 2022] DELETE /compute/v2.1/os-security-groups/2b7e7638-1eda-40e6-b351-74d84c0d10ea => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:34.697262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.698530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.699563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.700764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.701541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.702089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:34.702617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.703359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:34.725364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.725931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.726424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.727151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:34.727605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:34.728174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:34.789036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:34.917592 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab98895a-0f0e-4e3d-ba14-954fec349355 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166" status: 204 len: 0 microversion: 2.1 time: 0.222517 Oct 04 17:57:34.921600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 869/1847] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:34 2022] DELETE /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:34.927931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-760f89ec-4bf9-4bb7-bb51-bb159f23cfd6 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd0f91f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.065041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:35.074766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:35.093511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-054ff10f-7bd9-43f3-bb5c-6928415d4071 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.414093 Oct 04 17:57:35.104894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 979/1848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:34 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.104894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.105235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.115861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.116780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.117668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.119004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.119731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.120609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.159481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:57:35.258230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c9a9300-623a-46bc-aa39-82ce3508bc4b tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 204 len: 0 microversion: 2.1 time: 0.161399 Oct 04 17:57:35.259445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 980/1849] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:57:35 2022] DELETE /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:57:35.266423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.267362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.275629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.276411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.277101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.277847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.278356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.278788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.361625 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-760f89ec-4bf9-4bb7-bb51-bb159f23cfd6 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/cc40073c-af10-45e1-b260-f748adc4e212" status: 202 len: 0 microversion: 2.1 time: 0.441280 Oct 04 17:57:35.363107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 870/1850] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:57:34 2022] DELETE /compute/v2.1/os-security-groups/cc40073c-af10-45e1-b260-f748adc4e212 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:35.371650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.372523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: e80ebeb2-7538-4c14-97b8-5644a8710b53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.380763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.381339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.381856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.382640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.383295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.383813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.402067 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] HTTP exception thrown: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 HTTP/1.1 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e80ebeb2-7538-4c14-97b8-5644a8710b53'} Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:35.404022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. Oct 04 17:57:35.410835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:35.413540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 404 to user: Instance e80ebeb2-7538-4c14-97b8-5644a8710b53 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:35.415644 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6410644e-700d-44e7-a60d-e85712ab0100 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53" status: 404 len: 111 microversion: 2.1 time: 0.048237 Oct 04 17:57:35.416234 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 871/1851] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/e80ebeb2-7538-4c14-97b8-5644a8710b53 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:35.425407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7f059abf-4f62-41ee-b470-3369f468b590 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd08a1f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.467065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:35.476737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63d61646-b026-45ba-a8a0-2aaf49de8c0e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1382 microversion: 2.1 time: 0.215683 Oct 04 17:57:35.477340 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 981/1852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1382 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.496138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.497506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.505184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.505751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.506217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.506961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.507413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.507914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.665004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:35.674795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b47ef80c-0a0c-45a4-be9f-0aff9161779d tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166" status: 200 len: 1522 microversion: 2.1 time: 0.196268 Oct 04 17:57:35.675766 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 982/1853] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.681737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.682722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.689519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.690628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.693062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.694142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.694844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.695277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.853362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9c3b4f1-6776-4548-a76c-c7ccf401bbc2 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1535 microversion: 2.1 time: 0.176286 Oct 04 17:57:35.853998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 983/1854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1535 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:35.880526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:35.881561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:35.881730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7f059abf-4f62-41ee-b470-3369f468b590 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/cbbc493e-085d-49e5-b895-329a05567420" status: 202 len: 0 microversion: 2.1 time: 0.462735 Oct 04 17:57:35.882937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 872/1855] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:57:35 2022] DELETE /compute/v2.1/os-security-groups/cbbc493e-085d-49e5-b895-329a05567420 => generated 0 bytes in 466 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:35.887441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.888018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.888549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.889238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:35.889670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:35.890509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:35.892121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74d39da4-7d6f-4a28-af48-9c0ffcdb7dfe tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd0f9ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.026155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52a48fc9-f40d-4426-80a3-9c68f5bd5beb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1535 microversion: 2.1 time: 0.150322 Oct 04 17:57:36.026725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 984/1856] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:35 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1535 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:36.048237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.052551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.053034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.053471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.054255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.054821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.055245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.086181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb5eaf35-1f02-4ffd-b133-e4a569852a03 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.041520 Oct 04 17:57:36.087598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 985/1857] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:57:36.107064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": false, "disk_over_commit": false}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:36.109544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:36.117635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.119982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.120546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.121353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.121922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.122330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.148615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lazy-loading 'flavor' on Instance uuid df74761e-98eb-4e85-b208-f52678075b2a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:36.161974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128849) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:57:36.610773 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74d39da4-7d6f-4a28-af48-9c0ffcdb7dfe tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/6844cb02-8ce2-47e1-a8ee-2935f144dbee" status: 202 len: 0 microversion: 2.1 time: 0.723861 Oct 04 17:57:36.613755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 873/1858] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:57:35 2022] DELETE /compute/v2.1/os-security-groups/6844cb02-8ce2-47e1-a8ee-2935f144dbee => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:57:36.627178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:36.638623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:36.652598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.653194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.655138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:36.656073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:36.656624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:36.657361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:37.001396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:37.017058 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6413da0-90de-45b8-bd50-764987189954 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.398300 Oct 04 17:57:37.019841 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 874/1859] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:36 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:37.044090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eaa124ab-c72b-4372-a37f-cff1958204e2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] Calling method '.version_select at 0x7fbdbd0f93a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:37.752071 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eaa124ab-c72b-4372-a37f-cff1958204e2 tempest-SecurityGroupRulesNegativeTestJSON-1721124040 tempest-SecurityGroupRulesNegativeTestJSON-1721124040-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/f887b9ca-997b-4947-9657-60e64d2be5aa" status: 202 len: 0 microversion: 2.1 time: 0.720099 Oct 04 17:57:37.752706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 875/1860] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 17:57:37 2022] DELETE /compute/v2.1/os-security-groups/f887b9ca-997b-4947-9657-60e64d2be5aa => generated 0 bytes in 732 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:57:37.762020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:37.762927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:37.781563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:37.782125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:37.782574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:37.783327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:37.783786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:37.784212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.049030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:38.064707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa573d79-a687-44e9-bdae-772be87e647a tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166" status: 200 len: 1480 microversion: 2.1 time: 0.304832 Oct 04 17:57:38.068878 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 876/1861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:37 2022] GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 => generated 1480 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:38.089081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98142af-4396-4595-96a3-d5bbb5310166", "name": "network-vif-deleted", "tag": "6b646275-15df-4894-bd2d-941f9064ae82"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:38.112019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.124354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.124956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.158280 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] Creating event network-vif-deleted:6b646275-15df-4894-bd2d-941f9064ae82 for instance a98142af-4396-4595-96a3-d5bbb5310166 on n-h2-831194-21 Oct 04 17:57:38.163911 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-03a6ea9f-5ad1-4e62-a34e-026ce1b7e6bb req-f770081b-6a07-4f89-bf03-eb35ffacd499 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090869 Oct 04 17:57:38.166443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 877/1862] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:38.178698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:38.179406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:38.189090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.189569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.190230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.199004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.199677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.200677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.586568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:38.611992 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04412165-6b04-4105-915d-841f1200b270 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.438873 Oct 04 17:57:38.614033 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 878/1863] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:38 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:38.667974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a545ac96-c0e9-41e2-8607-7eeabe520182", "name": "network-vif-deleted", "tag": "68f11906-328d-4d33-973a-0ca801f2a9ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:38.691085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.692183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.692858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.729854 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] Creating event network-vif-deleted:68f11906-328d-4d33-973a-0ca801f2a9ad for instance a545ac96-c0e9-41e2-8607-7eeabe520182 on n-h1-831194-21 Oct 04 17:57:38.752090 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1d0cdfce-1389-44f6-b4a7-8d2270b6aec3 req-7a8033aa-c58e-4f65-8654-07b1871a8f5f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134606 Oct 04 17:57:38.752524 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 879/1864] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:38.879164 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2efb538e-6e5e-41c4-97fa-65fbacd256f6 tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a/action" status: 202 len: 0 microversion: 2.1 time: 2.775551 Oct 04 17:57:38.880682 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 986/1865] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:57:36 2022] POST /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a/action => generated 0 bytes in 2780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 17:57:38.894605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:38.896683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:38.905772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.906801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.907647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:38.908809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:38.909938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:38.911830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.109278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:39.110103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a98142af-4396-4595-96a3-d5bbb5310166] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:39.130984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.131521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.131960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.132752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.133255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.134048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.149927 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] HTTP exception thrown: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 HTTP/1.1 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a98142af-4396-4595-96a3-d5bbb5310166'} Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:39.151634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 404 to user: Instance a98142af-4396-4595-96a3-d5bbb5310166 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b2b092f-8ae4-4f72-8efd-bb7ba1b5f382 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166" status: 404 len: 111 microversion: 2.1 time: 0.049153 Oct 04 17:57:39.155646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 987/1866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:39 2022] GET /compute/v2.1/servers/a98142af-4396-4595-96a3-d5bbb5310166 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:57:39.162063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:39.162718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:39.172742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.173227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.173662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.174385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.174835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.175258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.206800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.207286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.208426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.208912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lazy-loading 'fault' on Instance uuid a545ac96-c0e9-41e2-8607-7eeabe520182 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:57:39.251618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e7ea7d1c20e44dba9f187869ddf3079', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11115d232e364cff9ca6675cd6b2b2fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:39.260570 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-05fe3079-2f7b-4472-a78a-76c9a4a90818 tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 200 len: 1313 microversion: 2.1 time: 0.103015 Oct 04 17:57:39.261223 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 988/1867] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:39 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 1313 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:39.325289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:39.335551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a772eef4-05d8-4e69-b228-fe08c422d41a tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.448921 Oct 04 17:57:39.336248 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 880/1868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:38 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:39.640185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:39.641080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:39.647872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.648553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.649130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:39.650019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:39.650637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:39.651219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.001729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:40.016720 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1be485b1-de5b-4762-b3e3-b6596bac5f4f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.379867 Oct 04 17:57:40.017842 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 989/1869] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:39 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:40.287017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:40.288212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] [instance: a545ac96-c0e9-41e2-8607-7eeabe520182] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:40.296402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.297066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.297640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.298503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.299163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.299586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.316297 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] HTTP exception thrown: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Request method failure captured: Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 HTTP/1.1 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHPZXey3VVpWDbNOmzftjCCR9rqX-E5cJu-79JN5TzSCohNUsYk-cubYy41VFReEASFT3mtbSobHxp8c4vY56fU512SggUtsQBEUVFpWULfpmIMt0hX4pAYNHBu4GhxBh94FrAUlQ88bkLMoqoYzYhxyTRFCthN52hlnqiQfr4jgRxg Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_11115d232e364cff9ca6675cd6b2b2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 11115d232e364cff9ca6675cd6b2b2fd Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-559119295 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6e7ea7d1c20e44dba9f187869ddf3079 Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListServersNegativeTestJSON-559119295-project Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a545ac96-c0e9-41e2-8607-7eeabe520182'} Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:40.320025 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. Oct 04 17:57:40.323869 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:57:40.325330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] Returning 404 to user: Instance a545ac96-c0e9-41e2-8607-7eeabe520182 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:57:40.326852 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f360ce37-de00-4437-a4b3-0b033da62aae tempest-ListServersNegativeTestJSON-559119295 tempest-ListServersNegativeTestJSON-559119295-project] 10.222.0.42 "GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182" status: 404 len: 111 microversion: 2.1 time: 0.046723 Oct 04 17:57:40.327572 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 881/1870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:40 2022] GET /compute/v2.1/servers/a545ac96-c0e9-41e2-8607-7eeabe520182 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 17:57:40.360538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:40.361164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:40.369570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.370029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.370463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.371180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:40.371634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:40.372064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:40.824397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:40.849194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3297aa16-4f5f-40c0-b94a-7fcd52094b83 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.491148 Oct 04 17:57:40.873997 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 990/1871] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:40 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:41.047512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:41.048886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:41.058304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.058942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.059535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.060638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.061920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.062532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.068828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:41.352486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:41.368121 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d3576fd-63a0-45fe-9fff-7f5345ca6d00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.329560 Oct 04 17:57:41.368774 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 882/1872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:41 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:41.889653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:41.892364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:41.914120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.915026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.915887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:41.918497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:41.919236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:41.921351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:42.277405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:42.295429 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7c34026-c001-4f46-b762-45ecdbe23571 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.415300 Oct 04 17:57:42.296710 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 991/1873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:41 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:42.392704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:42.393927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:42.414957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:42.415637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:42.416225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:42.417127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:42.417741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:42.418345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:42.731662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:42.752625 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a95b1efc-eabc-4e71-9de7-7b2d02ca388f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.362327 Oct 04 17:57:42.797912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 883/1874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:42 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:43.323747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:43.324891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:43.344271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.344956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.345779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:43.346871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.347344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.347929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:43.779349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:43.779980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:43.781969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:43.796700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.799078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.800358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:43.802531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:43.804464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:43.806224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:44.097879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:44.100839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:44.115728 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cfc5a580-478e-4aa2-8925-8806c107cdab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.341350 Oct 04 17:57:44.116163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-beeeac38-fb7a-44ff-98b0-2d210c14873d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.796989 Oct 04 17:57:44.118735 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 992/1875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:43 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:44.121747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 884/1876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:43 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:45.147273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:45.148535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:45.149886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:45.150965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:45.155640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:45.171721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.172217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.172653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.173351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.185009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.186833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.187431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.187879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.188605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:45.189165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:45.189690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.192727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:45.472769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:45.475496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:45.491393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b87b578f-424e-450c-8895-8389223c4c43 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.354697 Oct 04 17:57:45.510172 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 993/1877] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:45 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:45.846718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:45.856692 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24ffdb00-5d62-49f1-babb-8745174c27c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.716674 Oct 04 17:57:45.857308 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 885/1878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:45 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:46.521213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:46.522426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:46.534111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:57:46.551266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.553382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.554039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.556022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.556674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.559734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.881635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:46.882287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:46.891114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.891833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.892644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.893548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:46.894175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:46.894942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:46.993608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:47.008871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93ffd0fb-2fe2-47ab-a676-a83167663454 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.492566 Oct 04 17:57:47.009919 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 994/1879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:46 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:48.043368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:48.045426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:48.062725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:48.068632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:48.074099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:48.075941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:48.078351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:48.079131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:48.107383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:48.117746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d88fb98e-55d2-415e-bb72-4d7c5525caf0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 1.241531 Oct 04 17:57:48.123182 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 886/1880] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:46 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:48.415129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:48.427934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f8a1863-9aee-4119-a43b-2865eeb4c1d2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.396302 Oct 04 17:57:48.430489 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 995/1881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:48 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:49.164532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:49.165281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:49.186686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.189701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.190670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.193681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.194407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.201170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.454584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:49.455205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:49.480535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.481448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.482060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.487957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:49.492847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:49.496049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:49.496505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:49.501015 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22206aab-38fa-4eba-9ead-c2f1ab53526e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.358470 Oct 04 17:57:49.501612 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 887/1882] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:49 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:50.005557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:50.016333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc9afd5a-15e9-4c2b-bafc-262e67f5a048 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.565315 Oct 04 17:57:50.018556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 996/1883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:49 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:50.531256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:50.531881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:50.541709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.543501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.543955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.544707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:50.545247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:50.545856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:50.933605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:50.949421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-21a0d112-bf3b-4690-9867-6777b6fe46ad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.421985 Oct 04 17:57:50.952243 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 888/1884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:50 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:51.046069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:51.047535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:51.057250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:51.058122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:51.058819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:51.059801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:51.060811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:51.062919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:51.528648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:51.539952 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-abb1c329-65d6-45f8-9040-29a42e08999d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.500690 Oct 04 17:57:51.555722 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 997/1885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:51 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:51.975242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:51.975927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:51.983609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:51.984416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:51.985124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:51.986009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:51.986758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:51.987371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.267710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:52.292295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03118a90-35e3-4de1-bcf1-90bb96f3cb06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.321063 Oct 04 17:57:52.293926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 889/1886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:51 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:52.573043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:52.575058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:52.594839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.595567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.597638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:52.600283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:52.601100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:52.601898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.174096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:53.192645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0bbb6d8-1df6-4ee0-93a6-2a93145b0f11 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.625471 Oct 04 17:57:53.210574 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 998/1887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:52 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:53.321221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:53.321865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:53.340858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.341365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.341812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.342551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:53.343011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:53.343443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:53.628479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:53.650465 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-714379ab-71d3-431c-a0c2-292972431996 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.333520 Oct 04 17:57:53.652307 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 890/1888] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:53 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:54.217718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:54.218391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:54.229461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:54.230096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:54.230566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:54.231297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:54.232110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:54.232981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:54.684236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:54.684918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:54.700755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:54.701251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:54.701679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:54.715986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:54.716644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:54.729754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:54.964558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:54.975076 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96a4d019-8f3b-46ee-930b-d384aa65e079 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.300368 Oct 04 17:57:54.986467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 891/1889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:54 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:57:55.274947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:55.284502 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3fe87969-5f07-42a2-9f34-92968e2d1065 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 1.071613 Oct 04 17:57:55.285151 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 999/1890] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:54 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:56.004185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:56.005356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:56.015511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.016005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.016438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.017145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.022777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.023264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.174834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0fccf353-6464-4fa5-b4e8-c46c50d0f068 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Action: 'create', calling method: .version_select at 0x7fbdbd019d30>, body: {"pool": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:56.505069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:56.527891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-882ce0ee-b2f4-45e9-ac9a-cd4c06b216ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.527879 Oct 04 17:57:56.543874 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1000/1891] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:55 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:56.559689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:56.560316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:56.585192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.586061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.586657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:56.588629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:56.593238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:56.593926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.121072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:57.133456 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13e57b8c-661b-4e91-a05e-e80389e4d137 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.579705 Oct 04 17:57:57.137022 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1001/1892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:56 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:57.144618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df74761e-98eb-4e85-b208-f52678075b2a", "name": "network-vif-unplugged", "status": "completed", "tag": "68eac1d1-f4b1-4baa-b456-d71061eecc70"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:57.160614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:57.162365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:57.163051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.177924 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] Creating event network-vif-unplugged:68eac1d1-f4b1-4baa-b456-d71061eecc70 for instance df74761e-98eb-4e85-b208-f52678075b2a on n-h2-831194-21 Oct 04 17:57:57.183737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f3e4c64b-cd8b-49a6-a990-e56850cff971 req-95de53df-93a6-481a-a82f-5b03d8acf9a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044787 Oct 04 17:57:57.184860 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1002/1893] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:57.572796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:57.574237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:57.583154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:57.584287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:57.584923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.586665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:57.587295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:57.588124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:57.810277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0fccf353-6464-4fa5-b4e8-c46c50d0f068 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 1.868584 Oct 04 17:57:57.811506 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 892/1894] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:57:55 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:57.914494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-822818873", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5aedda1f-baf0-459d-966b-7a8f7e6088bb"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:57.994773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] validate_networks() for [('5aedda1f-baf0-459d-966b-7a8f7e6088bb', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:57:58.377041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:58.387637 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9092b52a-e6d3-4d60-adaa-4dc2e44f8a56 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 0.822330 Oct 04 17:57:58.391142 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1003/1895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:57 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:58.411414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f28f36dd-1cd1-4cee-be82-10b2d1374fc8 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Action: 'create', calling method: .version_select at 0x7fbdbd19c4c0>, body: {"pool": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:58.711420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:57:58.712211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:57:58.713058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:57:58.713656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:57:58.714955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:57:58.752805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.754117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.756861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:58.758570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.759328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.760077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:58.796765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:57:58.805867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for user 56b04b3d7b1e413292af14ed0e2edb09 and project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:57:58.850347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:57:58.863550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:57:58.925717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b54236fa-806b-48b1-9f53-269ca4060105 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.112825 Oct 04 17:57:58.934696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 893/1896] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:57:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:57:58.939956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:58.941000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:58.950762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.951590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.952263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:58.953184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:58.954054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:58.954838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.403256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:59.420062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3d3eb2e-22f3-44d7-82d3-785174f17818 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.483813 Oct 04 17:57:59.422719 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 894/1897] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:58 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:59.441758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9db7beab-d061-47bc-b285-7520351f9af2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.445555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9db7beab-d061-47bc-b285-7520351f9af2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.559908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9db7beab-d061-47bc-b285-7520351f9af2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:57:59.569610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9db7beab-d061-47bc-b285-7520351f9af2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1217 microversion: 2.1 time: 0.145535 Oct 04 17:57:59.573519 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 895/1898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:57:59.579727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df74761e-98eb-4e85-b208-f52678075b2a", "tag": "68eac1d1-f4b1-4baa-b456-d71061eecc70"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:57:59.611230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.612000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.613342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.647109 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] Creating event network-changed:68eac1d1-f4b1-4baa-b456-d71061eecc70 for instance df74761e-98eb-4e85-b208-f52678075b2a on n-h2-831194-21 Oct 04 17:57:59.663156 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7e8f30e4-a2d6-4b33-a3f5-c0daffcc61f6 req-9763da78-d3e7-445e-800a-f65eb293f4df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087762 Oct 04 17:57:59.666595 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 896/1899] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:57:59.676662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:57:59.680501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:57:59.687346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.687971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.688535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:57:59.689350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:57:59.689951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:57:59.690481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.573282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f28f36dd-1cd1-4cee-be82-10b2d1374fc8 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.179334 Oct 04 17:58:00.580950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1004/1900] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:57:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:00.580950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:00.580950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:00.589769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:00.600663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.601674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.602319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.603446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.604173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.605251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.699769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.721671 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-279765f6-09d4-4548-b0dd-ebc5c369346f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1496 microversion: 2.1 time: 1.052822 Oct 04 17:58:00.727149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 897/1901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:57:59 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1496 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:00.735583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e520c584-02b3-4a95-947b-17fc0fa35b77 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Action: 'create', calling method: .version_select at 0x7fbdbd16c700>, body: {"pool": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:00.879476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:00.896906 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed8c3abf-e4c9-42ac-9a36-d0f6e8aacb7c tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.321194 Oct 04 17:58:00.898092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1005/1902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:00 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:00.903203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:00.911534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:00.920737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.921317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.921864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:00.922702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:00.923419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:00.924085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.061085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:01.075211 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f5a5153f-2b4a-48aa-a43a-655f480f2d45 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1269 microversion: 2.1 time: 0.175513 Oct 04 17:58:01.075962 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1006/1903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:00 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1269 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:01.752089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:01.753989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:01.769228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.771823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.772635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:01.775669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:01.776677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:01.777276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.022464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.032257 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa3a3d52-5404-4548-9c9d-aba4a45cffa2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 200 len: 1473 microversion: 2.1 time: 0.284569 Oct 04 17:58:02.038052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1007/1904] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:01 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 1473 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:02.043963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.048905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.062141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.062693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.063126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.063883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.064384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.066508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.322490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:02.331868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dbf0de06-a2ef-4c57-99ad-13818b2dc197 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.292152 Oct 04 17:58:02.333302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1008/1905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:02.339508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1611013919"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:02.342506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.349247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.350073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.350940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.351888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.352666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.353316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.644792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09bf1cbe-dcb0-4a7c-b60a-dbb476e5d63a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207/action" status: 202 len: 0 microversion: 2.1 time: 0.307834 Oct 04 17:58:02.651987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1009/1906] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:02 2022] POST /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:58:02.659527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:02.660470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:02.672182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.672963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.673492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:02.674456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:02.674968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:02.675587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.057296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.067276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:03.070703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-525509b6-3746-413f-99a7-0d1e84f3b2b1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1275 microversion: 2.1 time: 0.416964 Oct 04 17:58:03.105241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1010/1907] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:02 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1275 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.113638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.130035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.134902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Searching by: {'deleted': False, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:58:03.147990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.148483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.148925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.149660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.150149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.150575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.195588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:58:03.228328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-40293754-96e4-45c5-9ae8-89b45b491146 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.121585 Oct 04 17:58:03.229354 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1011/1908] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers => generated 333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:03.234841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f5404eb-4200-41ab-81a0-b2e452c0416f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd155160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.292255 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f5404eb-4200-41ab-81a0-b2e452c0416f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.061235 Oct 04 17:58:03.299790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1012/1909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.311977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.320060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.321425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Searching by: {'deleted': False, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:58:03.327796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.328482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.329609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.330520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.331115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.331699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.371069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:58:03.425246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.432163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.432746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.433260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.586206 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64a48bae-0faf-437b-a7e8-84cf7bdaebb7 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.284147 Oct 04 17:58:03.587192 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1013/1910] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.621314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.622413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:03.632171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.632855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.633618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.634919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.635244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.635858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.896006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:03.905749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d40b52ad-0c63-4e50-8821-36392e7b5687 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.300354 Oct 04 17:58:03.906353 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1014/1911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:03.930199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b62811c2-653d-435e-a73d-6c34584c0c85 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.939548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b62811c2-653d-435e-a73d-6c34584c0c85 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014624 Oct 04 17:58:03.951833 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1015/1912] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:03.962816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:03.966050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:03.979814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.980553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.981148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:03.983970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:03.984628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:03.988107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.499910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.515099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.518119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.521703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef535a18-4a13-4285-896c-08a0013502a5 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2943 microversion: 2.32 time: 0.567958 Oct 04 17:58:04.523440 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1016/1913] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:03 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2943 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:04.534552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.535198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:04.553022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.554665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.554665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.554928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:04.555365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:04.555803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:04.970760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:04.985183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f088ae66-4b65-444e-b5aa-2016dbca5884 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.458126 Oct 04 17:58:04.986596 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1017/1914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:04 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:04.993524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:04.998589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.019766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.020344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.021752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.022895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.023666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.024487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.062826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:05.258186 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8690c42f-eaeb-46fc-b953-c0ef7933b7bf tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "DELETE /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 204 len: 0 microversion: 2.1 time: 0.269142 Oct 04 17:58:05.259652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1018/1915] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:04 2022] DELETE /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:05.269116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ec72f2f-8603-4216-953b-c6843b368ab0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd21e160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.344022 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ec72f2f-8603-4216-953b-c6843b368ab0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.080369 Oct 04 17:58:05.349965 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1019/1916] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:05.363734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.365284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.376224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.376923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.377513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.378328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.379155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.379811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.588798 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ddfae70-2194-4703-a114-611f5208bcbd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.237281 Oct 04 17:58:05.600482 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1020/1917] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df/os-interface => generated 1828 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:05.600482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.600482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.615606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.616400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.617874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.618789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.619443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.620044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.782190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:05.792647 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e1c1c21-6d29-4c43-b20b-1c3803891110 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.200496 Oct 04 17:58:05.793520 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1021/1918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:05.798483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:05.799226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:05.806725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.812353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.813001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:05.813858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:05.814365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:05.814798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.007927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:06.017559 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59f5db5d-e3f7-4814-a448-e1168530d73d tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1700 microversion: 2.1 time: 0.223049 Oct 04 17:58:06.030719 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1022/1919] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:05 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1700 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.043191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:06.044675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:06.052791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.053533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.054203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.055097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:06.055712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:06.056304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:06.223383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:06.235981 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d320af9-bfb1-4a08-aa81-b940356342b0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.203592 Oct 04 17:58:06.236608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1023/1920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:06 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.367588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80375d2f-59a9-477a-bb16-19b58d3c8d67 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd172940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:06.441761 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80375d2f-59a9-477a-bb16-19b58d3c8d67 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.083424 Oct 04 17:58:06.444541 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1024/1921] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:06 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:06.467185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e520c584-02b3-4a95-947b-17fc0fa35b77 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.738625 Oct 04 17:58:06.470833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 898/1922] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:58:00 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:06.483948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-802c1246-2038-427e-91d4-c41797b11050 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Action: 'create', calling method: .version_select at 0x7fbdbd067dc0>, body: {"pool": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:06.610153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2060887904", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:06.667885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:06.722407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] validate_networks() for [('8d4d7469-bf06-4f8d-a47b-5c8b431d003c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:08.333289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:08.334902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:08.336018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:08.336646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:08.337433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:08.353735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.354751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.355480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.357037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.357920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.358568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.440539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Getting quotas for project 08f966e4040e488b9d4e8588d8bed8fe. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:08.465415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Getting quotas for user 620198e4009447a1a858a19117e644f1 and project 08f966e4040e488b9d4e8588d8bed8fe. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:08.510157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:08.514051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:08.615095 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-20d5c621-b0fd-4f3a-8d13-efc46d447755 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.079404 Oct 04 17:58:08.618931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 899/1923] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:58:08.650893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:08.652285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:08.673043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.673612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.674454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:08.678428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:08.679115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:08.679601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.306523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:09.315099 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f218a0c4-3fb9-449c-b965-d9bd1ef06696 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.694690 Oct 04 17:58:09.315699 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 900/1924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:08 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:09.330895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:09.346069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:09.366851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.367839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.368463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.369347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.373092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.373762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.898224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:09.910659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2915be88-5a42-41e7-a058-e2c4c5d2cfec tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1632 microversion: 2.1 time: 0.584198 Oct 04 17:58:09.911686 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 901/1925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1632 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:09.918701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae59853-8da0-4004-a56e-d44726a17207", "name": "network-vif-plugged", "status": "completed", "tag": "aa961dc3-afee-40c5-88a7-00bb35b6700c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:09.944067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:09.944806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:09.945419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:09.977018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] Creating event network-vif-plugged:aa961dc3-afee-40c5-88a7-00bb35b6700c for instance bae59853-8da0-4004-a56e-d44726a17207 on n-h1-831194-21 Oct 04 17:58:09.989696 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5f5c35e0-0b0e-415e-8f73-106a693693b8 req-3c5e2ed9-5cb0-494a-a955-0e84675311e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075976 Oct 04 17:58:09.992394 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 902/1926] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:10.001028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:10.003121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:10.012013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.013023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.013643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.014626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.015238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.015813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.236547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:10.248356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04ca8af5-1eca-42aa-8538-e7a8543fe06f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.254200 Oct 04 17:58:10.251998 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 903/1927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:09 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:10.258017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fca2d664-fabb-414c-99d2-6175627252c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd002820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:10.340770 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fca2d664-fabb-414c-99d2-6175627252c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.087451 Oct 04 17:58:10.341928 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 904/1928] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:10 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:10.346656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ebaee67-62ca-4988-8f1d-26fb853c7a6b", "tag": "b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:10.363792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.364740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.378479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.391588 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] Creating event network-changed:b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5 for instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b on n-h2-831194-21 Oct 04 17:58:10.397027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c97865b4-7231-4078-836c-fb91973995ea req-c37b59c3-9611-4f88-8e11-1d52492db39d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053728 Oct 04 17:58:10.398453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 905/1929] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:10.406051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:10.407076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:10.419913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.420791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.422459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.423409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.424072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.424794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.429823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:10.582352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:10.598100 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58a9f8ce-c97f-4ea8-8da2-c185a5054ae9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1276 microversion: 2.1 time: 0.198142 Oct 04 17:58:10.601447 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 906/1930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:10 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1276 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:10.622864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:10.623683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:10.631336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.631981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.632583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.633424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:10.634050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:10.634609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:10.998413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.015080 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb1622f2-3b6f-463a-96e2-5da55668d8e3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1392 microversion: 2.1 time: 0.396147 Oct 04 17:58:11.016065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 907/1931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:10 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1392 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.022094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.029197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.045795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.046621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.047222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.048160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.053080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.053815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.404225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-802c1246-2038-427e-91d4-c41797b11050 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.924766 Oct 04 17:58:11.415243 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1025/1932] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 17:58:06 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:11.420549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.421186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.430088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.430702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.431223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.432068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.432856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.433480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.442006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b3aaa5c74d408b828248e5f4f8b3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96c00a0a4bf244878cabf24f3b1bdd82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.461795 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-103b8243-0e38-4287-a62d-cec65a550534 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 200 len: 1632 microversion: 2.1 time: 0.444439 Oct 04 17:58:11.466158 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 908/1933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 1632 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.472415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00a53d6f-50be-4f98-8538-f9fc28345505", "name": "network-vif-deleted", "tag": "d4e0fbcd-a0cc-4db5-af79-69322c31f4d1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:11.517078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.518903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.521265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.561440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] Creating event network-vif-deleted:d4e0fbcd-a0cc-4db5-af79-69322c31f4d1 for instance 00a53d6f-50be-4f98-8538-f9fc28345505 on n-h2-831194-21 Oct 04 17:58:11.576434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3d00b580-b463-4c11-81c3-1ab59c1085b6 req-f2ccc97e-3d60-4bee-96f1-4a5601c52607 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108598 Oct 04 17:58:11.577436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 909/1934] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:11.587957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c182187a-2d65-4d4e-8a87-ab3e5088fb71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd01cca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.741773 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c182187a-2d65-4d4e-8a87-ab3e5088fb71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.162609 Oct 04 17:58:11.743175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 910/1935] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.758567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e44945b-4af5-4eb4-a1ea-7b67cec80eb9 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd073280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.862523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:11.871788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db1a87fc-e321-444f-8223-09f4e6f59b15 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.455249 Oct 04 17:58:11.876711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1026/1936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:11.893954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:11.894821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:11.918590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.919120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.919558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:11.920320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:11.920780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:11.921236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.066986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:12.077005 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ca5db37-f019-4a4d-aa86-d874d5dafda9 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1282 microversion: 2.1 time: 0.198837 Oct 04 17:58:12.077590 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1027/1937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:12.090756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.091568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:12.099194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.099970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.100563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.101473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.102115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.102729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.495090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:12.513514 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1125c803-9498-4cce-99ef-132c507e8567 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1382 microversion: 2.1 time: 0.431254 Oct 04 17:58:12.515513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1028/1938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1382 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:12.527141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.528043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] [instance: 00a53d6f-50be-4f98-8538-f9fc28345505] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:12.551270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.554305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.554971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.556734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.559392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.560039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.601718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] HTTP exception thrown: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Request method failure captured: Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 HTTP/1.1 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHPMbJvv5Id_GXvC5DX1ORB9v6BLMJGauEMxqBbBJkLh4-ee-fsxrXZOqgRewNREwgbbnAtPEGqprZ1_dSEvnFMpzx_9_EJFfileF9gue_ZmgbItzhZivHhRAFazbezMgChns4KJjDlGOJd8DbqVWXJeu4uxUxPVh6L9SdSpYn4W7uc Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 96c00a0a4bf244878cabf24f3b1bdd82 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2142839389 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/96c00a0a4bf244878cabf24f3b1bdd82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96c00a0a4bf244878cabf24f3b1bdd82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/96c00a0a4bf244878cabf24f3b1bdd82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_96c00a0a4bf244878cabf24f3b1bdd82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2142839389 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 96c00a0a4bf244878cabf24f3b1bdd82 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2142839389 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2142839389-project Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 13b3aaa5c74d408b828248e5f4f8b3e8 Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2142839389-project Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '00a53d6f-50be-4f98-8538-f9fc28345505'} Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:12.605305 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Returning 404 to user: Instance 00a53d6f-50be-4f98-8538-f9fc28345505 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:12.611363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0afb10af-0154-42e7-9321-45670167d19a tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505" status: 404 len: 111 microversion: 2.1 time: 0.090266 Oct 04 17:58:12.612750 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e44945b-4af5-4eb4-a1ea-7b67cec80eb9 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips/532e51cd-87ab-4e46-9fb9-e65210effb7d" status: 200 len: 142 microversion: 2.1 time: 0.865874 Oct 04 17:58:12.613337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 911/1939] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 17:58:11 2022] GET /compute/v2.1/os-floating-ips/532e51cd-87ab-4e46-9fb9-e65210effb7d => generated 142 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:12.627128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6280058-8f3c-4051-a42f-76cc339a81cf tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '.version_select at 0x7fbdbd073550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.631650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6280058-8f3c-4051-a42f-76cc339a81cf tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.631993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6280058-8f3c-4051-a42f-76cc339a81cf tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.634040 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1029/1940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/servers/00a53d6f-50be-4f98-8538-f9fc28345505 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:12.644149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6280058-8f3c-4051-a42f-76cc339a81cf tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.650331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3e8b0e1-168c-4d2c-a7f4-a527c2403c3a tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd21e1f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.679971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6280058-8f3c-4051-a42f-76cc339a81cf tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.056720 Oct 04 17:58:12.682758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 912/1941] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:12.689093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3cdf7501-533f-4d96-af96-28b425530367 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] Calling method '.version_select at 0x7fbdbd073820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.746667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3cdf7501-533f-4d96-af96-28b425530367 tempest-ServersTestJSON-2142839389 tempest-ServersTestJSON-2142839389-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-53372890" status: 202 len: 0 microversion: 2.1 time: 0.062618 Oct 04 17:58:12.747371 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 913/1942] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 17:58:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-53372890 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:12.761652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:12.762843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:12.779016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.783122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.783717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:12.784575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:12.790239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:12.790886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.253104 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0c14019-ee7f-48dd-9c52-25c051d1f1cb tempest-LiveMigrationTest-1331946138 tempest-LiveMigrationTest-1331946138-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1535 microversion: 2.1 time: 0.503407 Oct 04 17:58:13.264207 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 914/1943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:12 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1535 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.294478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b955f97-7937-4f48-ad1a-83e606107fb3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd06b280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:13.340540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:13.417124 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b955f97-7937-4f48-ad1a-83e606107fb3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.145440 Oct 04 17:58:13.428976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:13.432047 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 915/1944] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:13 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.449372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:13.451184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:13.467940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.472083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.475847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.476655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.486849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.487427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.854096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:13.874598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d18c9706-2142-4dcb-8384-29f2673afcb0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.438124 Oct 04 17:58:13.907888 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 916/1945] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:13 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:13.924225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:13.927522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:13.943993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.944414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.944853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:13.948772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:13.952585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:13.953670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.398335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:14.411746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70c28850-479c-4e75-a184-c42fb80deaa4 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.500243 Oct 04 17:58:14.414288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 917/1946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:13 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:14.433161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:14.433693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:14.458702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.459256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.461214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.468016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.469269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.470463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.540359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:14.789080 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60e129b8-8a34-4d17-b2f2-eb837bfdfe69 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 204 len: 0 microversion: 2.1 time: 0.369174 Oct 04 17:58:14.790638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 918/1947] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:14 2022] DELETE /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:14.803312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86350bd8-d10a-43f2-8336-058ba415a6f0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd020ca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:14.880541 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86350bd8-d10a-43f2-8336-058ba415a6f0 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.086929 Oct 04 17:58:14.885334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 919/1948] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:14 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:14.905662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:14.907316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:14.934445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.935807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.937613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:14.939001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:14.940640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:14.942529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.388063 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e3e8b0e1-168c-4d2c-a7f4-a527c2403c3a tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/532e51cd-87ab-4e46-9fb9-e65210effb7d" status: 202 len: 0 microversion: 2.1 time: 2.752863 Oct 04 17:58:15.393090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:15.393369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1030/1949] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:58:12 2022] DELETE /compute/v2.1/os-floating-ips/532e51cd-87ab-4e46-9fb9-e65210effb7d => generated 0 bytes in 2759 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:15.398881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:15.399497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:15.406937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.407685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.408408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.408697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f30e6fd-a1d8-4c69-b55f-b09202d2f8fc tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1388 microversion: 2.1 time: 0.519886 Oct 04 17:58:15.409457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.409859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 920/1950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:14 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1388 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:15.410594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.411424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.427996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebaee67-62ca-4988-8f1d-26fb853c7a6b", "name": "network-vif-plugged", "status": "completed", "tag": "b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:15.460014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.460543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.460994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.484452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] Creating event network-vif-plugged:b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5 for instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b on n-h2-831194-21 Oct 04 17:58:15.500056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1ed071cf-d815-4f1e-b44c-56fd496564ed req-b9d9b80f-a93c-416f-9649-162e50b353fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082730 Oct 04 17:58:15.501086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 921/1951] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:15.507653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41af4cc1-cbfa-4e76-803f-e6ba85f79d06 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd06b9d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:15.898647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:15.906186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:15.916145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-41af4cc1-cbfa-4e76-803f-e6ba85f79d06 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.413512 Oct 04 17:58:15.917800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 922/1952] 10.222.0.42 () {58 vars in 1164 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 17:58:15.924721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:15.925776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:15.950681 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5ee5932-313d-404f-9063-d6218f921f0a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.554430 Oct 04 17:58:15.953867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1031/1953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:15.955398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.956128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.960431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.962202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:15.964258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:15.965053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:15.968909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6b5c6e3-879e-4e55-8802-8cebd9386c47 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd20fdc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:16.086821 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6b5c6e3-879e-4e55-8802-8cebd9386c47 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.131366 Oct 04 17:58:16.087677 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1032/1954] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:16.096702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b44e8d48-6df1-45cf-b168-1f0634e230a5 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd29cf70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:16.709384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:16.718708 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40c48eef-c5c9-4409-8628-24559b39c581 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.799291 Oct 04 17:58:16.719841 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 923/1955] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:15 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:16.728746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "127b3a44-61fb-4f55-b510-72bbe26df366", "tag": "a7d6ee21-e8eb-44c8-a854-5247406bc496"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:16.741856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:16.743199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:16.743641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.756651 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] Creating event network-changed:a7d6ee21-e8eb-44c8-a854-5247406bc496 for instance 127b3a44-61fb-4f55-b510-72bbe26df366 on n-h1-831194-21 Oct 04 17:58:16.761789 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7cf9197c-a770-48d5-b07c-7a983dd9df0f req-e6246e9c-978f-474e-a50d-25ef547e3211 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040739 Oct 04 17:58:16.762756 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 924/1956] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:16.769022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:16.769732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:16.778515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:16.778729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:16.779134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.779853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:16.780308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:16.780731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:16.971607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:16.999637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4adc315-8088-4b8e-8482-1423b6016360 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1388 microversion: 2.1 time: 0.235404 Oct 04 17:58:17.002507 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 925/1957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:16 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1388 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:17.011200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:17.013508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:17.030737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:17.037089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:17.038001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:17.039216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:17.039879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:17.040521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:17.057774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b44e8d48-6df1-45cf-b168-1f0634e230a5 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.965051 Oct 04 17:58:17.059512 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1033/1958] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 17:58:16 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:17.086311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31155a12-34cd-4aff-8515-b269943084e0 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd29c790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:17.314229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:17.322953 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f50ee21-a8fc-4d00-a6eb-bdfc690cd237 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1317 microversion: 2.1 time: 0.318575 Oct 04 17:58:17.334300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 926/1959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:17 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1317 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:17.343070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c9a1c0b1-18f0-434c-9926-edbf3b7ce0e8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd076430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:17.415459 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c9a1c0b1-18f0-434c-9926-edbf3b7ce0e8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.078131 Oct 04 17:58:17.420276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 927/1960] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:17 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:17.426084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df74761e-98eb-4e85-b208-f52678075b2a", "name": "network-vif-deleted", "tag": "68eac1d1-f4b1-4baa-b456-d71061eecc70"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:17.438585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:17.438752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:17.439327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:17.454991 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] Creating event network-vif-deleted:68eac1d1-f4b1-4baa-b456-d71061eecc70 for instance df74761e-98eb-4e85-b208-f52678075b2a on n-h1-831194-21 Oct 04 17:58:17.460724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f0d3d932-eb54-4982-b02c-3f8d41a5b4e1 req-1fa14ea7-a150-4f00-a93c-3c4c734c565b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039000 Oct 04 17:58:17.461920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 928/1961] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:17.746518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:17.747298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:17.761060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:17.761581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:17.762048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:17.762885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:17.763218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:17.763647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:17.951151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:17.961564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cf11d0b-cd69-427a-bad7-75bce2148eef tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.219753 Oct 04 17:58:17.963107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 929/1962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:17 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:18.027954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:18.029504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:18.039682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.040482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.041149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:18.042286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.042943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.043583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:18.165353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:18.182235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dba5c249-5c14-4245-a3de-0eaa9b83d6ef tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1346 microversion: 2.1 time: 0.157904 Oct 04 17:58:18.202403 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 930/1963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:18 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1346 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:18.351953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:18.352977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:18.384233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:18.402557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.403031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.403672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:18.404408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.405009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.406566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:18.446724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:18.504224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=14 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:18.662447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:18.678241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4feb480f-1f9a-49ca-94a9-a22e2208c8f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1508 microversion: 2.1 time: 0.326835 Oct 04 17:58:18.682170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 931/1964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:18 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1508 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:18.696296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fdbb36bb-ca94-41f5-8c95-a834c2fe3ac2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd06b4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:18.801465 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fdbb36bb-ca94-41f5-8c95-a834c2fe3ac2 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.118154 Oct 04 17:58:18.802849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 932/1965] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:18 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:18.815679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:18.818976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:18.831872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.835785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.836750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:18.839438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:18.840571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:18.844477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.172956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:19.181264 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a23f71e1-b978-4931-8c7b-7fae601a00b2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1508 microversion: 2.1 time: 0.374440 Oct 04 17:58:19.183139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 933/1966] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:18 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:19.187860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:19.188812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:19.207643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.209929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.210989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.213026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.214032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.214714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.295417 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31155a12-34cd-4aff-8515-b269943084e0 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/c5231017-9415-4831-a5e3-891c74c5b0d5" status: 202 len: 0 microversion: 2.1 time: 2.222817 Oct 04 17:58:19.296011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1034/1967] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:58:17 2022] DELETE /compute/v2.1/os-floating-ips/c5231017-9415-4831-a5e3-891c74c5b0d5 => generated 0 bytes in 2224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:19.305274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:19.306140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:19.319194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.322822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.323454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.324335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.330985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.331854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.418167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:19.431563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77aa6205-da74-4fe1-a362-bbd8e2ff2165 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.246977 Oct 04 17:58:19.432553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 934/1968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:19 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:19.437707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:19.441099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:19.450431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.451257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.451889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.454576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.456685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.457212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.482837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:19.512183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd9d67bd-c87d-49b9-bc1d-c899b5fa6f88 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1184 microversion: 2.1 time: 0.211269 Oct 04 17:58:19.514537 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1035/1969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:19 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1184 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:19.534644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55ba1594-2d4d-46d9-aec5-f2466aa63a8d tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd29caf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:19.598139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:19.598734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:19.598734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:19.599620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:19.600188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:19.765640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:19.774674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.775306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.775681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.776656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.777129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.777565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.813890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-623303ef-8763-43d9-bcf0-427fa0869003 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "POST /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b/action" status: 202 len: 1110 microversion: 2.1 time: 0.380052 Oct 04 17:58:19.815151 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 935/1970] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:19 2022] POST /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b/action => generated 1110 bytes in 382 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:58:19.821206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-af7d0b42-4810-4c07-9264-b7ac07176d42 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd002c10>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:19.886784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-af7d0b42-4810-4c07-9264-b7ac07176d42 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.070534 Oct 04 17:58:19.888061 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 936/1971] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:19 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:19.894708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:19.895677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:19.905307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.906211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.906872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:19.907938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:19.909080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:19.909735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.321866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:20.336306 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-374acdf8-2705-410d-8abb-aa9ee17e16b3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.446921 Oct 04 17:58:20.344080 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 937/1972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:19 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:20.463419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:20.464197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:20.482440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.483306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.483956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.487570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.488506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.490165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.728548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:20.737087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b20ece8-8cc1-40f1-aad0-3d356dc22d3f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.282084 Oct 04 17:58:20.756081 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 938/1973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:20 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:20.765455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:20.766185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:20.774313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.774810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.775253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.775967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.776491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.776924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.873025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:20.884388 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42785c44-dfc9-4593-a7ac-38d3f6b58884 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1184 microversion: 2.1 time: 0.127094 Oct 04 17:58:20.885338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 939/1974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:20 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1184 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:20.896925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:20.897890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:20.904714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.905752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.906239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:20.906957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:20.907428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:20.972861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.195689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:21.251280 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-23db21de-0a52-4a52-a314-8d3cd565f706 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 2348 microversion: 2.25 time: 0.364705 Oct 04 17:58:21.252038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 940/1975] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:20 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 2348 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:21.258396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28465e71-e867-4c09-8c9a-38ed964aea04 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd0e7d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:21.341201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28465e71-e867-4c09-8c9a-38ed964aea04 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.087691 Oct 04 17:58:21.342935 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 941/1976] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:21 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:21.356506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:21.365818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.366399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.366876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.371786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.373696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.374190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.444653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1580b4c8-47fe-4678-9f02-0e87ee93e742 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.099145 Oct 04 17:58:21.445634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 942/1977] 10.222.0.42 () {60 vars in 1217 bytes} [Tue Oct 4 17:58:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:58:21.467245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:21.467875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:21.484934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.495714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.496432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.497879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.498766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.499534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.791371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:21.799715 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2360a6e2-b1ca-4180-8d52-337448eac4ca tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.353032 Oct 04 17:58:21.802530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 943/1978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:21 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:21.807755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:21.808766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:21.815661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.816470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.817204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:21.819107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:21.819799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:21.820444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:22.787890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:22.808567 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b2a4552-4a35-4557-b6db-cc6d5252fd9a tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 1.002429 Oct 04 17:58:22.810745 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 944/1979] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:21 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:22.842284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:22.842990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:22.874789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:22.876903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:22.879329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:22.882114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:22.883458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:22.885265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:23.027318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:23.040580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6131280-ee88-4df6-84f4-b736c15b3cc0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1184 microversion: 2.1 time: 0.227715 Oct 04 17:58:23.042687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 945/1980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:22 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1184 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:23.054451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127b3a44-61fb-4f55-b510-72bbe26df366", "name": "network-vif-plugged", "status": "completed", "tag": "a7d6ee21-e8eb-44c8-a854-5247406bc496"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:23.072960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:23.077151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:23.078352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:23.079292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:23.107897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55ba1594-2d4d-46d9-aec5-f2466aa63a8d tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/f404519d-ce90-4ced-9596-66379d11f6a1" status: 202 len: 0 microversion: 2.1 time: 3.590298 Oct 04 17:58:23.112394 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1036/1981] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:58:19 2022] DELETE /compute/v2.1/os-floating-ips/f404519d-ce90-4ced-9596-66379d11f6a1 => generated 0 bytes in 3594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:23.113807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b93ce72d-53b7-4e99-a55d-879d1871aa17 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd20f9d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:23.138353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] Creating event network-vif-plugged:a7d6ee21-e8eb-44c8-a854-5247406bc496 for instance 127b3a44-61fb-4f55-b510-72bbe26df366 on n-h1-831194-21 Oct 04 17:58:23.143247 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ecc0a4bc-6b13-4c8b-8e5a-5186f0be5438 req-10f9595f-f520-4522-b8fd-3ab4cb14408d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099218 Oct 04 17:58:23.146960 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 946/1982] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:23.153424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:23.154209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:23.169907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:23.170443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:23.170934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:23.171659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:23.172116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:23.172543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:23.204200 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b93ce72d-53b7-4e99-a55d-879d1871aa17 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.094336 Oct 04 17:58:23.209947 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1037/1983] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:23 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:23.217756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3af786ce-f52a-4773-a426-5ef293214432 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] Calling method '.version_select at 0x7fbdbd155e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:23.701477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:23.718716 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-617b582c-3696-4ad9-8ecc-2ecf62baa5a0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.570324 Oct 04 17:58:23.721009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 947/1984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:23 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:23.836365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:23.838429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:23.856034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:23.859654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:23.861737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:23.862827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:23.869120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:23.870017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:24.115292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:24.124341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a2e6876-38e1-4d2f-b065-6eef8eef3a5e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1324 microversion: 2.1 time: 0.293846 Oct 04 17:58:24.142067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 948/1985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:23 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1324 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:24.148147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:24.148775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:24.156214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:24.156715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:24.157258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:24.158083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:24.158544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:24.158968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:24.244593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:24.256732 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47fc63a6-1d59-41ec-ac7a-9a323afd7d1e tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1184 microversion: 2.1 time: 0.112946 Oct 04 17:58:24.258400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 949/1986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:24 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:24.263341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5d76824-a287-4503-908a-1cf69221a3f7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd011310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:24.356327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5d76824-a287-4503-908a-1cf69221a3f7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.096602 Oct 04 17:58:24.359549 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 950/1987] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:24 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:24.606180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "246cf38a-e996-4fa8-9efe-3426a9d09f49", "device": "/dev/xvdb"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:24.609694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:24.625754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:24.626681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:24.627357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:24.628300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:24.628985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:24.630800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:24.634637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:25.324959 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-09f47d66-79aa-4312-ba92-3c115dd0f6fa tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.723666 Oct 04 17:58:25.349038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 951/1988] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Oct 4 17:58:24 2022] POST /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:58:25.361911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:25.364999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:25.389610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:25.390490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:25.392703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:25.396606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:25.397351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:25.402594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:25.772783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3af786ce-f52a-4773-a426-5ef293214432 tempest-FloatingIPDetailsTestJSON-1026251649 tempest-FloatingIPDetailsTestJSON-1026251649-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/3e84e1b0-7c3b-4bea-8c1a-170871a5e229" status: 202 len: 0 microversion: 2.1 time: 2.561352 Oct 04 17:58:25.774104 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1038/1989] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:58:23 2022] DELETE /compute/v2.1/os-floating-ips/3e84e1b0-7c3b-4bea-8c1a-170871a5e229 => generated 0 bytes in 2563 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:25.782131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:25.784488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:25.811543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:25.812531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:25.813149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:25.814103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:25.814572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:25.814994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:26.002638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:26.016158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b03b0c7e-4ce2-4181-802b-cb7b6fc52666 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.665072 Oct 04 17:58:26.043319 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 952/1990] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:25 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:26.054770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:26.056072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:26.092912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:26.099992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:26.100815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:26.103440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:26.108178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:26.108751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:26.324429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:26.353449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d77638e-2a1c-4c78-b298-2b18b0f73aaf tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1520 microversion: 2.1 time: 0.577560 Oct 04 17:58:26.358864 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1039/1991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:25 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1520 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:26.363687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f17d0cc2-5d37-4def-bbb1-ea7c2f4a7077 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd3e8040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:26.432447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:26.449654 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e492f420-ede4-44df-87ba-caadba87ad3d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1184 microversion: 2.1 time: 0.404703 Oct 04 17:58:26.452444 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 953/1992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:26 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1184 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:26.493401 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f17d0cc2-5d37-4def-bbb1-ea7c2f4a7077 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.133321 Oct 04 17:58:26.496003 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1040/1993] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:26 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:26.613544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-def1421a-fa03-468c-b26c-124e2a5025cd tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-627021345", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-def1421a-fa03-468c-b26c-124e2a5025cd tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 242 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-627021345", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-627021345', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '8d4d7469-bf06-4f8d-a47b-5c8b431d003c'}]}}} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:26.627996 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.632076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.640093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-def1421a-fa03-468c-b26c-124e2a5025cd tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:26.641720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-def1421a-fa03-468c-b26c-124e2a5025cd tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.037389 Oct 04 17:58:26.647005 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 954/1994] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:26 2022] POST /compute/v2.1/servers => generated 175 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:58:26.659665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:26.660752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 518f664b-bcc4-4cba-8208-6453bcc241a1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:26.669111 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] HTTP exception thrown: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/518f664b-bcc4-4cba-8208-6453bcc241a1/metadata HTTP/1.1 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '518f664b-bcc4-4cba-8208-6453bcc241a1'} Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.704606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.708897 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:26.708897 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:26.708897 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. Oct 04 17:58:26.708897 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.714208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 404 to user: Instance 518f664b-bcc4-4cba-8208-6453bcc241a1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:26.719915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ae294dc-241f-4319-aa7e-02e0e27b89ff tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/518f664b-bcc4-4cba-8208-6453bcc241a1/metadata" status: 404 len: 111 microversion: 2.1 time: 0.064721 Oct 04 17:58:26.728026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1041/1995] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 17:58:26 2022] GET /compute/v2.1/servers/518f664b-bcc4-4cba-8208-6453bcc241a1/metadata => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:26.808685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8283a945-ec96-43e9-8ab5-a0103ee7d7eb tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1078960224", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8283a945-ec96-43e9-8ab5-a0103ee7d7eb tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 499 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1078960224", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1078960224', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8d4d7469-bf06-4f8d-a47b-5c8b431d003c'}]}}} Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:58:26.813044 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8283a945-ec96-43e9-8ab5-a0103ee7d7eb tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:26.815581 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8283a945-ec96-43e9-8ab5-a0103ee7d7eb tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009874 Oct 04 17:58:26.827298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 955/1996] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:26 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:58:26.928741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87452a8a-f3b9-459a-8e54-72df24bb78ec tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1185734733", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87452a8a-f3b9-459a-8e54-72df24bb78ec tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 500 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1185734733", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1185734733', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8d4d7469-bf06-4f8d-a47b-5c8b431d003c'}]}}} Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:58:26.947170 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:26.949590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87452a8a-f3b9-459a-8e54-72df24bb78ec tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:26.951590 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87452a8a-f3b9-459a-8e54-72df24bb78ec tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.025828 Oct 04 17:58:26.954252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1042/1997] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:26 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:58:27.036805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b5114c3-10c9-4b6d-ae5d-7f3869325ece tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1033756430", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b5114c3-10c9-4b6d-ae5d-7f3869325ece tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 754 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1033756430", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1033756430', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8d4d7469-bf06-4f8d-a47b-5c8b431d003c'}]}}} Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:58:27.047532 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:58:27.049565 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:58:27.052017 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.052017 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.052279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.052279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:27.054520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b5114c3-10c9-4b6d-ae5d-7f3869325ece tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:27.056845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b5114c3-10c9-4b6d-ae5d-7f3869325ece tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.028312 Oct 04 17:58:27.060617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 956/1998] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:27 2022] POST /compute/v2.1/servers => generated 1197 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 17:58:27.066105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.069573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.072441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.073373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.075367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.078167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.168629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ef3762c-c025-4ace-95fb-7920f200fb6f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-694910044", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ef3762c-c025-4ace-95fb-7920f200fb6f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 1265 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-694910044", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "8d4d7469-bf06-4f8d-a47b-5c8b431d003c"}]}} Oct 04 17:58:27.173147 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-694910044', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '8d4d7469-bf06-4f8d-a47b-5c8b431d003c'}]}}} Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.175105 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:58:27.176134 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:58:27.177965 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:58:27.177965 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.177965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ef3762c-c025-4ace-95fb-7920f200fb6f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:27.180010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ef3762c-c025-4ace-95fb-7920f200fb6f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.016412 Oct 04 17:58:27.187475 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 957/1999] 10.222.0.42 () {60 vars in 1148 bytes} [Tue Oct 4 17:58:27 2022] POST /compute/v2.1/servers => generated 2221 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 04 17:58:27.202305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.202834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 2336f231-b0de-4000-bf00-fcdb8cc93616] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:27.235680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] HTTP exception thrown: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2336f231-b0de-4000-bf00-fcdb8cc93616/metadata/test2 HTTP/1.1 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '2336f231-b0de-4000-bf00-fcdb8cc93616', 'id': 'test2'} Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:27.242329 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:27.246669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:27.246669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:27.246669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. Oct 04 17:58:27.246669 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:27.246669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 404 to user: Instance 2336f231-b0de-4000-bf00-fcdb8cc93616 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:27.258217 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-763c0aaf-2372-44c4-a707-402ceb38c613 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/2336f231-b0de-4000-bf00-fcdb8cc93616/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.056063 Oct 04 17:58:27.258505 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 958/2000] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 17:58:27 2022] GET /compute/v2.1/servers/2336f231-b0de-4000-bf00-fcdb8cc93616/metadata/test2 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:27.277703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.282444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:27.310210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.313943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.316609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.321367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.322072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.322687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.375960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:27.387734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:27.399426 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f53af6fb-ea5a-4d84-9158-a95378791c06 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.355342 Oct 04 17:58:27.400194 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1043/2001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:27 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:27.474017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.475025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:27.494087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.496193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.496911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.500882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.503988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.505010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.562625 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9229feae-7a5f-4b72-9353-e81388a95a9f tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "DELETE /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 204 len: 0 microversion: 2.1 time: 0.287976 Oct 04 17:58:27.566626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 959/2002] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:27 2022] DELETE /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 17:58:27.578741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b57fbb95-d097-4359-9b85-a8c7a9da66c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd020670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.605731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.608430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.608973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.610545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid df74761e-98eb-4e85-b208-f52678075b2a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:27.690351 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b57fbb95-d097-4359-9b85-a8c7a9da66c4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.125229 Oct 04 17:58:27.693314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 960/2003] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:27 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:27.704923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:27.713682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:27.714702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:27.731528 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01a247a6-d044-4b44-9346-517944b424b0 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1189 microversion: 2.1 time: 0.262757 Oct 04 17:58:27.742882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1044/2004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:27 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1189 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:27.750048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.756314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.757279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:27.758025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:27.758574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:27.759205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.033640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:28.044973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63571bad-a1d4-4c3d-b32b-176bf71180e8 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1526 microversion: 2.1 time: 0.347136 Oct 04 17:58:28.045547 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 961/2005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:27 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1526 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:28.441815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:28.454667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:28.467804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:28.470346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:28.471931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.473054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:28.474897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:28.476873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.707455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83db1ad8-f0d3-46e6-8897-1dff13bcc436 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd020700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:28.823486 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83db1ad8-f0d3-46e6-8897-1dff13bcc436 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.119653 Oct 04 17:58:28.824297 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 962/2006] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:28 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:28.842437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:28.845995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:28.856358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:28.857058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:28.857939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.858805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:28.859866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:28.860513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.946656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:28.947508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:28.948218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:28.948917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid df74761e-98eb-4e85-b208-f52678075b2a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:29.108302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:29.124171 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed082c84-f7ac-4f0e-b315-b555f5d9bb9a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.697432 Oct 04 17:58:29.124779 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1045/2007] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:28 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:29.137644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:29.138512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:29.148432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.149206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.149853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.152618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:29.153241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:29.155944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:29.189593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:29.208783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a61cbc9-b996-45e3-88df-3e2365761c62 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 200 len: 1143 microversion: 2.1 time: 0.377254 Oct 04 17:58:29.211045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 963/2008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:28 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 1143 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:29.787804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:29.803844 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d563098d-3c64-4859-8d76-0e9b78c122fe tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1526 microversion: 2.1 time: 0.671595 Oct 04 17:58:29.809143 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1046/2009] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:29 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1526 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:29.846836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b81a7eb-4748-4ab7-808d-a7fd4aa14a00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbe2e51f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:29.949851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b81a7eb-4748-4ab7-808d-a7fd4aa14a00 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.108536 Oct 04 17:58:29.950436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 964/2010] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:29 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:30.150784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.151440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.170601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.171098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.182488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.183754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.184380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.187476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.247297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.248225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: df74761e-98eb-4e85-b208-f52678075b2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.262604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.263455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.264783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.268103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.268789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.272819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.351371 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] HTTP exception thrown: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Request method failure captured: Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a HTTP/1.1 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHK1Zo76seNf-PruRwnKA62hdcC3sBHOpMdRHd26cm0y75l4yZga2P76oeznx0GjxKUkdSr-1ZKn-n3Stx3TgC0ngdcXU4m-AftP4KTwZOtPkrlnOy05S9eYD-xZdmZgrxzNk-PFhJcP4HuJlXJ_hMmb5YR5E7MUOqLzk-bOg0HCtzY Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ea6b89bd15d0468a920310645029d5d1 Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'df74761e-98eb-4e85-b208-f52678075b2a'} Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:30.353404 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. Oct 04 17:58:30.357408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:30.359106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Returning 404 to user: Instance df74761e-98eb-4e85-b208-f52678075b2a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:30.360472 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16f99e21-75ea-47e2-9aed-13c9705df408 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a" status: 404 len: 111 microversion: 2.1 time: 0.127322 Oct 04 17:58:30.361404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 965/2011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/df74761e-98eb-4e85-b208-f52678075b2a => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:30.831186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:30.831873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:30.849244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.850182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.850631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:30.852254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:30.852720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:30.854372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:31.116792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:31.140598 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c153867c-3851-4438-a9d8-3ca2052563f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.995578 Oct 04 17:58:31.144632 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1047/2012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:31.165760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e4bd12-6b42-49f9-82df-8cca96c6dc69 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd29cca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:31.290478 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65e4bd12-6b42-49f9-82df-8cca96c6dc69 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1414 microversion: 2.1 time: 0.144047 Oct 04 17:58:31.300356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1048/2013] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:31 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1414 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:31.400567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:31.540696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:31.558282 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cd7211f-051d-4a53-94da-76511228598e tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1484 microversion: 2.1 time: 0.733049 Oct 04 17:58:31.562971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "127b3a44-61fb-4f55-b510-72bbe26df366", "name": "network-vif-deleted", "tag": "a7d6ee21-e8eb-44c8-a854-5247406bc496"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:31.563605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 966/2014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:30 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1484 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:31.569211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:31.622276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:31.624576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:31.626522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:31.671424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] Creating event network-vif-deleted:a7d6ee21-e8eb-44c8-a854-5247406bc496 for instance 127b3a44-61fb-4f55-b510-72bbe26df366 on n-h1-831194-21 Oct 04 17:58:31.695650 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-224c3e4d-0e81-4012-a3b2-01242cf9d13e req-376cb687-5e5a-4266-a3eb-ac8ee3bfe67f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137122 Oct 04 17:58:31.698390 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1049/2015] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:32.182121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.184383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:32.228763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.229481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.233993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.241908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.242632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.243518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.309179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4303a317-36bc-4659-a81b-9a5ace58907d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd29c3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.475749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4303a317-36bc-4659-a81b-9a5ace58907d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1423 microversion: 2.1 time: 0.171344 Oct 04 17:58:32.488120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1050/2016] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1423 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:32.495353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ebe20de-c407-4cb3-be84-578829f9da50 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd259700>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.615690 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ebe20de-c407-4cb3-be84-578829f9da50 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 200 len: 1423 microversion: 2.1 time: 0.124436 Oct 04 17:58:32.616379 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1051/2017] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:32.632489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:32.633588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:32.656550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.657065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.670563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.671465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.671965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.672452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.774874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:32.777376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:32.777849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:32.778321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lazy-loading 'fault' on Instance uuid 127b3a44-61fb-4f55-b510-72bbe26df366 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:33.124268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '620198e4009447a1a858a19117e644f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08f966e4040e488b9d4e8588d8bed8fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.153868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e8b576b-56a5-4422-9702-ae6cd0a28327 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 200 len: 1314 microversion: 2.1 time: 0.534698 Oct 04 17:58:33.154689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1052/2018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:33.154795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:33.171907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2b2b083-f8a1-4f65-8c4f-b46d2837cd34 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd2594c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:33.173904 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa50e68b-3f97-4907-86d4-b6790227c88d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.994769 Oct 04 17:58:33.175175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 967/2019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:32 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:34.097424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae59853-8da0-4004-a56e-d44726a17207", "name": "network-vif-unplugged", "status": "completed", "tag": "aa961dc3-afee-40c5-88a7-00bb35b6700c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:34.130366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.133417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.135291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.179691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] Creating event network-vif-unplugged:aa961dc3-afee-40c5-88a7-00bb35b6700c for instance bae59853-8da0-4004-a56e-d44726a17207 on n-h1-831194-21 Oct 04 17:58:34.196554 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-25cb1c86-4cfd-4bcf-ad7c-a121395450f4 req-a74046a8-5202-43ec-a6c0-bdf098141349 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104538 Oct 04 17:58:34.199163 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 968/2020] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:58:34.208217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:34.218959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] [instance: 127b3a44-61fb-4f55-b510-72bbe26df366] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:34.236422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.241470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.242477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.243802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.244798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.245710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.289377 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] HTTP exception thrown: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Request method failure captured: Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 HTTP/1.1 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQuWw5PeYL8Df3UfCvSP-s2EXMh4E7H0WZu7RDB4Xysi5vHezPIjgWvzMzA8a4c3AJkWCADtTmxMeNl4am-W_5Sg995NO-AdxccFSTe3ZY4Vc65V_6rOeyBMD7z6yCIKxsANZylZrW4Eo8UQV-gFE_w0zk1Fpj_FFWWvmM5HhD8pTw Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_08f966e4040e488b9d4e8588d8bed8fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 08f966e4040e488b9d4e8588d8bed8fe Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1472046371 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 620198e4009447a1a858a19117e644f1 Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1472046371-project Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '127b3a44-61fb-4f55-b510-72bbe26df366'} Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:34.293419 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:34.297917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] Returning 404 to user: Instance 127b3a44-61fb-4f55-b510-72bbe26df366 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:34.302603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82e1297a-8a46-492c-8ccc-584e98aec8c7 tempest-ServerMetadataNegativeTestJSON-1472046371 tempest-ServerMetadataNegativeTestJSON-1472046371-project] 10.222.0.42 "GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366" status: 404 len: 111 microversion: 2.1 time: 0.096348 Oct 04 17:58:34.302603 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 969/2021] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:34 2022] GET /compute/v2.1/servers/127b3a44-61fb-4f55-b510-72bbe26df366 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:34.306242 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2b2b083-f8a1-4f65-8c4f-b46d2837cd34 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 204 len: 0 microversion: 2.1 time: 1.146766 Oct 04 17:58:34.306789 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1053/2022] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:33 2022] DELETE /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 0 bytes in 1148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:34.319735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:34.320220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:34.327963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:34.328601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:34.344845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.350316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.352955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.353789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.354338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.354770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.355807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.356304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.359314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.360106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:34.360587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:34.361032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:34.458000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:34.763242 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b5a1794-3cd1-4a67-b6d7-8c129bce0e06 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 204 len: 0 microversion: 2.1 time: 0.451123 Oct 04 17:58:34.780721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1054/2023] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:34 2022] DELETE /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:34.843336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:34.856184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a87ff90b-b2fa-466f-a76f-6f835e0912de tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.555004 Oct 04 17:58:34.861303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 970/2024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:34 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:34.995172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2001001975", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "c33ce19a-c198-46b8-a446-c121fdf53f1c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:35.111532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] validate_networks() for [('c33ce19a-c198-46b8-a446-c121fdf53f1c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:35.892418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:35.893142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:35.912142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.913212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.913906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:35.915719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:35.916403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:35.917045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:36.216276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:36.225113 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cbe08bc7-916b-4ab0-a5e5-1b441c7feab5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.338234 Oct 04 17:58:36.229086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 971/2025] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:35 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:37.037641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:37.039438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:37.039974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:37.040544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:37.040966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:37.082478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.083924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.091194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.092970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.094353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.094946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.146441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:37.158583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for user 2e3ae7cc3d854e0690d8354dbca1e6c6 and project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:37.190147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:37.199085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:37.258794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.259680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:37.276099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.277567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.278907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.280218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:37.281637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:37.282505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:37.325228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f638b9e6-4fa3-4597-ab7a-35907b81f280 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.337699 Oct 04 17:58:37.336094 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1055/2026] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2349 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:37.350282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2e94ad3-2277-46a2-a94a-4f96978a396b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:37.350989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2e94ad3-2277-46a2-a94a-4f96978a396b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:37.569373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:37.583341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa265f38-b228-4b2e-adb3-53be64da36d6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.329966 Oct 04 17:58:37.588919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 972/2027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:37.995566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2e94ad3-2277-46a2-a94a-4f96978a396b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:38.008245 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2e94ad3-2277-46a2-a94a-4f96978a396b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1208 microversion: 2.1 time: 0.667654 Oct 04 17:58:38.011599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1056/2028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:37 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1208 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:38.619767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:38.621218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:38.644339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.644807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.645367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:38.646267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:38.646725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:38.647153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.038695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:39.039613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.061483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.063416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.064020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.068816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.070906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.072860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.115432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:39.130587 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd0724f6-fcbf-4ebc-8f05-3c207279b97c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.513269 Oct 04 17:58:39.133376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 973/2029] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:38 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:39.151712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bae59853-8da0-4004-a56e-d44726a17207", "name": "network-vif-deleted", "tag": "aa961dc3-afee-40c5-88a7-00bb35b6700c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:39.177734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.178348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.178955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.197061 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] Creating event network-vif-deleted:aa961dc3-afee-40c5-88a7-00bb35b6700c for instance bae59853-8da0-4004-a56e-d44726a17207 on n-h1-831194-21 Oct 04 17:58:39.211392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3e551e41-b67f-4988-a230-1b2c33b974d8 req-3940b591-db39-4e0c-9bb6-5c6e86497469 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076087 Oct 04 17:58:39.213181 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 974/2030] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:39.465895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:39.482890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12588030-8c55-473e-bfa7-4e58cd3e3086 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1260 microversion: 2.1 time: 0.449067 Oct 04 17:58:39.483447 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1057/2031] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:39 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1260 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:39.572312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:39.573140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.587805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.590903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.591529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.592473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.593116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.596771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.612208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:39.678396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:39.876739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4a02a302-2234-4feb-913a-b322279a0476 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 204 len: 0 microversion: 2.1 time: 0.308948 Oct 04 17:58:39.880855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 975/2032] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:39 2022] DELETE /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:39.886000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:39.886630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:39.893709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.895019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.895019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:39.905636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:39.905984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:39.906485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.161521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:40.162760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:40.186006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.186535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.187001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.187733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.188369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.188959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.462188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.480845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a8e1bda-3d45-4fda-a739-322ac95a8d1c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.315405 Oct 04 17:58:40.482299 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 976/2033] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:40 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:40.513091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:40.514933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:40.529460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.530307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.530939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.532858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:40.534061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:40.535279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:40.550404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.567745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed42e028-82e1-4c2d-99ae-1c18ed6b3fa3 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1667 microversion: 2.1 time: 0.683084 Oct 04 17:58:40.568614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1058/2034] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:39 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1667 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:40.834821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:40.847081 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7772c08-b5ed-45e3-8cc2-f60627db81eb tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1266 microversion: 2.1 time: 0.338015 Oct 04 17:58:40.851192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 977/2035] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:40 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1266 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:41.509089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:41.509736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:41.523637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.527181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.528541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.530840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.533453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.534156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.601194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:41.601845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:41.613343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.613855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.628221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:41.629091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:41.629723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:41.639658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.117270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.129474 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e331c1c3-57db-4b40-839f-dce47c1353f5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.624830 Oct 04 17:58:42.145895 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1059/2036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:41 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:42.151720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:42.152469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:42.160616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.162123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.162899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.163767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:42.164524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:42.165104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:42.333171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:42.344372 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e58bf00-3a13-493b-b3ce-332b6d4b16c2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1667 microversion: 2.1 time: 0.749025 Oct 04 17:58:42.345045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 978/2037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:41 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1667 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.162769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:43.163930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:43.175346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.176096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.177395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.178344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.179143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.179868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.415963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:43.427776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc74dabf-c0cb-46d4-8dd3-4b78afc25675 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 1.285453 Oct 04 17:58:43.436008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1060/2038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:42 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.441508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:43.449885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:43.470809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.474344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.475397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.476987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.478857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.479673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:43.504659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:43.647718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:43.666523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f483440d-2e87-448b-88d4-23b26fe94b5b tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1600 microversion: 2.1 time: 0.225513 Oct 04 17:58:43.688840 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1061/2039] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:43 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1600 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.840724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:43.852789 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f9c8568a-812c-447b-9acd-275a946f79f2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.699074 Oct 04 17:58:43.858142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 979/2040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:43 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:43.947859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aebe331-591b-4fc2-bb54-3f516d4453dd", "name": "network-vif-deleted", "tag": "60c5b302-6788-45fa-83b1-5a3268821d46"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:43.970770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:43.971548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:43.974367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.002445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] Creating event network-vif-deleted:60c5b302-6788-45fa-83b1-5a3268821d46 for instance 0aebe331-591b-4fc2-bb54-3f516d4453dd on n-h1-831194-21 Oct 04 17:58:44.018471 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cacfcc84-bbc8-4677-8345-b076ebc256aa req-21aa2246-6ab2-4639-93c7-d6538f71f350 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075632 Oct 04 17:58:44.024566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1062/2041] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:44.453444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.454593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.462959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.471111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.471935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.472913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.474156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.477399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.702624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.703456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.722660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.723638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.726036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.727388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.731401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.732310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.806149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.806886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.809725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.811781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid 0aebe331-591b-4fc2-bb54-3f516d4453dd {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:44.938493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:44.951134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5bc4e13a-33d8-4d29-af9a-be0894d92e32 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.501640 Oct 04 17:58:44.967857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 980/2042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:44.973016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:44.984196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:44.992875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.993634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.994392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:44.995127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:44.995601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:44.996024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.091995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.109760 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77fae0ff-dda5-4c68-acf4-7f9d5eb1584d tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 200 len: 1324 microversion: 2.1 time: 0.414247 Oct 04 17:58:45.111820 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1063/2043] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 1324 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:58:45.127840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:45.135951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:45.157087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.160415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.165082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.166438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.168254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.170508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.492378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:45.501139 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-947b7df7-be5e-4fdd-9060-7541d6e8c0f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.531918 Oct 04 17:58:45.514706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 981/2044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:44 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:45.659232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:45.702472 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be7bb3f2-b33e-4a96-adfa-52094b7e10d1 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 2426 microversion: 2.25 time: 0.584384 Oct 04 17:58:45.705918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1064/2045] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:45 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 2426 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:45.736881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831194-21", "block_migration": "auto"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:45.739928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:45.757851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.758365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.758804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.767439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:45.768024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:45.769321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:45.840594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'flavor' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:45.873009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Going to try to live migrate instance to n-h2-831194-21 {{(pid=128850) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:58:45.982939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:45.983770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:46.009291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.011216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.013417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.014754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.016545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.018642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.512374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:46.529310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f21ae58e-3153-4f40-9bd0-5c4da1177900 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.557717 Oct 04 17:58:46.532682 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1065/2046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:45 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:46.544544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfe661fe-d8ea-4211-afaf-0c7461c6a7bc", "tag": "65807dc9-c6c0-4f88-8477-4d4bfae6af76"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:46.583227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.585024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.587019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.620904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] Creating event network-changed:65807dc9-c6c0-4f88-8477-4d4bfae6af76 for instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc on n-h1-831194-21 Oct 04 17:58:46.637887 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4deca30c-41e6-46d7-af0c-16c21c644270 req-7f6fcc3a-26d2-443b-a944-0cfd127c2578 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101492 Oct 04 17:58:46.638754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1066/2047] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:46.662524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:46.667228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 0aebe331-591b-4fc2-bb54-3f516d4453dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:46.683436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.685265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.688082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.689072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.691449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.692632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.726262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] HTTP exception thrown: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Request method failure captured: Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd HTTP/1.1 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHK1Zo76seNf-PruRwnKA62hdcC3sBHOpMdRHd26cm0y75l4yZga2P76oeznx0GjxKUkdSr-1ZKn-n3Stx3TgC0ngdcXU4m-AftP4KTwZOtPkrlnOy05S9eYD-xZdmZgrxzNk-PFhJcP4HuJlXJ_hMmb5YR5E7MUOqLzk-bOg0HCtzY Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ea6b89bd15d0468a920310645029d5d1 Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0aebe331-591b-4fc2-bb54-3f516d4453dd'} Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:46.730572 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Returning 404 to user: Instance 0aebe331-591b-4fc2-bb54-3f516d4453dd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37045cc5-ec13-4969-a6c4-15cda7fa8158 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd" status: 404 len: 111 microversion: 2.1 time: 0.087637 Oct 04 17:58:46.735264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1067/2048] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:46 2022] GET /compute/v2.1/servers/0aebe331-591b-4fc2-bb54-3f516d4453dd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:46.746652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:46.747304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:46.793138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.794084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.796193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:46.800323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:46.800813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:46.801256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:47.111001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:47.638825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:47.651312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94eaddbb-db6d-40a5-bd88-15aab96ee8d0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1515 microversion: 2.1 time: 0.917706 Oct 04 17:58:47.653663 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1068/2049] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:46 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1515 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:47.660563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef6e0938-469b-4233-975a-19672b1d2407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '.version_select at 0x7fbdbd067430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:47.725187 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef6e0938-469b-4233-975a-19672b1d2407 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-866914179" status: 202 len: 0 microversion: 2.1 time: 0.068792 Oct 04 17:58:47.729786 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1069/2050] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 17:58:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-866914179 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:58:47.909977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-46920232", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "fce7ff1e-70f3-4550-b825-58c99b6e82a7"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:48.003449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:48.027159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] validate_networks() for [('fce7ff1e-70f3-4550-b825-58c99b6e82a7', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:49.689477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:49.690942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:49.691699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:49.692618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:49.693413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:49.726796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.727297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.729783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.730642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:49.734644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:49.735120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:49.786371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:49.798587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for user 9c110945b1ec49fb91c8d3e67a6c2178 and project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:49.838420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:49.843046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:49.977198 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-29271a76-f56e-471e-8af1-e0e546d1d094 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.243250 Oct 04 17:58:49.979538 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1070/2051] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2248 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:49.990703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:49.993856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.004187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.005956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.006615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.007707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.008495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.010170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.752569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:50.767689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66fd4c01-4ab5-4ed7-a013-7a8e6304b245 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.785589 Oct 04 17:58:50.770168 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1071/2052] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:49 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:50.785935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:50.786996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.805709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.806549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.807169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.808073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.808670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.809589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.904212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5ab0140-8d3f-42c7-94f0-3d2cc4eaf480 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/action" status: 202 len: 0 microversion: 2.25 time: 5.174209 Oct 04 17:58:50.905420 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 982/2053] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:58:45 2022] POST /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/action => generated 0 bytes in 5176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:50.919922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:50.922829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:50.960304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.961914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.964787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:50.968976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:50.969557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:50.972004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.062183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:51.167145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.177719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4403fda5-da76-4469-a434-b27662bf5504 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.403649 Oct 04 17:58:51.195255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1072/2054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:50 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:51.200149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.200779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.212652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.213586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.214247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.215341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.216022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.216777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.296675 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab6b1742-1bf2-4af0-8c53-70f2f5679626 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 204 len: 0 microversion: 2.1 time: 0.388346 Oct 04 17:58:51.297605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 983/2055] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:50 2022] DELETE /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:51.320297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.332170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-460fee19-d4a7-4577-b852-fb82c0fbf7ee tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1219 microversion: 2.1 time: 0.135694 Oct 04 17:58:51.334604 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1073/2056] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:51.339656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.340395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.347332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.348390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.349491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.350335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.350872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.351670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.586539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-89369587", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:51.597276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.614028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.616659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:51.621766 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e8ab53f-2bc2-4811-97ee-847c80a4e891 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.282509 Oct 04 17:58:51.622508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1074/2057] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:51.653694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.654903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.665567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.666859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.667471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.670597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.671231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.671678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.693565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:51.694360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:51.697098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:51.697893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:51.698612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:51.726415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.727055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.727558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.728579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.729228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.729862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.794597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Getting quotas for project 3bcbef20c46d49e39767796552359db1. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:51.822600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Getting quotas for user 040dcc7e702f4585b1657a7b36c1dda1 and project 3bcbef20c46d49e39767796552359db1. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:51.858742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:51.861112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:51.960147 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e3a2a56b-d7a7-4146-a021-4dbb42758d8b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.660578 Oct 04 17:58:51.961916 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 984/2058] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:58:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:58:51.971221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:51.972122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:51.979806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.980539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.981137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:51.982089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:51.982730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:51.983403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.463748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.474167 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-05033d55-feac-4f14-bff7-0fc799b1b6f8 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1483 microversion: 2.1 time: 0.838314 Oct 04 17:58:52.478536 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1075/2059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1483 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:52.498235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:52.499218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:52.696507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.735858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.748017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:52.749270 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-805d471b-6850-4637-b21c-e5cd3798609f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 200 len: 1276 microversion: 2.47 time: 0.268094 Oct 04 17:58:52.768223 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1076/2060] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 1276 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:52.781678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:52.782598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:52.794746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.795257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.795710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:52.796439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:52.796904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:52.797333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.034784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:53.044998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58189d7b-1a7b-437d-8e99-0ccb69e30cad tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 1.079365 Oct 04 17:58:53.061611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 985/2061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:51 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:53.066146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:53.066778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:53.072829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:53.076611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.077504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.078373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.080199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.080915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.081739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.357196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:53.367244 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-554509f3-a14d-4aff-8a31-1a372343b834 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1281 microversion: 2.1 time: 0.317127 Oct 04 17:58:53.371478 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 986/2062] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:53 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1281 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:53.386386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebaee67-62ca-4988-8f1d-26fb853c7a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:53.410467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.411801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.412417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.419494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:53.432607 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] Creating event network-vif-unplugged:b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5 for instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b on n-h2-831194-21 Oct 04 17:58:53.441238 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4bcaad92-e391-4106-bff6-bd7d62a34720 req-97e5297e-fe30-4944-873c-fbda9a26ff28 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067013 Oct 04 17:58:53.442192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 987/2063] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:53.459084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:53.481066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:53.507448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.510791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.513961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.516202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.516852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.521847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.620418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:53.634454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f371e93b-3d1b-4ff9-b6b4-70a29aa40c8f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.864854 Oct 04 17:58:53.636215 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1077/2064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:52 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:53.663308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-766384819", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:53.768740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:53.769177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:53.770037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:53.771727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:53.772208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:53.807243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.807746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.808245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.809027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:53.809490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:53.809963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:53.846235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:53.856825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Getting quotas for project 3bcbef20c46d49e39767796552359db1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:53.865741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Getting quotas for user 040dcc7e702f4585b1657a7b36c1dda1 and project 3bcbef20c46d49e39767796552359db1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:53.885203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:53.888563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:53.980912 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78162d5e-8aa7-4a2d-8987-0cecb5369cd2 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.333619 Oct 04 17:58:54.001053 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1078/2065] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 17:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 355 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 17:58:54.011953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c2a784f-482e-476d-828b-1e77d9a6f0f7", "name": "network-vif-deleted", "tag": "42f2cb70-4d7b-4080-9522-f3089c3dd2f5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:54.055329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.056237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.056975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.097565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] Creating event network-vif-deleted:42f2cb70-4d7b-4080-9522-f3089c3dd2f5 for instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 on n-h1-831194-21 Oct 04 17:58:54.124689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-64f7f789-2a4f-4552-968a-e3d15b0707e9 req-47bec551-6768-453c-8604-c4872ce7975c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121270 Oct 04 17:58:54.128183 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1079/2066] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:54.149081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.150166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.164228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.165196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.166316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.167220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.167846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.168596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.261720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.263003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.263610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.264350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid 3c2a784f-482e-476d-828b-1e77d9a6f0f7 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:54.446191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.449396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.465808 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0817f4f1-a785-4461-8340-42a8c53ca885 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1299 microversion: 2.1 time: 0.335030 Oct 04 17:58:54.466667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.470828 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1080/2067] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:54 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1299 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:54.474807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.476231 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6a45164-357c-4b27-b6b3-77e82335d71f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 1.032353 Oct 04 17:58:54.479152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 988/2068] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:53 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:54.486531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ea2b682-173c-4545-876a-92a0dee1f5d7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:54.492837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ea2b682-173c-4545-876a-92a0dee1f5d7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.505395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.506148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.549319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.552888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.559574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.560476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.560967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.566371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.665130 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ea2b682-173c-4545-876a-92a0dee1f5d7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "PUT /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 991 microversion: 2.47 time: 0.188979 Oct 04 17:58:54.679125 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1081/2069] 10.222.0.42 () {62 vars in 1297 bytes} [Tue Oct 4 17:58:54 2022] PUT /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 991 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:58:54.701780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.703974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:54.731146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.731912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.732969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.734259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:54.735097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:54.735930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:54.967546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:54.979135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ed93df9-86da-47ff-a5fc-49a46a5509b7 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.498572 Oct 04 17:58:54.980033 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 989/2070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:54 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:54.998090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:54.998714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.021520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.022170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.022601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.023495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.024108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.024690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.267437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.278859 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7477421a-acdb-4404-b287-6700b0c96ec8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.296723 Oct 04 17:58:55.280135 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 990/2071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:54 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.285566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.286962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.294855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.296326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.296959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.297926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.299821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.300453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.316491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.324944 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-056c9693-2710-4872-9901-c3ac62a296b9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.644459 Oct 04 17:58:55.342270 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1082/2072] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:54 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.350549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-264700795", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "9f9c9c00-6a63-4582-86a5-1da069aaa19e"}, {"uuid": "55d091ca-3779-4f07-b3d2-bd8decc4d6be"}, {"uuid": "9f9c9c00-6a63-4582-86a5-1da069aaa19e"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:55.410084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.414342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] validate_networks() for [('9f9c9c00-6a63-4582-86a5-1da069aaa19e', None, None, None, None, None), ('55d091ca-3779-4f07-b3d2-bd8decc4d6be', None, None, None, None, None), ('9f9c9c00-6a63-4582-86a5-1da069aaa19e', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:58:55.430578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.433454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.434849 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a92563bf-f771-4ffd-96c9-fc9b07f6e67b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1273 microversion: 2.47 time: 0.153472 Oct 04 17:58:55.435621 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 991/2073] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1273 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:55.493304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.494310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.509554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.510103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.515621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.516694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.517375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.526317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.584814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.585585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.586228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.586843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid 3c2a784f-482e-476d-828b-1e77d9a6f0f7 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:58:55.657095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.669548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-308e8628-1a37-444f-a83c-20aa72ac2520 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 200 len: 1299 microversion: 2.1 time: 0.180630 Oct 04 17:58:55.685461 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 992/2074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 1299 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:55.701222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:55.704417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:55.726969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.728514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.729124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.730037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:55.730674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:55.731754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:55.970278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.984886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.986842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:55.988234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26c3ca6e-892f-4e7d-90c1-56c7141ee957 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.301405 Oct 04 17:58:55.988758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 993/2075] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:56.010936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.011804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.026700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.028197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.028877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.029934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.030703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.031460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.315588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:56.330409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7efe475f-bf12-4c72-b9d5-c8a87eefeb1d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.331045 Oct 04 17:58:56.346689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 994/2076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:55 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:56.355787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.356493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.374909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.375418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.375865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.376609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.377072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.377508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.573753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:56.582066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-66b8f5a7-0e13-41c0-8a98-dc8730742e97 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.234242 Oct 04 17:58:56.582729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 995/2077] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:56 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:56.604125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.604759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.612042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.612549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.613274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.614391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.615031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.615505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.859594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:56.873320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80b167c8-343e-4117-8414-4f24e0838a83 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.273086 Oct 04 17:58:56.874476 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 996/2078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:56 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:56.880304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:56.881129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:56.888526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.889252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.889877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.890754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:56.891368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:56.891949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:56.996638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.012843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.016955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.021392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7370cdd3-504c-4443-a61c-d530c773c155 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1335 microversion: 2.47 time: 0.144745 Oct 04 17:58:57.022730 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 997/2079] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:56 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1335 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:57.037897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe661fe-d8ea-4211-afaf-0c7461c6a7bc", "name": "network-vif-plugged", "status": "completed", "tag": "65807dc9-c6c0-4f88-8477-4d4bfae6af76"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:57.050414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.051138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.053199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.068950 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] Creating event network-vif-plugged:65807dc9-c6c0-4f88-8477-4d4bfae6af76 for instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc on n-h1-831194-21 Oct 04 17:58:57.078283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f8bbaa5d-f58e-45c8-9cc5-0d6db56f42ef req-21883145-c14e-4e93-8f69-c48a715fc196 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051110 Oct 04 17:58:57.078283 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 998/2080] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:57.082182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:57.083546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: 3c2a784f-482e-476d-828b-1e77d9a6f0f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:57.091234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.091882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.092431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.095010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.095613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.096196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.121122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] HTTP exception thrown: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Request method failure captured: Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 HTTP/1.1 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHK1Zo76seNf-PruRwnKA62hdcC3sBHOpMdRHd26cm0y75l4yZga2P76oeznx0GjxKUkdSr-1ZKn-n3Stx3TgC0ngdcXU4m-AftP4KTwZOtPkrlnOy05S9eYD-xZdmZgrxzNk-PFhJcP4HuJlXJ_hMmb5YR5E7MUOqLzk-bOg0HCtzY Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ea6b89bd15d0468a920310645029d5d1 Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveMigrationTest-1031741175-project Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3c2a784f-482e-476d-828b-1e77d9a6f0f7'} Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:58:57.124309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:58:57.128478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Returning 404 to user: Instance 3c2a784f-482e-476d-828b-1e77d9a6f0f7 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:58:57.130519 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae086629-ab75-40da-aaf0-9e8efc6418e6 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7" status: 404 len: 111 microversion: 2.1 time: 0.051581 Oct 04 17:58:57.131383 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 999/2081] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:57 2022] GET /compute/v2.1/servers/3c2a784f-482e-476d-828b-1e77d9a6f0f7 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:58:57.138528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:57.139237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:57.148420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.149021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.149557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.150758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.151297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.151798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.403402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.422084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.425411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:57.427386 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98ef5e6b-675f-41c1-83a4-85e49cb4cd2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.294221 Oct 04 17:58:57.428391 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1000/2082] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:57 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:57.434152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:57.434746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:57.443430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.443947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.444388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.445103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.445583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.446272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.519982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:58:57.691666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-408789d6-1602-4db8-87cc-2963676881bf tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 204 len: 0 microversion: 2.1 time: 0.261604 Oct 04 17:58:57.694048 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1001/2083] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:58:57 2022] DELETE /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:58:57.701024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40fdcf34-7fa5-4972-b730-26aa3634cd8d", "tag": "ab0f6519-ce19-41b2-96f4-5b800acd8c87"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:57.714418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.715252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.716017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.738747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] Creating event network-changed:ab0f6519-ce19-41b2-96f4-5b800acd8c87 for instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d on n-h2-831194-21 Oct 04 17:58:57.746813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-965459f7-8bdf-44ee-ab83-780f311c0386 req-5f0b63db-4186-495a-b64d-6c322d1d1482 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050015 Oct 04 17:58:57.748010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1002/2084] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:57.753466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:57.755470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:57.762947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.763545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.764192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:57.765384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:57.766084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:57.766730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.078822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.090166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b634b41e-5796-4d99-a1ad-a4dbb843fc3a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1308 microversion: 2.1 time: 0.340651 Oct 04 17:58:58.090767 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1003/2085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:57 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1308 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:58.099992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.100834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.110185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.110916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.111619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.113419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.115513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.116180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.145101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:58.356494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.375395 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bcc5a1c-cfe8-4150-97f6-7f094884e833 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.283357 Oct 04 17:58:58.376228 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1004/2086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:58.392245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.394188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.409328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.410304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.411091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.412017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.412628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.413222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.692068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:58:58.693154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:58:58.693789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:58:58.695211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:58:58.696046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:58:58.718625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.719525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.720151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.724698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.727558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.728261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.736482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:58.754435 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdff44af-9b57-4f0a-bc73-47423968b834 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1501 microversion: 2.1 time: 0.367322 Oct 04 17:58:58.776114 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1005/2087] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1501 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:58.787284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.787572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.789484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Getting quotas for project 42151954583a4ff68618a0a783fdc7d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:58:58.803298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.803787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.804226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.804923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.806127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.806749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.807965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Getting quotas for user 61d553fff0e64a2ca5970bf9897eaff1 and project 42151954583a4ff68618a0a783fdc7d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:58:58.822890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:58:58.825589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:58:58.908125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f67c0764-cf1b-4dd8-9783-0e1e14c4a432 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.564517 Oct 04 17:58:58.909309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1083/2088] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:58:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:58:58.922788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:58.923610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:58.941331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.942313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.943227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:58.944177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:58.944849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:58.945485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.108493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.120153 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9bae31a3-72dc-4875-be3c-c98dfffc2f79 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.340851 Oct 04 17:58:59.134457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1006/2089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:59.135244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.138204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.151384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.151887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.157871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.160107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.161544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.162090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.173463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.178708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:58:59.189062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.195680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.205773 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08222508-ba9f-4622-83cc-2c0e69c2704f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1335 microversion: 2.47 time: 0.295221 Oct 04 17:58:59.212553 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1084/2090] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:58 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1335 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:59.247262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a04dc5b-3f0f-480c-9627-82c41e9591f4 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.249445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a04dc5b-3f0f-480c-9627-82c41e9591f4 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.370253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.382779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.384648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.386064 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-269dfe95-a69f-49fb-9e64-4409470d8737 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.263046 Oct 04 17:58:59.386964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1007/2091] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:58:59.408290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.410416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.425639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.426186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.427163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.427904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.428364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.431539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.478245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a04dc5b-3f0f-480c-9627-82c41e9591f4 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.497873 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a04dc5b-3f0f-480c-9627-82c41e9591f4 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1212 microversion: 2.1 time: 0.275561 Oct 04 17:58:59.501040 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1085/2092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1212 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:59.518243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebaee67-62ca-4988-8f1d-26fb853c7a6b", "name": "network-vif-plugged", "status": "completed", "tag": "b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:59.571570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.572538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.574672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.598643 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] Creating event network-vif-plugged:b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5 for instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b on n-h2-831194-21 Oct 04 17:58:59.615894 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0874e96a-c261-4680-801c-f4f500fb4e3d req-f19c81ed-422d-4754-8c29-0c118b85f8ef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112027 Oct 04 17:58:59.617957 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1086/2093] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:58:59.636893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.641939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.658793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.660005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.662315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.664036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.664515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.664959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.876619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.892343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c6b0d62-4eca-4820-a6f3-0f59391d0384 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1487 microversion: 2.1 time: 0.503567 Oct 04 17:58:59.909995 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1008/2094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1487 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:59.910466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:58:59.922573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec1a95d1-c5d0-4db1-ac1d-64e25f588dcd tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.302232 Oct 04 17:58:59.923166 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1087/2095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:58:59.935763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:58:59.936302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.949333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.949853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.950302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:58:59.950918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:58:59.951544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:58:59.954751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:58:59.955246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:58:59.956304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.003454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.004433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.007348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.008128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.008601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.009037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.035192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lazy-loading 'flavor' on Instance uuid dfe661fe-d8ea-4211-afaf-0c7461c6a7bc {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:00.180974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.196433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ff2646d-928b-4b81-ab2f-9c5cb1980b08 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1459 microversion: 2.1 time: 0.301809 Oct 04 17:59:00.197023 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1009/2096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:58:59 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1459 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.201797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.202439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.224153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.224657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.225101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.225846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.228520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.228961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.337079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-727625b8-ad81-4169-8293-ead2c72bad33 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc/action" status: 202 len: 0 microversion: 2.1 time: 0.408229 Oct 04 17:59:00.338273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1088/2097] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:58:59 2022] POST /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:59:00.344999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.346205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.370456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.371230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.371824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.372688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.373289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.373923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.512309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.522010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5035c8f-c4c0-4f2a-8487-eb333792783a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.323511 Oct 04 17:59:00.537480 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1010/2098] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.553792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eeafbed5-09c2-4b4f-8a29-08ca36addfdf", "name": "network-vif-deleted", "tag": "c8bb7279-f62f-4197-8b17-515763de394c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:00.557810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.557904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.558333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.562016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.571474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] Creating event network-vif-deleted:c8bb7279-f62f-4197-8b17-515763de394c for instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf on n-h1-831194-21 Oct 04 17:59:00.576856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7f8a1e34-3a42-4c56-bebf-48e8fd7c9e3d req-a3537dd9-424f-4945-a62e-cdaad114e83c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038242 Oct 04 17:59:00.580614 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1011/2099] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:00.588279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.589911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.591312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2915c122-bd67-4481-ad98-6642f5a4cd4d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1356 microversion: 2.47 time: 0.251003 Oct 04 17:59:00.592486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1089/2100] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1356 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:00.604318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.605364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.618954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.624659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.630558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.631287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.631911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.634652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.635278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.635864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.637601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.641445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.642209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.643716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.646549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.648299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.920892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:00.930873 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-014dd226-fbbd-4f17-80cb-8a818286c717 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1495 microversion: 2.1 time: 0.348975 Oct 04 17:59:00.947622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1012/2101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1495 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:00.954000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:00.955425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:00.963163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.963946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.964728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:00.966301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:00.967043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:00.967721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.076375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.093940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.102161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.106758 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26a2b7cb-dcf9-4719-8c81-fe554f45417d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.511171 Oct 04 17:59:01.110015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1090/2102] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:01.112435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.119284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:01.124504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.124849 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02022f4f-8b65-4fca-9a1a-680291502b91 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1264 microversion: 2.1 time: 0.175101 Oct 04 17:59:01.126743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1013/2103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:00 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:01.138228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.139363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.139902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.140185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.141020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.141156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.141482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.142029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.148455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.148952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.149393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.150144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.150605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.151159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.293581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:01.294102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:01.294595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:01.295014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:01.295728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:01.354160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.365852 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06d444a7-c581-417b-ae03-99f939a39684 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1521 microversion: 2.1 time: 0.237970 Oct 04 17:59:01.367439 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1014/2104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:01.372838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.373662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.381785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.382422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.383215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.384030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.385532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.386243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.438905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.440768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.441439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.444521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lazy-loading 'fault' on Instance uuid eeafbed5-09c2-4b4f-8a29-08ca36addfdf {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:01.457548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.464800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.465294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.465732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.466532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.467155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.467473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.548502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea6b89bd15d0468a920310645029d5d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7916c0d165d40f38d13d012e9dc627c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.550021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4732ed59-12d4-4650-8756-364ef46d6581 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "POST /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0/action" status: 202 len: 1078 microversion: 2.47 time: 0.438432 Oct 04 17:59:01.552925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1091/2105] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 17:59:01 2022] POST /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0/action => generated 1078 bytes in 442 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 17:59:01.563538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.564399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.572412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.573291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.573977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.574863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.575483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.576778 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5bb1568-61b3-4409-b2d2-15fd2329bfc2 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 200 len: 1301 microversion: 2.1 time: 0.208760 Oct 04 17:59:01.577451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.579546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1015/2106] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 1301 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:01.588086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.588086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.596979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.598882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.599292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.600587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.601216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.601876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.747110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.750649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:01.785556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.791914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:01.813613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a38a45e-7767-4411-9b58-9c75c32881d8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.231719 Oct 04 17:59:01.815655 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1016/2107] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:01.959459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:01.960113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:01.964028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:01.984569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.985001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.985639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:01.986748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:01.987271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:01.989727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.041941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.055726 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfe886f3-b308-450b-bb2f-63f8da11f2e5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.497206 Oct 04 17:59:02.057032 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1092/2108] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:02.139727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.141892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.178764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.179274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.179720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.180454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.180898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.181326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.308850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.326591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-506a4d1f-25be-4659-a000-fc57b0a5979c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 200 len: 1478 microversion: 2.1 time: 0.366900 Oct 04 17:59:02.328472 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1017/2109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:01 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 1478 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:02.334349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.335359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.348873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.348873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.348873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.349560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.366153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.367059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.497784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.510293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-250725dd-a85f-4bad-bb18-df7e205a2e24 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1270 microversion: 2.1 time: 0.178197 Oct 04 17:59:02.521088 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1018/2110] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1270 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:02.529294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1687394408"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:02.532006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.540075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.540573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.541618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.541733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.542182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.542604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.873551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d602f42c-4fae-49ca-8b6a-e9591c3dd655 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc/action" status: 202 len: 0 microversion: 2.1 time: 0.360277 Oct 04 17:59:02.881076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1019/2111] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:02 2022] POST /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc/action => generated 0 bytes in 368 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:59:02.887598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.888585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.897592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.898545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.899219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.900327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.901000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.901837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.922911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.928163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:02.937070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.942615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:02.943858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1fe3a46-8e57-498a-964b-65e447936ce8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.811724 Oct 04 17:59:02.949313 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1093/2112] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:02.970225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:02.971018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] [instance: eeafbed5-09c2-4b4f-8a29-08ca36addfdf] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:02.982023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.983146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.983753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:02.984867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:02.985441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:02.985910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.012129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] HTTP exception thrown: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Request method failure captured: Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf HTTP/1.1 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHK1Zo76seNf-PruRwnKA62hdcC3sBHOpMdRHd26cm0y75l4yZga2P76oeznx0GjxKUkdSr-1ZKn-n3Stx3TgC0ngdcXU4m-AftP4KTwZOtPkrlnOy05S9eYD-xZdmZgrxzNk-PFhJcP4HuJlXJ_hMmb5YR5E7MUOqLzk-bOg0HCtzY Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b7916c0d165d40f38d13d012e9dc627c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-LiveMigrationTest-1031741175 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b7916c0d165d40f38d13d012e9dc627c Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-LiveMigrationTest-1031741175 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-LiveMigrationTest-1031741175-project Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ea6b89bd15d0468a920310645029d5d1 Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-LiveMigrationTest-1031741175-project Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'eeafbed5-09c2-4b4f-8a29-08ca36addfdf'} Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:03.013984 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] Returning 404 to user: Instance eeafbed5-09c2-4b4f-8a29-08ca36addfdf could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:03.018330 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-863d8db9-892a-4486-9e36-494a161e6b15 tempest-LiveMigrationTest-1031741175 tempest-LiveMigrationTest-1031741175-project] 10.222.0.42 "GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf" status: 404 len: 111 microversion: 2.1 time: 0.064605 Oct 04 17:59:03.019724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1094/2113] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/eeafbed5-09c2-4b4f-8a29-08ca36addfdf => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:03.025580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.026233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.035533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.039071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.039519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.040289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.040756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.041198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.165166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.173522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-159150c2-ba23-49e5-a405-e46523584b36 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1506 microversion: 2.1 time: 0.290745 Oct 04 17:59:03.173970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.174995 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1020/2114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:02 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:03.183792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b67b579-7d81-4e72-9b46-cf6926d89ff4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbf45aa60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.199185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.200967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.202503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6c9b35e-756c-40be-b66b-931602a59c5e tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.181167 Oct 04 17:59:03.214244 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1095/2115] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:03.228153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.229266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.235833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.241038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.242264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.244403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.245201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.245872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.257639 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b67b579-7d81-4e72-9b46-cf6926d89ff4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.081395 Oct 04 17:59:03.266451 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1021/2116] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:03.272582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.273339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.279575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.280184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.280705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.281486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.288551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.289179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.565367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.576070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a81e43f-db42-4874-90be-e3ffef0e87bc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 200 len: 1506 microversion: 2.1 time: 0.308093 Oct 04 17:59:03.578729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1022/2117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:03.588253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.590879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.612262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.613150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.613758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.615492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.616173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.616751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.727381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:03.738345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebfad6b1-7e6d-43ed-af7d-0f6cdf1abbda tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1270 microversion: 2.1 time: 0.157671 Oct 04 17:59:03.741656 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1023/2118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1270 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:03.755101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:03.755882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:03.767015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.775292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.776042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.776946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:03.777608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:03.778205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:03.835115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:03.992558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.002346 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cfce98f6-b2fb-40c0-9518-0bf3bb1ec0b1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.786521 Oct 04 17:59:04.008945 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1096/2119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:03 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:04.009293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80cf23f6-10a7-425d-a331-17389a4e23a7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 204 len: 0 microversion: 2.1 time: 0.265970 Oct 04 17:59:04.010647 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1024/2120] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:03 2022] DELETE /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:04.018157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fdcf34-7fa5-4972-b730-26aa3634cd8d", "name": "network-vif-plugged", "status": "completed", "tag": "ab0f6519-ce19-41b2-96f4-5b800acd8c87"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:04.022031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:04.031657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.032341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.032777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.034228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:04.057396 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] Creating event network-vif-plugged:ab0f6519-ce19-41b2-96f4-5b800acd8c87 for instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d on n-h2-831194-21 Oct 04 17:59:04.059270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.060268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.061063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.062506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.062814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a64b2ffb-5e40-4e27-a9e0-c81fea05f5c3 req-8bf0f622-c0db-471d-925c-15320b54c86e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050617 Oct 04 17:59:04.064659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.067888 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1025/2121] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:04.074592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.184388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1127435074", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5aedda1f-baf0-459d-966b-7a8f7e6088bb"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:04.313348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] validate_networks() for [('5aedda1f-baf0-459d-966b-7a8f7e6088bb', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:04.384991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.396518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.398344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.399816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2df8363e-356e-4f40-a2ca-7759b75fbadf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.388024 Oct 04 17:59:04.400852 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1097/2122] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:04 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:04.405662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:04.406486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:04.416576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.417069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.417507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.426465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.427555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.428174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.540511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.555457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.558221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:04.560907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ced6a9c9-2c3a-4f8e-8cbd-be8f015e4f00 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.158612 Oct 04 17:59:04.561398 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1098/2123] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:04 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:04.577256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a9a472b-c480-485e-bcd2-57ecacf7db53 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd239a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:04.636045 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a9a472b-c480-485e-bcd2-57ecacf7db53 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.073787 Oct 04 17:59:04.641306 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1099/2124] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:04 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:04.766446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:04.767167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:04.782946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.786719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.787832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:04.790638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:04.791132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:04.792678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.044709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.045537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:05.046122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:05.047428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:05.051040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:05.051765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:05.054888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0fc872c2-ab7c-4ef1-8530-5be895b39c00 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1312 microversion: 2.1 time: 0.292149 Oct 04 17:59:05.055476 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1100/2125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:04 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1312 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:05.069939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.070865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.071892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.072940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.074394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.075572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.076192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.076556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.091701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.092457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.093069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.099423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.100202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.100665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.104542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:05.116712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:05.126415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:05.128267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for user 56b04b3d7b1e413292af14ed0e2edb09 and project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:05.158633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:05.161603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:05.258197 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-31d6ae18-8604-496e-a3c5-2dfcaa5cc22e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.078922 Oct 04 17:59:05.259353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1026/2126] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 17:59:05.272403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3be1a9c6-24b3-4fa3-a7da-52e10067a4a6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.273249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3be1a9c6-24b3-4fa3-a7da-52e10067a4a6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.521427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3be1a9c6-24b3-4fa3-a7da-52e10067a4a6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.547105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3be1a9c6-24b3-4fa3-a7da-52e10067a4a6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1218 microversion: 2.1 time: 0.280934 Oct 04 17:59:05.558175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1027/2127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1218 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:05.567825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.570212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.601020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.601545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.602112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.602811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.603280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.603720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.684439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.695964 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b67cf842-51ca-41db-811f-04e10524eb1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.622126 Oct 04 17:59:05.715469 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1101/2128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:05.721588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:05.729364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:05.738046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.743458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.744384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.745328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:05.746028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:05.747281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:05.950375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.969147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.987631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:05.990254 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d531d4a-6694-42d3-bb77-730775ba903b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.272745 Oct 04 17:59:06.017012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1102/2129] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:06.029351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5a8519a-1791-4101-929c-7fcf939424c9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd29c9d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:06.091953 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5a8519a-1791-4101-929c-7fcf939424c9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.071580 Oct 04 17:59:06.093354 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1103/2130] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:06 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:06.100565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:06.101891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:06.114894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.116343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.117666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.120236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.123055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.123974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.459414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.463333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.476434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.481989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-030a96fe-f293-4005-9570-7520a5c576dc tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1333 microversion: 2.1 time: 0.386587 Oct 04 17:59:06.483614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1104/2131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:06 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1333 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:06.499567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.502854 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d20c2c8-17fb-417b-bef0-11597ad852c9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.943535 Oct 04 17:59:06.506139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1028/2132] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:05 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:06.580823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:06.583565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:06.594430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.595238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.595930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.596788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.597742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.599174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.727059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:06.727995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:06.757090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.758417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.760736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.761781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:06.762709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:06.764307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:06.765213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:06.781261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91a04e29-a817-49bb-b6ba-f6f3617dca62 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1222 microversion: 2.1 time: 0.210192 Oct 04 17:59:06.784316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1105/2133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:06 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1222 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:07.026072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:07.027033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:07.041800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.043017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.045934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.047097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.049646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.050507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.178888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:07.195717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ab0fbcd-2528-4736-bc95-d7fac42b3d08 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1323 microversion: 2.1 time: 0.472661 Oct 04 17:59:07.196387 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1029/2134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:06 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1323 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:07.210482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ddaabbdd-e09a-4378-8a4d-05766ad11677 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd9e8ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:07.231745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:07.255697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:07.257862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:07.259585 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2930474c-ca91-4d36-931f-d8af290a3163 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.240863 Oct 04 17:59:07.294606 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1106/2135] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:07 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:07.330881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ddaabbdd-e09a-4378-8a4d-05766ad11677 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.132726 Oct 04 17:59:07.334206 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1030/2136] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:07 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:07.509208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:07.518593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:07.535057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:07.537115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:07.547437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.550748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.564591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.565764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.566631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.567419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.571109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.572249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:07.574642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.575864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:07.578657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:07.581016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.052312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.071664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.073240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.074598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9556a56-fe3d-4ded-aab7-771f42b903f8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.543640 Oct 04 17:59:08.082485 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1031/2137] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:07 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:08.107279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ebaee67-62ca-4988-8f1d-26fb853c7a6b", "name": "network-vif-deleted", "tag": "b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:08.158071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.160565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.163738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.164209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.173691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94280aa1-1496-4f22-b16d-ee9365dec0c8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.668407 Oct 04 17:59:08.190631 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1107/2138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:07 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:08.199551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.201050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.211335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.213393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.214562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.218552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.221253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.227115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.240804 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] Creating event network-vif-deleted:b13567d6-3c0d-4d3b-aefe-fef5eba8c6d5 for instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b on n-h2-831194-21 Oct 04 17:59:08.260586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8a79987d-667c-48b9-989d-873360aa24f8 req-dc478532-2b50-437e-acf5-37a3ce8d3f7c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175259 Oct 04 17:59:08.261190 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1032/2139] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:08.276465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe661fe-d8ea-4211-afaf-0c7461c6a7bc", "name": "network-vif-plugged", "status": "completed", "tag": "65807dc9-c6c0-4f88-8477-4d4bfae6af76"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:08.314708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.315196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.315787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.350546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] Creating event network-vif-plugged:65807dc9-c6c0-4f88-8477-4d4bfae6af76 for instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc on n-h1-831194-21 Oct 04 17:59:08.366285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-58d22fe4-81a9-41da-9908-082f9cac7d58 req-fcbc5d61-f21c-462c-8fc3-0b544739652f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102832 Oct 04 17:59:08.366963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1033/2140] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:08.368255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.380841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.383561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d00e6b3-533a-4549-8215-ebca69f662c5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1278 microversion: 2.1 time: 0.191524 Oct 04 17:59:08.398180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.398180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.398428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.399285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.400022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.400603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.401077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.401681 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1108/2141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1278 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:08.436027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.437051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.462321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.468078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.468714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.476411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.477436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.481540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.727928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.740025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.742150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.743917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06fc6da5-b004-4e1a-95e5-e095bab3c0cf tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.340911 Oct 04 17:59:08.768963 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1109/2142] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:08.781880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f678458-b93b-42c6-bf39-651aecee75c8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd7a2b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.794209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:08.817566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:08.830089 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9691a469-dfe5-404b-8c27-ed471e2538a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.461892 Oct 04 17:59:08.842232 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1034/2143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:08.862023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "tag": "f7f72c8c-d814-43cb-a946-3bbf10cf4992"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:08.882157 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f678458-b93b-42c6-bf39-651aecee75c8 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.108181 Oct 04 17:59:08.891754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1110/2144] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:08.898744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.899155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:08.899276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.899694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.900187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:08.914154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.915960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.923634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.925231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:08.927640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:08.928708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:08.944687 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] Creating event network-changed:f7f72c8c-d814-43cb-a946-3bbf10cf4992 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:08.956312 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4ebd3e71-5e54-4aa4-aee8-d075c6651843 req-a009a8ed-3fa2-448b-be80-c34081be7def service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111773 Oct 04 17:59:08.956936 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1035/2145] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:09.113821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:09.117060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:09.128377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.130867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.131595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.132646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.133418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.134066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.288978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.302620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4405977a-1ce9-4dc8-8dd8-f56dc70db1fe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.408737 Oct 04 17:59:09.319795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1111/2146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:08 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:09.331352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:09.333764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:09.337325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:09.345435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.347620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.348672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.349717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.351019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.351735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.394989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.405383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.407498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.413731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bebe3958-da5c-4ce0-9a24-ef9deea60575 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.305218 Oct 04 17:59:09.414398 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1036/2147] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:09.424970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e94be475-5dcd-483e-aad3-cd9d5918dc67 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1566486196", "metadata": {"": ""}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e94be475-5dcd-483e-aad3-cd9d5918dc67 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action HTTP/1.1 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 107 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1566486196", "metadata": {"": ""}}} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1566486196', 'metadata': {'': ''}}}} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'': ''} Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:09.429503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e94be475-5dcd-483e-aad3-cd9d5918dc67 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e94be475-5dcd-483e-aad3-cd9d5918dc67 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action" status: 400 len: 170 microversion: 2.1 time: 0.015487 Oct 04 17:59:09.438510 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1037/2148] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Oct 4 17:59:09 2022] POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action => generated 170 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:09.441210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:09.441210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:09.448539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.449019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.449459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.450214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.450673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.451104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.491832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=22 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:09.576572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.593901 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a57585d4-fd9a-4916-9d21-98c4341c4bb8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1276 microversion: 2.1 time: 0.157424 Oct 04 17:59:09.597959 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1038/2149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:09.611001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:09.615742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:09.639245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.640027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.640635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.642752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.643929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.644577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.646349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.653357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32bbf971-4477-4b86-a7eb-d5862cce3e19 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.332100 Oct 04 17:59:09.658881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1112/2150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:09.779916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:09.780777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:09.793381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.794546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.795293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.796329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:09.797074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:09.797728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:09.948219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.959860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.964517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:09.965777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ace8a5bb-4341-47ad-8231-791bd45e46cc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.190130 Oct 04 17:59:09.971359 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1113/2151] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:09.985753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5de3760e-9e98-4cc6-8410-150c4f230381 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd168430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.059594 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5de3760e-9e98-4cc6-8410-150c4f230381 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.085274 Oct 04 17:59:10.073551 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1114/2152] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:10.397732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.423502 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd229f1d-9f83-47f7-a19d-e13eeecfc423 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.823517 Oct 04 17:59:10.444107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1039/2153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:09 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:10.453020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.453780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.463908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.468900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.483076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.483931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.484517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.486551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.489628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.491265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.506852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.508010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.508773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.509902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.510609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.511278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.882747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.901669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.903396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:10.904675 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7a67510-472e-43e3-a299-187f86f6da1c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.466723 Oct 04 17:59:10.905589 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1115/2154] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:10 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:10.911578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:10.912759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:10.924975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.930664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.931501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:10.932728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:10.938635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:10.943790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.088379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.102799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb026644-75ad-4605-bd16-926fbce2fa8b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1276 microversion: 2.1 time: 0.195678 Oct 04 17:59:11.105235 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1116/2155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:10 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1276 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.112890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.115633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.127518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.129001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.131700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.133546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.135658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.136502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.289143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.314941 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-93211285-7d97-485a-87ae-b5e13e758310 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.861549 Oct 04 17:59:11.318848 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1040/2156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:10 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.330498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.334163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.354245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.355058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.355710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.356661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.357988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.359269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.425259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.443125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f6e86be-a898-43c1-95bf-be8efa0a2eff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.334891 Oct 04 17:59:11.445500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1117/2157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.454844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "tag": "495f3046-cb30-4555-84ea-c0369c0abbe7"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:11.475994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.476937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.477755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.491173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.495968 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] Creating event network-changed:495f3046-cb30-4555-84ea-c0369c0abbe7 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:11.505792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b2a30263-25c9-4086-b671-d4519a7e1b0d req-0d818152-09c6-4101-930c-d1271aad8e22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056584 Oct 04 17:59:11.507359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.507806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1118/2158] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:11.509487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:11.516305 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa165483-9ae3-4bab-899f-c452d3096ac8 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.195675 Oct 04 17:59:11.518920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1041/2159] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:11.524224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a15d4d48-e56f-4c87-98de-3ba80cbfb8dd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd1720d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.549104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abc06eaa-2e10-4b02-86ee-8fb6ec453548 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-42565962", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abc06eaa-2e10-4b02-86ee-8fb6ec453548 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action HTTP/1.1 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 617 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-42565962", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-42565962', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:11.563144 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 04 17:59:11.566840 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:11.577210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abc06eaa-2e10-4b02-86ee-8fb6ec453548 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:11.577210 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-abc06eaa-2e10-4b02-86ee-8fb6ec453548 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action" status: 400 len: 938 microversion: 2.1 time: 0.048237 Oct 04 17:59:11.578777 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1042/2160] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Oct 4 17:59:11 2022] POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action => generated 938 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:11.592729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.593512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.606957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.607696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.608374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.609310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.609912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.610786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.615820 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a15d4d48-e56f-4c87-98de-3ba80cbfb8dd tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.104316 Oct 04 17:59:11.617484 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1119/2161] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:11.649678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:11.946432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:11.947364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:11.967794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.978454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.979561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:11.981006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:11.982048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:11.983067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.359058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:12.370323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:12.378072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:12.384879 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-becccbf9-4b67-41e0-b883-aaa9f87e1903 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.441192 Oct 04 17:59:12.385633 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1120/2162] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:12.390423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:12.398453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:12.407742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.413959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.415226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.416443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.416998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.417525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.460409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:12.470234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-505c1637-b2e2-4256-b428-5400127ef7ab tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.889635 Oct 04 17:59:12.473913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1043/2163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:11 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:12.484515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:12.485385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:12.503332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.504579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.505188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.506140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.507880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.510849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.737554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:12.751797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b149309b-5674-4a30-a5d8-babaf9908d16 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.363919 Oct 04 17:59:12.752667 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1121/2164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:12 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:12.764340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:12.766818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:12.787002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.788114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.789639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.791621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:12.792436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:12.793020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:12.819718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:12.999152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.014699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f04f7439-e83f-4a2c-87b4-5cc2bb6301ff tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.539443 Oct 04 17:59:13.026362 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1044/2165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:12 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:13.039302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.040226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.046754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.047635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.048251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.049124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.049733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.050345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.262375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.278873 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25bfe09b-e24b-4925-9a7f-1615a430906c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.524290 Oct 04 17:59:13.281926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.296412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.304657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1122/2166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:12 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:13.305989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.307765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-af5d5470-454d-43e2-ac52-c320e42b7a44 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.280016 Oct 04 17:59:13.308851 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1045/2167] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:13.313804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e245b4a9-0c1a-40d3-83f6-8300ede13507 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:13.318945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a967c96-de53-44a4-a26b-abef3d444020 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd1e6e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e245b4a9-0c1a-40d3-83f6-8300ede13507 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action HTTP/1.1 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 285 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.322414 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 17:59:13.325522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:13.338326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e245b4a9-0c1a-40d3-83f6-8300ede13507 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:13.340564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e245b4a9-0c1a-40d3-83f6-8300ede13507 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action" status: 400 len: 619 microversion: 2.1 time: 0.029146 Oct 04 17:59:13.341178 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1046/2168] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Oct 4 17:59:13 2022] POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action => generated 619 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:13.355859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.356481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.381689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a967c96-de53-44a4-a26b-abef3d444020 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.075804 Oct 04 17:59:13.383842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.384350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.384793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.385627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.386055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.386486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.391056 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1123/2169] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:13.415558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.417189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.435567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.437712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.439344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.440597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.443401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.444642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.778416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:13.792486 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-acd600e3-43e2-4440-a5ef-c1743430a3f2 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.440177 Oct 04 17:59:13.793139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1047/2170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:13.811037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:13.811682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:13.822380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.822890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.823339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:13.824077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:13.824542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:13.824979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.129718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.152216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.155290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.159847 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e50a2519-163d-4f5e-b526-a7dcd1784bdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.749067 Oct 04 17:59:14.171437 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1124/2171] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:59:14.177486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.178666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.188956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.189467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.196785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.197681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.198274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.198650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.263072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.274677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2211141-3a21-42c1-a683-87b4a843d0eb tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.480401 Oct 04 17:59:14.298079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1048/2172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:13 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:14.303824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "tag": "870ee857-9b6c-4c1c-9671-5e90682586af"}, {"server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "name": "network-vif-unplugged", "status": "completed", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:14.335237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.335758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.336223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.354514 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Creating event network-changed:870ee857-9b6c-4c1c-9671-5e90682586af for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:14.359381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] Creating event network-vif-unplugged:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h1-831194-21 Oct 04 17:59:14.369998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fefd932f-6bb8-4f34-bc37-d076279338f7 req-de75263f-1f55-4086-b1f6-45f573ed741e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.069454 Oct 04 17:59:14.371641 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1049/2173] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:14.378351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.380103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.390759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.391718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.392660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.393809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.394671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.395777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.541590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.550310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57c71353-b169-4935-bcee-1f95521ebd91 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.377018 Oct 04 17:59:14.555520 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1125/2174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:14.574999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.576270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.588093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.591735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.593270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.595249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.596181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.596872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.707293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.721404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.725188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:14.726765 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d12da583-fac9-41dd-852a-ade7960026dc tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.169946 Oct 04 17:59:14.727862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1126/2175] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:14.733482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0035066c-ced3-4dfc-bedd-cf4016dfc11b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd041d30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:14.796396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0035066c-ced3-4dfc-bedd-cf4016dfc11b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.067185 Oct 04 17:59:14.797281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1127/2176] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:14.811325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-911752341"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:14.814640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:14.822171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.823024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.823978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:14.824956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:14.825654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:14.826416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.042096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.055724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e69744c7-5299-4ae2-935b-9f1aa48454c5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.682552 Oct 04 17:59:15.072219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1050/2177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:14 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:15.188541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32d763e1-36c0-4f5e-a465-e472d38226f5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action" status: 202 len: 0 microversion: 2.1 time: 0.366819 Oct 04 17:59:15.193734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.194393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.196375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:15.197785 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1128/2178] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:14 2022] POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:59:15.212975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-443714958"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:15.215698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.216454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.217107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.218093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.218770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.218894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.219505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.232448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.232949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.233390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.234192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.234653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.235080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.275337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Cannot 'createImage' instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d while it is in task_state image_snapshot_pending Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action HTTP/1.1 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 84 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-443714958"}} Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'createImage' instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d while it is in task_state image_snapshot_pending Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-443714958'}}} Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 17:59:15.277021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d while it is in task_state image_snapshot_pending Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d while it is in task_state image_snapshot_pending Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 409 to user: Cannot 'createImage' instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d while it is in task_state image_snapshot_pending {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd27daa4-eaf8-453d-a2d6-f742221ae303 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action" status: 409 len: 167 microversion: 2.1 time: 0.078072 Oct 04 17:59:15.283886 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1129/2179] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:15 2022] POST /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d/action => generated 167 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:15.289582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9a8ac52-af1a-49c5-888d-080fddb974a6 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdbd21e5e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.475203 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9a8ac52-af1a-49c5-888d-080fddb974a6 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/images/c864b063-b05a-4f61-bc81-fc2c414597bf" status: 204 len: 0 microversion: 2.1 time: 0.191029 Oct 04 17:59:15.475944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1130/2180] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:15 2022] DELETE /compute/v2.1/images/c864b063-b05a-4f61-bc81-fc2c414597bf => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:15.486460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.487426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.506197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.507152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.507687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.508555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.509092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.509599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.526678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:15.617957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.633055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.636699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.639986 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d51dd061-5a83-4838-a73f-90687766b580 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.450272 Oct 04 17:59:15.642939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1051/2181] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:15 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:59:15.651544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.652566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.667988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.668747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.669966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.671450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.672163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.673485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.904965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:15.921384 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9e68861-dd06-40fb-b518-1f33a769cf9c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.440794 Oct 04 17:59:15.929624 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1131/2182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:15 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:15.934712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:15.935553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:15.942858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.944269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.945077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:15.946085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:15.948310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:15.948989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.051902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.063929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.065389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.066757 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c48d87fb-4e8e-49ed-a0d3-28ed720c3fb1 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.135789 Oct 04 17:59:16.068326 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1132/2183] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:15 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:16.083644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24b57c7f-e592-4ba3-bc81-ef802790fb8c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd21e9d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.166176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24b57c7f-e592-4ba3-bc81-ef802790fb8c tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.096548 Oct 04 17:59:16.174468 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1133/2184] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:16.186300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3991e40-32c7-4df3-9eb4-e29000bf8180", "tag": "90c6ffdf-46d8-4042-badc-9cb08c77e977"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:16.197218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.198052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.198545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.212209 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] Creating event network-changed:90c6ffdf-46d8-4042-badc-9cb08c77e977 for instance c3991e40-32c7-4df3-9eb4-e29000bf8180 on n-h2-831194-21 Oct 04 17:59:16.218912 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d679b6a6-2d13-4055-97a6-9f77e7c59aee req-8955261c-befc-4570-be37-06bdaa107146 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038249 Oct 04 17:59:16.221877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1134/2185] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:16.226447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.227223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:16.234635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.235305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.235758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.236483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.236947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.237384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.262106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.274410 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2495b5a-ff6a-448c-817f-017a729e5694 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1532 microversion: 2.1 time: 0.629274 Oct 04 17:59:16.298508 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1052/2186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:15 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1532 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:16.454624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:16.478618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.479431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.480061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.494135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] Creating event network-changed:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h1-831194-21 Oct 04 17:59:16.496729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:16.502271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05c9c2fc-3064-4554-9ef3-a1b0fedd3f23 req-3099b6d0-3fe3-4126-a704-db73f2941330 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052989 Oct 04 17:59:16.503635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1053/2187] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:16.508607 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9c565e7-37b5-4f00-9610-546c29d15c1d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.287548 Oct 04 17:59:16.509199 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1135/2188] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:16.677626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.682123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:16.690442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.691957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.693179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.694411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.695112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.695757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.951178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:16.952045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:16.969281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.969781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.975569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:16.976539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:16.978605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:16.979544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.220714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.237529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.239755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.241026 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ccd1260-4703-46fe-b8b6-d569c50b410a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.572515 Oct 04 17:59:17.241613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1054/2189] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:17.248770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.249663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.260590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.261410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.262068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.271293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.277194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.278000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.438654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.453870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.459011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.462576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f206012-be54-4976-b964-18fb325fe5c3 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.217565 Oct 04 17:59:17.487952 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1055/2190] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:17.497000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a85bab48-ecb0-4b47-8210-a73728a47fde tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd9d9790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.507315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.515797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a42a2a9b-cd5b-4948-824b-fd7f60e0e675 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.568611 Oct 04 17:59:17.530511 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1136/2191] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:16 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:17.539164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.540232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.547210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.548055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.548595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.549420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.550588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.552656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.564794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a85bab48-ecb0-4b47-8210-a73728a47fde tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.074135 Oct 04 17:59:17.574486 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1056/2192] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:17.579941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:17.580538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:17.590464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.591245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.591893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.592841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:17.593458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:17.594585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:17.765121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.774208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:17.779502 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0231f14-f34f-48fa-aa61-0d89f34ddbe0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1538 microversion: 2.1 time: 0.247671 Oct 04 17:59:17.780273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1137/2193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1538 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:17.796781 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5fdd52b-ca53-4141-9976-3b12f42ce456 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.221114 Oct 04 17:59:17.797558 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1057/2194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:17 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:18.269670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.270386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.280877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.281358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.282371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.283103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.283569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.284005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.498429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.500142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.514672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.515620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.516227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.517121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.517731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.519033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.674659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.688039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.689724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.698185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec379060-59be-4b84-b54b-3182e86a688d tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.204203 Oct 04 17:59:18.699362 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1058/2195] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:18.704217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:18.704836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:18.712864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.713364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.713799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.714710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:18.715258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:18.716324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:18.899239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:18.917029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7aa049c8-1e1f-4eaf-a805-fc21512cfae1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.216275 Oct 04 17:59:18.917849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1059/2196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:18.929769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4a334ef9-73ee-40b8-a220-b22941f8a1ed tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd9d9790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.046884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4a334ef9-73ee-40b8-a220-b22941f8a1ed tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.127749 Oct 04 17:59:19.048444 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1060/2197] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:19.053619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.054407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.061295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.081472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.088239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.089115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.089622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.090096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.090466 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b3a091f-6dad-4721-8923-a0bdbdf47cd1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.824222 Oct 04 17:59:19.090816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.091405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.091732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.091876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1138/2198] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:18 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:19.096817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.097577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.118347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.119199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.120043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.120924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.121528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.122292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.450870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:19.460163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57bf9e3a-2398-4f8e-bc99-b278d86e1cb5 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.367098 Oct 04 17:59:19.470996 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1139/2199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:19.731119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:19.731741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:19.748058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.748690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.749264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:19.750120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:19.752297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:19.756860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.034983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.045767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.047276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.048479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef540f85-0d80-4f63-9e8f-3129916b8fe7 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.321645 Oct 04 17:59:20.049048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1140/2200] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:20.068068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.068852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:20.092728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.093239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.096352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.098334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.098938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.099967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.100585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.119595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a7b27a6-b1a4-4b25-8dd3-b732e15d9f1b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1538 microversion: 2.1 time: 1.069767 Oct 04 17:59:20.120471 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1061/2201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:19 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1538 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:20.134485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-251f87c2-593c-4f23-9ae0-3c6e35d767c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbdc640d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.228675 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-251f87c2-593c-4f23-9ae0-3c6e35d767c5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.103314 Oct 04 17:59:20.230963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1062/2202] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:20.251935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.254794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:20.277126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.278194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.278848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.280842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.282545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.283681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.811599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.827155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.828805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.833444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eebc9981-0e7f-45d8-901b-532487fbf04e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.598167 Oct 04 17:59:20.846683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1063/2203] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:20.846683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:20.857320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:20.857752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:20.883854 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72a734fd-fa4f-4b77-9073-3c24f5b87c0b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.811577 Oct 04 17:59:20.885114 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1141/2204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:20.888912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.892514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.893073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:20.893984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:20.896062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:20.896756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.087408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.088690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.114874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.116022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.116897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.117763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.118344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.119001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.210134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:21.399459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.415389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.423715 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1efd0df-635d-400b-9575-f29e37a28609 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.582577 Oct 04 17:59:21.431509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.434086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1064/2205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:20 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:21.437161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.439334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-530a6bf8-28fb-4c99-a995-8e70bcd69b42 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.365246 Oct 04 17:59:21.443487 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1142/2206] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:21.446848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.457018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.464122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d7af046e-c7e6-4fe4-b4a9-1e0a78a48783 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd3893a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.474699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.475909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.476942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.477994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.479605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.480277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.513139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:21.544097 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d7af046e-c7e6-4fe4-b4a9-1e0a78a48783 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.096836 Oct 04 17:59:21.552994 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1143/2207] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:21.713422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:21.723087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e83c2db-cfb0-4dbc-b6ad-dd9248e949b4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1520 microversion: 2.1 time: 0.287733 Oct 04 17:59:21.738582 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1065/2208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1520 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:21.752565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.753441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.768938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.769664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.771200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.772105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.772711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.773309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.839153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:21.864604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:21.865352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:21.888595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.891643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.892147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.892919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:21.893394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:21.893864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:21.998623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e3bb46e-d49e-457d-8b09-3ff23d30e39d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 204 len: 0 microversion: 2.1 time: 0.249656 Oct 04 17:59:22.001099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1144/2209] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:21 2022] DELETE /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:22.010984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.012254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.022077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.023646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.024345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.025475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.026297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.026957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.181665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.191739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.195242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.196807 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc339ff1-6947-46d4-b237-5926dcf71492 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.336679 Oct 04 17:59:22.198002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1066/2210] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:21 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:22.204397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.205476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.237667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.242548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.243292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.244255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.247517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.249021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.333684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.344412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-242fce0d-6634-49eb-af9b-a71a0a705b0f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.341585 Oct 04 17:59:22.360512 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1145/2211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:22.471449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.472566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.487635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.488495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.490271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.491291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.496057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.498587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.505641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.564867 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89231bb6-037b-477d-805a-f975c20eb07a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1526 microversion: 2.1 time: 0.365495 Oct 04 17:59:22.568530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1067/2212] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1526 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:22.576140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.587518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:22.593763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.599813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.600503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.601310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:22.601980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:22.608441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:22.785601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.795162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.799775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.806461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b284e7a-e147-4244-9d93-18817c17de02 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.236690 Oct 04 17:59:22.808705 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1068/2213] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:22.829659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-62066d11-da9c-480a-bb5b-4d6f79528b3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbdb8c5e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:22.858080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:22.874423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-167f8bd0-98cc-462a-bf54-8437922cc656 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.408300 Oct 04 17:59:22.903608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1146/2214] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:22.959870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-62066d11-da9c-480a-bb5b-4d6f79528b3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.149017 Oct 04 17:59:22.971009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1069/2215] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:22 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:23.223178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.225289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.237010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.238031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.238733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.241280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.243753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.244372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.372240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.372882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.393669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.398954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.407101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.408232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.408874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.409966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.562921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.574524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.575964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.577175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97ab8b2b-47de-4ed6-97fc-c72fabfc2f3f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.358275 Oct 04 17:59:23.590723 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1147/2216] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:23.606385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.607208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.621563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.622105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.622532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.625786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.626316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.626764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.702065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:23.713041 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86589036-b89e-4511-8a48-e4b0f169ed95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.345386 Oct 04 17:59:23.723457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1070/2217] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:23.836727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:23.837696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:23.857296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.860047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.862976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:23.866910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:23.867684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:23.870245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.022134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.054264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f38360fd-c0fb-4b9c-a576-5292bbd7bcaa tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1526 microversion: 2.1 time: 0.459709 Oct 04 17:59:24.055650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1148/2218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1526 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:24.074657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:24.075318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:24.096019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.111074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.111905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.114553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.115722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.118900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.134631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.147628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.151818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.157038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-140d0420-dab0-4a32-9e3c-9fc5009054dd tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.325877 Oct 04 17:59:24.178820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1071/2219] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:23 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:24.184323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a869bfa-3f79-42d6-a4fe-f2db0f12d03f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd827280>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:24.260314 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a869bfa-3f79-42d6-a4fe-f2db0f12d03f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.079747 Oct 04 17:59:24.261263 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1072/2220] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:24 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:24.267221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fdcf34-7fa5-4972-b730-26aa3634cd8d", "name": "network-vif-plugged", "status": "completed", "tag": "ab0f6519-ce19-41b2-96f4-5b800acd8c87"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:24.279558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.280948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.281610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.313764 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] Creating event network-vif-plugged:ab0f6519-ce19-41b2-96f4-5b800acd8c87 for instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d on n-h2-831194-21 Oct 04 17:59:24.321317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b4cf3b54-5385-4cbe-ba72-7524f5d45efe req-2cf5abe7-c51a-474f-861c-c154f523b926 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057547 Oct 04 17:59:24.322765 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1073/2221] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:24.502138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:24.512908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d636b289-e3fc-41c5-9659-90f7263ce66c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.454901 Oct 04 17:59:24.536413 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1149/2222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:24 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:24.607858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:24.608876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:24.629261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.629963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.630434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.631251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.631750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.632178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.741777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:24.743591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:24.762418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.764897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.767750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:24.770641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:24.771937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:24.773422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.166134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.183202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdf1b343-e217-4f26-934b-b37836e57549 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.449013 Oct 04 17:59:25.187563 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1150/2223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:24 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:25.201784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.204505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:25.222624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.225024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.225880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.226799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.227430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.232967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.241701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.252481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.258622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.263143 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68eb6f00-319b-4fcd-a0c7-a673daf76baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.658560 Oct 04 17:59:25.265120 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1074/2224] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:24 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:25.283221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.284490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:25.297927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.299032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.300649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.303727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.304639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.307469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.480358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.493346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.495492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.496316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e319cf4e-4e98-42ea-9383-f5cc3e31e41f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.230095 Oct 04 17:59:25.502789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1075/2225] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:25.508882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9afa96b8-560d-4969-ae51-9bd2988101d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd7ed5e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.577141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9afa96b8-560d-4969-ae51-9bd2988101d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.073010 Oct 04 17:59:25.577989 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1076/2226] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:25.596388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:25.607552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f452f58-9e64-4528-9fdd-3cb58a45abc1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 200 len: 1526 microversion: 2.1 time: 0.418624 Oct 04 17:59:25.607909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:25.623039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1151/2227] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 1526 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:25.623811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:25.626082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.630062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.631464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.632247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.633612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.639405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.808786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40fdcf34-7fa5-4972-b730-26aa3634cd8d", "name": "network-vif-deleted", "tag": "ab0f6519-ce19-41b2-96f4-5b800acd8c87"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:25.850939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:25.861392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:25.861867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:25.908182 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] Creating event network-vif-deleted:ab0f6519-ce19-41b2-96f4-5b800acd8c87 for instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d on n-h2-831194-21 Oct 04 17:59:25.929763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-954a6a7b-6246-40b0-9fc8-6eca66b14d03 req-ea292eac-6638-4553-b169-efaf09092273 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120851 Oct 04 17:59:25.935911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1152/2228] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:26.221925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:26.223148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:26.255732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.256474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.257135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.258291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.261213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.262282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.344968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:26.380137 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-01db4cca-b649-4045-ab60-5b6ab1ca5883 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.793386 Oct 04 17:59:26.383938 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1077/2229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:25 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:26.404564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:26.407990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:26.421103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.421877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.422486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.423366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.423979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.424569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.714067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:26.731782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:26.735684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:26.740265 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46252e7e-100e-4aa4-a746-edefa5444834 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.354904 Oct 04 17:59:26.750341 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1078/2230] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:26 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:26.762506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3991e40-32c7-4df3-9eb4-e29000bf8180", "name": "network-vif-plugged", "status": "completed", "tag": "90c6ffdf-46d8-4042-badc-9cb08c77e977"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:26.804003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.805344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.805895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.830116 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] Creating event network-vif-plugged:90c6ffdf-46d8-4042-badc-9cb08c77e977 for instance c3991e40-32c7-4df3-9eb4-e29000bf8180 on n-h2-831194-21 Oct 04 17:59:26.843907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b8bff629-efe1-4c29-a653-a91136fcd1ce req-3207b295-07e4-4bd7-84d1-d523eeafae18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092293 Oct 04 17:59:26.845065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1079/2231] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:26.860631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:26.862722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:26.886923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.901764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.902968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:26.911658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:26.913469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:26.915129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.001199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.021364 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f6dc68f-8e64-4e28-b575-5fd594d894a9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.813754 Oct 04 17:59:27.039486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1153/2232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:26 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:27.075144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af9d5d4f-5441-4568-9f16-2beba0d6caab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd168ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.159614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af9d5d4f-5441-4568-9f16-2beba0d6caab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.117630 Oct 04 17:59:27.161395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1154/2233] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:27.166872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.167688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.175467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.176664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.176664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.186229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.186229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.186229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.197134 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d HTTP/1.1 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d'} Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.199193 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 17:59:27.203702 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:27.205916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:27.208174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84bcf250-cb16-482a-9578-cdb826f718d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 404 len: 111 microversion: 2.1 time: 0.044649 Oct 04 17:59:27.216691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1155/2234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:27.222868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6f15e98-5fe9-4ccc-80cc-ec6910ada076 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'create', calling method: .version_select at 0x7fbdbd1680d0>, body: {"keypair": {"name": "tempest-keypair-24428751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNT3UoeXTJJwTg80QavIeHpuRK5paQWj8TiT367lN67/An4M/KmOapJcK4TPixzITkwtkc9w4aQUzjMiazcO80/jdsxAtKt3ASx16tXBF0OA1iwvrKDKgSUuQ2aaqiHHw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:27.243867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b6f15e98-5fe9-4ccc-80cc-ec6910ada076 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:27.255853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b6f15e98-5fe9-4ccc-80cc-ec6910ada076 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for user 9c110945b1ec49fb91c8d3e67a6c2178 and project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:27.294320 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6f15e98-5fe9-4ccc-80cc-ec6910ada076 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.075906 Oct 04 17:59:27.295218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1156/2235] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 17:59:27 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:27.356628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.383006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.384643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.387165 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-494a0978-6e28-43b5-a3cb-3e4910c9d3f9 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.539602 Oct 04 17:59:27.388664 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1080/2236] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:26 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:27.416219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.416219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.424450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.425194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.426930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.427886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.428813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.429569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.778013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:27.779413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:27.792379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:27.799611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.800480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.803669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.805553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:27.808871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:27.809546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:27.878653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:27.894197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5125b43-6110-491b-a1b6-1190c80e2f4b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.484691 Oct 04 17:59:27.895572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1157/2237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:28.055877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:28.057908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:28.080213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.081400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.082112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.084005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.084964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.086540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.422779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.438723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d27f2a0b-292b-4bba-a594-95aa59c76b82 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1318 microversion: 2.1 time: 0.389400 Oct 04 17:59:28.449862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1158/2238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:28 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:28.460632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb3d0cce-a62a-464c-8573-f2a559ec7d03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd8fd280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:28.529816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb3d0cce-a62a-464c-8573-f2a559ec7d03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1440 microversion: 2.1 time: 0.089023 Oct 04 17:59:28.530638 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1159/2239] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:28 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1440 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:28.544261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:28.544891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:28.553115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.553619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.554348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.555079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.555542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.555979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.655726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.672275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.674851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.677323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b27436b-215a-48e4-852c-606ff1bc96c4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.136410 Oct 04 17:59:28.699109 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1160/2240] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:28 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:28.708436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.718114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.719570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:28.720998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00975d09-5eef-4db3-a314-fc6060ae04a9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1815 microversion: 2.25 time: 0.948429 Oct 04 17:59:28.721559 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1081/2241] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:27 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1815 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:28.892280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1822744648", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:28.918569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:28.919190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:28.928394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.929195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.929642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.930387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:28.930849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:28.931274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:28.969371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:29.201762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.212199 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76746c22-76d2-4816-898e-b9ab81cb1007 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.297185 Oct 04 17:59:29.213898 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1082/2242] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:28 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:29.221004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-plugged", "status": "completed", "tag": "495f3046-cb30-4555-84ea-c0369c0abbe7"}, {"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-plugged", "status": "completed", "tag": "870ee857-9b6c-4c1c-9671-5e90682586af"}, {"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-plugged", "status": "completed", "tag": "f7f72c8c-d814-43cb-a946-3bbf10cf4992"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:29.233938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.234592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.235201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.248629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Creating event network-vif-plugged:495f3046-cb30-4555-84ea-c0369c0abbe7 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:29.249274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Creating event network-vif-plugged:870ee857-9b6c-4c1c-9671-5e90682586af for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:29.249777 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] Creating event network-vif-plugged:f7f72c8c-d814-43cb-a946-3bbf10cf4992 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:29.257389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-cde795b6-2dcc-40ce-bc0c-c5f760817852 req-a56f339c-5153-49e8-aeb5-aa868a068c8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.041619 Oct 04 17:59:29.265924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1083/2243] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:29.361040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:29.361553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:29.362199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:29.362758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:29.363469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:29.374239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.380767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.381677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.382919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.383603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.385120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.403327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:29.411632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Getting quotas for project 3b49a1b90e7b4efbbcfa61ecd450d4ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:29.419689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Getting quotas for user 4e5a98dffe494800adbd9c540c33588b and project 3b49a1b90e7b4efbbcfa61ecd450d4ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:29.434473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:29.437104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:29.469710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.471400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:29.478958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.480481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.481337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.482319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.483016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.483660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.506856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8a1a254-23e0-4890-ae2c-21a982eeaa7f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806392 Oct 04 17:59:29.510000 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1161/2244] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:29.522456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9d1c5b3-8be0-4e0e-9e43-f1300dab74e7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.523087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9d1c5b3-8be0-4e0e-9e43-f1300dab74e7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:29.612440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9d1c5b3-8be0-4e0e-9e43-f1300dab74e7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.625584 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9d1c5b3-8be0-4e0e-9e43-f1300dab74e7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1219 microversion: 2.1 time: 0.110853 Oct 04 17:59:29.626554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1162/2245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1219 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:29.634583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69911ce6-0592-4bef-8785-d090d32a43ce tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd33f0d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.726979 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69911ce6-0592-4bef-8785-d090d32a43ce tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1449 microversion: 2.1 time: 0.099018 Oct 04 17:59:29.728491 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1163/2246] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1449 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:29.733618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.734745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:29.746621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.747124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.747577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.750345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.750834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.752772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.766029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.775756 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76dde499-d11a-446c-8b59-8bdb043f0a10 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1508 microversion: 2.1 time: 0.311429 Oct 04 17:59:29.788362 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1084/2247] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:29.805735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c04a9254-38bd-4ebc-baed-4b23ffa5f3fc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbdd72550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.885893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c04a9254-38bd-4ebc-baed-4b23ffa5f3fc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 200 len: 1449 microversion: 2.1 time: 0.086089 Oct 04 17:59:29.887733 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1085/2248] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 1449 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:29.893244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.894228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:29.905018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.905599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.906479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.907557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:29.908319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:29.909032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:29.964988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.975674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.978533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:29.979276 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-385f91ac-47a8-402c-b25b-3f6b2ec4ce97 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.249146 Oct 04 17:59:29.979515 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1164/2249] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:29.986140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:29.986784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.000863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.001286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.001760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.002918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.003333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.003946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.027904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:30.113459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.125150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.126928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.128160 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1565cb7-5c6f-4f18-963c-0ad319ef4673 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1805 microversion: 2.25 time: 0.239148 Oct 04 17:59:30.129424 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1086/2250] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1805 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:30.134526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7e7d29d-9c85-4b85-b26c-52e6575051f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbcfc03a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.594246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.607645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ee86b77-99cf-43e5-927e-ee9b92ce9d73 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1508 microversion: 2.1 time: 0.626655 Oct 04 17:59:30.610594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1165/2251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:29 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1508 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:30.617352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c95f6116-c02c-4eec-9dda-db469edcd80d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '.version_select at 0x7fbdbd19cd30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.621258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95f6116-c02c-4eec-9dda-db469edcd80d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.621940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95f6116-c02c-4eec-9dda-db469edcd80d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.635518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c95f6116-c02c-4eec-9dda-db469edcd80d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.690702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c95f6116-c02c-4eec-9dda-db469edcd80d tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.074067 Oct 04 17:59:30.693026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1166/2252] 10.222.0.42 () {60 vars in 1184 bytes} [Tue Oct 4 17:59:30 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:30.731667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.733138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.746653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.747755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.748204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.748922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.749378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.749809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.934395 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7e7d29d-9c85-4b85-b26c-52e6575051f9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 204 len: 0 microversion: 2.1 time: 0.803618 Oct 04 17:59:30.935711 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1087/2253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:30 2022] DELETE /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 0 bytes in 806 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:30.943352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:30.951491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.960627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.961124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.961578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.962357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.962463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:30.962825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.963285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.972806 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be60f4ae-615d-490d-8ffc-814e71f1a3b9 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1354 microversion: 2.1 time: 0.278921 Oct 04 17:59:30.974517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1167/2254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:30 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1354 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:30.980484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:30.981894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:30.990084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.990788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.991615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:30.992485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:30.993096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:30.994329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.022749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:31.048501 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56a5052d-9dcd-4998-bcce-f0f0a94016f3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "PUT /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1080 microversion: 2.1 time: 0.111523 Oct 04 17:59:31.049136 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1088/2255] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 17:59:30 2022] PUT /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1080 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:31.054171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.055138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.074229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.075252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.076858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.077599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.078141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.078581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.102215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.111884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dd634b3c-2a9c-45dd-bd9c-de9151a31794 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1271 microversion: 2.1 time: 0.136059 Oct 04 17:59:31.112689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1168/2256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:30 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1271 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:31.119645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1844167959", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:31.180287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] validate_networks() for [('fce7ff1e-70f3-4550-b825-58c99b6e82a7', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:31.242080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:31.256211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9bb78644-42c0-4cc7-b9f2-3ddb95b7588f tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 2426 microversion: 2.25 time: 0.205742 Oct 04 17:59:31.256800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1089/2257] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 2426 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:31.261284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.261789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.267513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.268003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.268472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.269145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.269606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.270670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.298974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:31.394359 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c188ceb-9a1e-4046-af00-db8c79c587aa tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 204 len: 0 microversion: 2.1 time: 0.133533 Oct 04 17:59:31.395027 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1090/2258] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:31 2022] DELETE /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:31.401271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.402185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.408461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.409137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.409722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.412043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.412941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.413504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.491014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.499668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.501207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.502614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b3acd6a-1ade-4dec-bac8-dd1aa21f80f0 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.105747 Oct 04 17:59:31.503107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1091/2259] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:31.508850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.509958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.516433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.516923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.517359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.518265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.518874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.519553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.605415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:31.605932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:31.606331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:31.606824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:31.607262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:31.617107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.617602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.618081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.618847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.619486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.620175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.638531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:31.643589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for user 9c110945b1ec49fb91c8d3e67a6c2178 and project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:31.653929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:31.656367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:31.658551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:31.661769 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3c7cea4-2a32-4699-af60-4c399d2b97ea tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1506 microversion: 2.1 time: 0.157710 Oct 04 17:59:31.662367 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1092/2260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:31.667545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.668322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.674343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.675119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.675803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.677449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.678925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.680303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.707092 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2596dceb-8edd-4b06-80fe-f5a9654cbde7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.592317 Oct 04 17:59:31.708080 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1169/2261] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:31.713367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2083150643", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "c33ce19a-c198-46b8-a446-c121fdf53f1c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:31.776329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] validate_networks() for [('c33ce19a-c198-46b8-a446-c121fdf53f1c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:31.840121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:31.855438 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d76be7d-a696-4f87-aa9d-e699dbad2610 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 2426 microversion: 2.25 time: 0.191863 Oct 04 17:59:31.866365 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1093/2262] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 2426 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:31.872871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:31.873489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:31.881525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.882289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.882730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:31.883421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:31.883894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:31.884320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.042217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.051092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d468e590-594c-4deb-a9e0-05b54c365f1d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1506 microversion: 2.1 time: 0.183602 Oct 04 17:59:32.051902 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1094/2263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:31 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1506 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.056883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d94033f0-c43b-4ad7-ad6c-881b15ef16d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.057508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d94033f0-c43b-4ad7-ad6c-881b15ef16d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.131572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d94033f0-c43b-4ad7-ad6c-881b15ef16d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.138920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d94033f0-c43b-4ad7-ad6c-881b15ef16d0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1225 microversion: 2.1 time: 0.085804 Oct 04 17:59:32.139528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1095/2264] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.150446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.150943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.157171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.157592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.158901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.158901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.159385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.159814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.216298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:32.217211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:32.217724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:32.218595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:32.219014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:32.231244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.231611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.232103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.232846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.233720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.234712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.254055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lazy-loading 'services' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:32.256600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:32.262186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Getting quotas for user 2e3ae7cc3d854e0690d8354dbca1e6c6 and project 138709a891374e24af26f00fe61b2125. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:32.276440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:32.278928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:32.334663 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e9eac3e-f642-41d8-b0d1-d14bb6fe2931 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625406 Oct 04 17:59:32.335307 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c040cbfe-7c6a-4d7b-94a9-7987b035488e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments/246cf38a-e996-4fa8-9efe-3426a9d09f49" status: 202 len: 0 microversion: 2.25 time: 0.192088 Oct 04 17:59:32.336492 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1096/2265] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Oct 4 17:59:32 2022] DELETE /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments/246cf38a-e996-4fa8-9efe-3426a9d09f49 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:32.339479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1170/2266] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:32.347362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:32.351042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.352156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.354738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.361179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.362055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.362169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.362872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.363330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.364559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.377191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.377692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.378164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.378877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.379388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.379999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.482821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:32.483257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:32.483928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:32.484248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:32.485270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:32.569099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.576065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.576557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.577003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.577708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.578209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.578649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.590404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.600971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-38c35419-4bb9-4e9a-aadb-bc9d754c82d7 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1804 microversion: 2.1 time: 0.262558 Oct 04 17:59:32.602081 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1097/2267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1804 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.617617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.618407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.627132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6f9f1aa9-ae8d-43e4-89f5-8ff77a478992 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "POST /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180/action" status: 202 len: 1112 microversion: 2.1 time: 0.283159 Oct 04 17:59:32.627933 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1171/2268] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:32 2022] POST /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180/action => generated 1112 bytes in 288 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 17:59:32.632133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.634190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.638976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.639627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.640444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.642874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.643460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.643970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.653078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.653881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.654340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.655054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.655516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.656195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.687301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5944fd4f-ddcb-4c73-aac9-bee5f0f3a35c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.053591 Oct 04 17:59:32.689900 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1172/2269] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:32.694382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3547a334-8074-465d-a5af-149011321a71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.694999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3547a334-8074-465d-a5af-149011321a71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.728814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.736737 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3aadd51-80e6-450d-82f5-55acba350cff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1279 microversion: 2.1 time: 0.133382 Oct 04 17:59:32.737510 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1098/2270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1279 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.759211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.759917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.767439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.768135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.768569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.769316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.769772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.770853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.844981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.855696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.857526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.859320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37564615-bdf3-4e7c-b478-55ea90a5a2b6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.120056 Oct 04 17:59:32.860177 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1099/2271] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:32.872409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.872997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.883974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.884478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.885112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.886036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.886575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.887083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.888614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3547a334-8074-465d-a5af-149011321a71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:32.901856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3547a334-8074-465d-a5af-149011321a71 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1208 microversion: 2.1 time: 0.212517 Oct 04 17:59:32.903177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1173/2272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1208 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:32.909018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.911424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.918106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.918602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.919047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.920392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.920953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.921189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.933526 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc334b42-7ba1-415d-be8d-7746cfddaa7e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f/ips" status: 200 len: 218 microversion: 2.1 time: 0.066323 Oct 04 17:59:32.934464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1100/2273] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f/ips => generated 218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:32.948377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:32.948894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:32.956883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.958434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.959070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.959894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:32.960751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:32.961342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:32.992184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:33.056972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:33.114163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df03d99c-f529-4b04-84f8-85bcddf912c2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 204 len: 0 microversion: 2.1 time: 0.167975 Oct 04 17:59:33.115465 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1101/2274] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:32 2022] DELETE /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:33.139690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.143294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.157856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.158722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.159402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.160338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.162085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.162687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.166059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.186211 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e7dde59b-9369-421c-b731-21f140016da6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.281753 Oct 04 17:59:33.186799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1174/2275] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:32 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:33.193815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.194639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.223816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.225294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.226200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.228032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.228713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.229306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.337757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.348561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebb0a090-2ec8-4646-b722-efa88f3af9f0 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1277 microversion: 2.1 time: 0.159186 Oct 04 17:59:33.350079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1175/2276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:33.399568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.407749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c76029fa-1e92-40ec-951d-e8318cbbb886 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1810 microversion: 2.1 time: 0.287526 Oct 04 17:59:33.408338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1102/2277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:33.700670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.702993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.710108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.710599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.711033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.711728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.712388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.712817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.745104 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d408f36c-cf4f-44a2-9ba5-c7624b6dc69a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.048213 Oct 04 17:59:33.745665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1176/2278] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:33.761722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.762387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.768482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.768970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.769406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.770307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.770766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.771193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.839127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.846973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f9ebf780-f15b-4842-ba4b-d38dded5cae6 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1289 microversion: 2.1 time: 0.089201 Oct 04 17:59:33.847729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1103/2279] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:33.887568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.888182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.894335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.894819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.895311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.896111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.896585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.897005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.928016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:33.928591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:33.935110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.935594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.936028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.936726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:33.937178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:33.937599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:33.966952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.979785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.981239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:33.982468 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82dc1796-948a-4eb8-a893-1374e7cfc6fb tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.098832 Oct 04 17:59:33.983025 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1177/2280] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:34.008704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:34.017878 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ecc55b1d-1f04-49b3-8f75-f47f6cdbcf3f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1260 microversion: 2.1 time: 0.094806 Oct 04 17:59:34.018614 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1104/2281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:33 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1260 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:34.215578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.216194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.223018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.223556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.224376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.225098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.225558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.226038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.320154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe661fe-d8ea-4211-afaf-0c7461c6a7bc", "name": "network-vif-unplugged", "status": "completed", "tag": "65807dc9-c6c0-4f88-8477-4d4bfae6af76"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:34.334803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.335388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.335899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.351671 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] Creating event network-vif-unplugged:65807dc9-c6c0-4f88-8477-4d4bfae6af76 for instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc on n-h1-831194-21 Oct 04 17:59:34.360154 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-73f4840b-81dd-4fbb-906c-988827034159 req-a5f75e29-b767-466e-82e9-7ae05d06357e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044230 Oct 04 17:59:34.361412 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1105/2282] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:59:34.376557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.377547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.387447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.388100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.388613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.389577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.394242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.394954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.398275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:34.411068 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2aeea7c1-1472-485d-a027-818698ab99f7 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.200058 Oct 04 17:59:34.412326 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1178/2283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:34.431904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.432519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.438528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.439042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.439469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.440291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.440777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.441202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.475442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:34.484186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf2fe498-c834-48d5-9458-487139cb575b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1285 microversion: 2.1 time: 0.113511 Oct 04 17:59:34.485117 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1106/2284] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:34.589369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:34.597367 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fb3ecd7-7bf0-43cb-ad43-0664837250c6 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1810 microversion: 2.1 time: 0.169434 Oct 04 17:59:34.597963 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1179/2285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:34.769622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.772737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.789574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.790133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.790600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.791321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.791963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.792407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.833380 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b3387b5-1b13-47ba-b7f9-e477ceb28566 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079538 Oct 04 17:59:34.834104 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1107/2286] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:34.872495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:34.873311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:34.880678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.881336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.881904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:34.883191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:34.883418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:34.884179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.010768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.011680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.020538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.024350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.024963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.025773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.028714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.029152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.251755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.261130 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4895654b-0c95-4438-b03b-3421c44f1684 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1277 microversion: 2.1 time: 0.394562 Oct 04 17:59:35.268429 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1180/2287] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:34 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1277 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:35.276147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.286750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.300926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.302479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.308420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.309511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.310175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.310769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.373592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.383653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.385177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.386619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e388a3c-5424-4615-a463-1bd377ad4a18 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1365 microversion: 2.47 time: 0.381220 Oct 04 17:59:35.387779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1108/2288] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1365 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:59:35.441229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.441978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.450207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.450884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.451330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.452068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.452553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.452983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.473867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.485359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78a18291-9ef1-46d4-bf2d-96c55dad23d6 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1260 microversion: 2.1 time: 0.212873 Oct 04 17:59:35.487987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1181/2289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:35.523092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.525162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.553699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.563126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.564180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.565612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.566578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.568865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.698352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.713913 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9bf1e3a4-dd05-489d-82c6-46347707e0c1 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1283 microversion: 2.1 time: 0.204976 Oct 04 17:59:35.715191 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1182/2290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1283 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:35.723440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.726662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.736793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.737378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.738527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.740075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.740558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.741002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.752077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:35.849697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:35.866690 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-41df0567-d065-453b-b5c8-5c55b2b20e18 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.431491 Oct 04 17:59:35.867651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1109/2291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:35.873610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:35.875948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:35.883472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.883972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.884420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.885140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:35.885606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:35.886081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:35.933608 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dfc39195-56ff-4f6b-8028-e350e40a01e5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.064756 Oct 04 17:59:35.934637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1110/2292] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:36.095956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.116653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1db8f1e-a790-474a-a5e1-9e3ad27e3059 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1810 microversion: 2.1 time: 0.400182 Oct 04 17:59:36.133859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1183/2293] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:35 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1810 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:36.295784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:36.296416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:36.308656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.309671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.310317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.311681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.314248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.314868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.340708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfe661fe-d8ea-4211-afaf-0c7461c6a7bc", "name": "network-vif-deleted", "tag": "65807dc9-c6c0-4f88-8477-4d4bfae6af76"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:36.365899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.374635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.378329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.413088 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] Creating event network-vif-deleted:65807dc9-c6c0-4f88-8477-4d4bfae6af76 for instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc on n-h1-831194-21 Oct 04 17:59:36.419847 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a2bbb1d2-8ac2-4421-ad54-c74ac9b39cf0 req-19b5f9d8-33f6-4813-ba04-3b9b9914a1a4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087072 Oct 04 17:59:36.424356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1184/2294] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 17:59:36.431557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:36.432531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:36.439379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.440099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.442940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.443949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.444728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.449286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.635916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.652856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.666249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.667591 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75e77c5f-280d-4a7c-9ea3-4b576229e74a tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1371 microversion: 2.47 time: 0.241620 Oct 04 17:59:36.691962 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1185/2295] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:36 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1371 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:36.697133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:36.697811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:36.722650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.733482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.734046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.739264 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1d794da-0a6c-4760-b8bb-11fc3422a570 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1277 microversion: 2.1 time: 0.447550 Oct 04 17:59:36.746288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.746763 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1111/2296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:36 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1277 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:36.747445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.748472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.750354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.764168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:36.777737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:36.800235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.801614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.802267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.803174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:36.803790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:36.804382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:36.987489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:36.997620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e838067f-9549-4d6e-95c6-f5b341f9faf5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1260 microversion: 2.1 time: 0.304317 Oct 04 17:59:37.002418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1186/2297] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:36 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1260 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:37.009048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.016124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.035557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.037576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.038454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.040489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.041385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.042028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.317897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:37.328604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-71e29559-636d-4be1-9868-727a59817149 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.324366 Oct 04 17:59:37.343657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1187/2298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:37 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:37.357172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.367518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.382403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.386108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.386786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.387753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.388377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.391897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.423565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:37.461274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-449eae81-63b6-4773-b7c3-2341642b1469 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.711916 Oct 04 17:59:37.461486 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a2ead09-4675-49bf-87ec-8a01a2eff400 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115812 Oct 04 17:59:37.466766 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1188/2299] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:37 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:37.468928 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1112/2300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:36 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:37.470306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.471129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.478497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.478987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.479477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.480189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.481343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.481799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.494479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-deleted", "tag": "495f3046-cb30-4555-84ea-c0369c0abbe7"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:37.530379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.536263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.537446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.555431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] Creating event network-vif-deleted:495f3046-cb30-4555-84ea-c0369c0abbe7 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:37.563178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2532ce98-bbf2-4f79-97e4-9a07979c0c4e req-f5bd30c7-5225-48ab-bd53-53c09b104435 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089749 Oct 04 17:59:37.564343 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1113/2301] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:37.700645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.701718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.716660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.717547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.720960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.722221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.724397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.725471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.758921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:37.768955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b841820-3406-477d-bb3c-ba8a28f9aeeb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1789 microversion: 2.1 time: 0.304092 Oct 04 17:59:37.769573 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1189/2302] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:37 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1789 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:37.777204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:37.777838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:37.793511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:37.795675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.796180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.796664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:37.797610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:37.798141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:37.798573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.028685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.044915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.052748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a8a4ce6-691a-4e60-bfa0-ddf47dac820b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.281129 Oct 04 17:59:38.053148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1190/2303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:37 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:38.056446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.057952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.059153 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6a514d5-4e29-4d2c-9d56-2e416fd7e6e6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1371 microversion: 2.47 time: 0.365009 Oct 04 17:59:38.070189 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1114/2304] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:37 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1371 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:59:38.084944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:38.085891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:38.103995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.107044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.108615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.117338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.118341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.118803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.289858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.304070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43c5584f-30d1-455b-8876-c4724a26b7ac tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1266 microversion: 2.1 time: 0.226514 Oct 04 17:59:38.321007 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1191/2305] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:38 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:38.358462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:38.359977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:38.373973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.375021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.376422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.378659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.380258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.382379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.494619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:38.501005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:38.517899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.521007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.521581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.524310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.526587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.527146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.610131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad1d685d-f50f-4562-82cb-c5449385f503 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.138547 Oct 04 17:59:38.612770 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1192/2306] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:38 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 17:59:38.620374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:38.621223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:38.634700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.635598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.636397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.637324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.638714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.639456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.922655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:38.935511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1596a4ca-e410-411e-8345-1f4bd18f02e9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.321480 Oct 04 17:59:38.941172 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1193/2307] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:38 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:38.947002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1952cc2f-479a-4156-b26f-052d4561355c", "tag": "7900280e-adce-4234-8c4f-b2214cf99a62"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:38.960157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:38.960752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:38.961275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:38.975924 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] Creating event network-changed:7900280e-adce-4234-8c4f-b2214cf99a62 for instance 1952cc2f-479a-4156-b26f-052d4561355c on n-h2-831194-21 Oct 04 17:59:38.985799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-15155e08-d09a-486b-8e48-92c273f42599 req-5b2cb331-1ccb-47e7-bc61-44ad90be2eef service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 Oct 04 17:59:38.986764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1194/2308] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:38.992699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:38.993429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:38.999130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.000179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.000853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.001309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.002733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.003178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.003627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.018281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d886026a-8f0e-432d-a762-27bcdb0cf098 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.664671 Oct 04 17:59:39.020981 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1115/2309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:38 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:39.075825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.076632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.088958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.089450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.089909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.090836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.091451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.092037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.283169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.292748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01570914-3155-47ee-86c4-6b2fc8210242 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1610 microversion: 2.1 time: 0.304955 Oct 04 17:59:39.293489 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1195/2310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:38 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1610 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:39.298275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.299101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.306815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.307566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.308297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.309202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.309852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.310339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.381914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.390415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.391856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.393067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfad892a-d3f4-4a29-8851-cec608eedd7c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1356 microversion: 2.47 time: 0.098381 Oct 04 17:59:39.393614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1196/2311] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:39.398120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.398916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.405010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.405669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.406312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.407215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.407694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.408176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.477448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.486183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43e449f0-5d20-4d36-8d4d-42d5248cd6f4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1266 microversion: 2.1 time: 0.091446 Oct 04 17:59:39.486866 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1197/2312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:39.492475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.497543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.498604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Searching by: {'deleted': False, 'project_id': '3bcbef20c46d49e39767796552359db1'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 17:59:39.503810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.504444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.505120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.505944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.506467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.506895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.597924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.607693 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0411d1f3-3d7f-4537-b965-6f4eb4f74439 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.535763 Oct 04 17:59:39.625163 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1116/2313] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:39.631524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-deleted", "tag": "f7f72c8c-d814-43cb-a946-3bbf10cf4992"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:39.643648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.644709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.645934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.650903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 17:59:39.662885 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] Creating event network-vif-deleted:f7f72c8c-d814-43cb-a946-3bbf10cf4992 for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:39.668378 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-febff82b-24ec-43e6-ad58-2fdc17104c7e req-b9a0ea2d-4576-4e2b-bdec-e96fac356c54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041775 Oct 04 17:59:39.669008 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1117/2314] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:39.674432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.677047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.688039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.688616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.689338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.690095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.691272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.691778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.732288 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0db59f43-3f87-4767-bccc-22844380ba28 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.061835 Oct 04 17:59:39.733069 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1118/2315] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:39.744254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.753109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.753682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.754229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.766723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.768200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:39.820549 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f18d35ac-febe-4422-9569-c382b8a17dd4 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.332493 Oct 04 17:59:39.822456 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1198/2316] 10.222.0.42 () {60 vars in 1187 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:39.858991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.859523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.867814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.868343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.868993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.869882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.870802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.871233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.899986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:39.928229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:39.965022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:39.965650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:39.978461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.978965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.979414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:39.980130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:39.980586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:39.981018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.030681 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bda4209c-3852-4abc-872a-2193baa93e47 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "DELETE /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 204 len: 0 microversion: 2.47 time: 0.174900 Oct 04 17:59:40.034233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1119/2317] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 17:59:39 2022] DELETE /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:59:40.048731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:40.050443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:40.072991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.073439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.074486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.076495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.077799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.078817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.233175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.252699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.264508 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0887653d-7846-492f-bd38-adef1a233ad5 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.303266 Oct 04 17:59:40.267327 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1199/2318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:39 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:40.272542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.273812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:40.275045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:40.276878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.282099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.282854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.283726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.284789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.285992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.286283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-520bba6f-74a2-4e65-86ee-8bd9d7df7818 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1362 microversion: 2.47 time: 0.246849 Oct 04 17:59:40.286945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.310642 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1120/2319] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:40 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:40.316575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:40.317312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:40.317811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:40.358192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.358893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.360958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.361861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.362433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.362971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.616329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.630468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:40.634913 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13625a93-aa05-4dc4-b899-44991f868cfd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 200 len: 1454 microversion: 2.1 time: 0.322087 Oct 04 17:59:40.635997 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1121/2320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:40 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 1454 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:40.641130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:40.647745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-67031d37-8502-47b9-b747-d79b1cb820d8 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.374176 Oct 04 17:59:40.648115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:40.666925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.667799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.668399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.669405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.670112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.670679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.671481 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1200/2321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:40 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:40.680087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:40.680695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:40.706573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.713331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.714118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:40.715607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:40.724216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:40.727167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.157329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.173011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-722b58bd-966a-4f53-8db2-7244b9df5572 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.500262 Oct 04 17:59:41.177176 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1201/2322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:40 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:41.300238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:41.301451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:41.314286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.321502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.322497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.323440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.324077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.324802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.351425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.368381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-befd3ca9-a743-4931-adbb-661672476f6d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.730994 Oct 04 17:59:41.369036 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1122/2323] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:40 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:41.374278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:41.375161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:41.387588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:41.393046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.393765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.394411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.395873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.396495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.397082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.533325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.541856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6cb4a079-ca5c-4005-876b-39d3cb828354 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.254755 Oct 04 17:59:41.542577 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1202/2324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:41 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:41.568102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.579032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.580577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:41.581785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a16ffba-05e2-4df5-ab79-2acabcaedff6 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1362 microversion: 2.47 time: 0.211650 Oct 04 17:59:41.583511 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1123/2325] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:41 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:41.662989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:41.663946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:41.670362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.671059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.671665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.672553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.673468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.673894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.680408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:41.681604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:41.691301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.691496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 17:59:41.692840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.693724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f HTTP/1.1 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '96448918-0969-4f81-ad23-ef464512ed7f'} Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:41.694217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 17:59:41.698430 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:41.698894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.698894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.698894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.700115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:41.701197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e25594f1-06b0-4805-940d-c58081cea64a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 404 len: 111 microversion: 2.1 time: 0.043313 Oct 04 17:59:41.705735 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1203/2326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:41 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:41.734284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96448918-0969-4f81-ad23-ef464512ed7f", "name": "network-vif-deleted", "tag": "870ee857-9b6c-4c1c-9671-5e90682586af"}, {"name": "network-changed", "server_uuid": "0ded9c24-1981-40bb-af64-362fdcd00bb7", "tag": "405db06d-ced9-402e-a6ee-735dfb7e07eb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:41.758820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:41.760587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:41.761489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:41.781615 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Creating event network-vif-deleted:870ee857-9b6c-4c1c-9671-5e90682586af for instance 96448918-0969-4f81-ad23-ef464512ed7f on n-h1-831194-21 Oct 04 17:59:41.783790 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] Creating event network-changed:405db06d-ced9-402e-a6ee-735dfb7e07eb for instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 on n-h1-831194-21 Oct 04 17:59:41.792859 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-35a5d889-e5e9-452b-b23c-d9f74db9d611 req-f54ab8ea-2929-4f45-92ad-68cb59e8ff1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.062261 Oct 04 17:59:41.792859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1204/2327] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:42.136184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:42.205402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:42.206320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:42.216545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.217349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.218252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.219280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.220164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.220788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.486606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:42.496677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:42.501124 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b13d6a3-7610-4582-ae14-69a94b5f75bf tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.298886 Oct 04 17:59:42.515527 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1205/2328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:42 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:42.516781 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fb78d676-36dd-4329-ad40-37a1396fe061 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.842657 Oct 04 17:59:42.525862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1124/2329] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:41 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:42.526723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:42.526723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.537096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.566136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:42.566808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:42.576649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.577166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.577607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.586673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.587186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.588911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.795369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:42.818611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e95f610a-b4bc-4882-81ca-fe36a7d6efc3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.299637 Oct 04 17:59:42.819818 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1206/2330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:42 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:42.825447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:42.826296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:42.833098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.833996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.834590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.835302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:42.835755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:42.836171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:42.975269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:42.984405 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c2f0ae8f-1a9b-4f54-ba70-4a3b25501e73 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.422129 Oct 04 17:59:42.990554 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1125/2331] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:42 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:43.001379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:43.015957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:43.017737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:43.021897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa71aec9-9006-4045-9716-d7bd98a1fe2b tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 200 len: 1362 microversion: 2.47 time: 0.200558 Oct 04 17:59:43.025928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1207/2332] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:42 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 1362 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:43.526183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:43.526804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:43.535028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.535572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.536671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:43.537735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.538662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.539286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:43.546331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:43.547172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:43.557215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.558173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.571684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:43.573290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.575058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.576726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:43.800582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:43.812344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08e36dfa-0d8a-4729-9851-778cf0ac8a9d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.271476 Oct 04 17:59:43.812929 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1208/2333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:43 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:43.844087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:43.845232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:43.854755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.857024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.858627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:43.861476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:43.862160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:43.864261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.008502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.026059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77ca31a2-7928-48c0-9d70-500b0e7aabf5 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.503560 Oct 04 17:59:44.027769 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1126/2334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:43 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:44.036872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "393fd824-cf3b-4f32-aac0-f16616e64bcd", "tag": "b835fb23-df11-4dd0-aa23-3b7a973d9d2c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:44.081370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.085127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.085617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.116699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] Creating event network-changed:b835fb23-df11-4dd0-aa23-3b7a973d9d2c for instance 393fd824-cf3b-4f32-aac0-f16616e64bcd on n-h2-831194-21 Oct 04 17:59:44.122365 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d4c59b3b-cf00-41d6-839e-56887a2f54da req-ef0a77e3-dcc6-4a92-b424-8480f9dc7dab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093383 Oct 04 17:59:44.123882 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1127/2335] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:44.130888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:44.131875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:44.139838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.140638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.141767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.142791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.145989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.146744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.240587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.256116 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69f81338-f4c8-4b67-82d1-ea9ea265abc5 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.415958 Oct 04 17:59:44.257291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1209/2336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:43 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:44.263838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:44.264760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: 30ac8952-0002-4935-85db-9053a159eae0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:44.272816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.273644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.274498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.275496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.276109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.276692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.298731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] HTTP exception thrown: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Request method failure captured: Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 HTTP/1.1 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRaqW-fH9BCPPEu1_JPis8PNfaIIAvPlk-in_ly3dSW4a22euVtDwYdZ-cFUKmdropPWAfCBT0h5L1Mcpl8A1TptI1a2qDCU4MgeNawNwyzjKbSSjXerm7tySfIVW8prOKg9mmFNOjdXx35s6qEAvJnEmKRoXLCx8vVoeT_llIuhLE Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 3bcbef20c46d49e39767796552359db1 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerShowV247Test-950952239 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bcbef20c46d49e39767796552359db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bcbef20c46d49e39767796552359db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bcbef20c46d49e39767796552359db1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bcbef20c46d49e39767796552359db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerShowV247Test-950952239 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 3bcbef20c46d49e39767796552359db1 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerShowV247Test-950952239 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerShowV247Test-950952239-project Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 040dcc7e702f4585b1657a7b36c1dda1 Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerShowV247Test-950952239-project Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '30ac8952-0002-4935-85db-9053a159eae0'} Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:44.300955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Returning 404 to user: Instance 30ac8952-0002-4935-85db-9053a159eae0 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e08343d-2653-449e-a57c-c379cac34a08 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0" status: 404 len: 111 microversion: 2.47 time: 0.044585 Oct 04 17:59:44.305696 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1210/2337] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:44 2022] GET /compute/v2.1/servers/30ac8952-0002-4935-85db-9053a159eae0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:44.322887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:44.323390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:44.329303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.330025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.330607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.331480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.332095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.332895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.369305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:44.477078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf080df4-6758-4f82-b05a-3905f1a6e806 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 204 len: 0 microversion: 2.47 time: 0.156376 Oct 04 17:59:44.478112 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1211/2338] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 17:59:44 2022] DELETE /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 17:59:44.486918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:44.490911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:44.500480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.501110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.502286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.503169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.504563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.505407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.617868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.631880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.644791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.647139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dbd5a140-1738-4e5b-9e84-5ccb0a5d7331 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 200 len: 1361 microversion: 2.47 time: 0.164816 Oct 04 17:59:44.649129 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1212/2339] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:44 2022] GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 17:59:44.661707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:44.679431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd58ee86-01b5-4bfc-bb8d-3d1c631e0a06 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.552290 Oct 04 17:59:44.685529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1128/2340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:44 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:44.844844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:44.845996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:44.860163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.860163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.860793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:44.863220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:44.864208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:44.865033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.059981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:45.059981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:45.067796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.068883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.069446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.070038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.070885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.071403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.071894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.080333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea53e866-a3e8-487b-9ffc-8ceff244dbcc tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.241014 Oct 04 17:59:45.100065 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1213/2341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:44 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:45.280771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:45.281310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:45.287383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.287883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.288323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.289027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.289481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.289946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.346555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.354889 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2102c37d-da63-4185-9ab9-662a18bcd07f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.304343 Oct 04 17:59:45.372425 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1129/2342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:45.430617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.438917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9967ca8-88f1-4731-93d1-fcb65d5ccb03 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.162191 Oct 04 17:59:45.439835 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1214/2343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:45.679776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:45.680530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:45.689419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.690170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.690844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.692806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.693559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.694017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.711033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:45.712726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:45.724177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.724766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.725331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.727194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:45.727735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:45.728243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:45.836327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.844781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.846536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:45.848254 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f2a95e35-256a-4fea-8d88-318e4e7db09f tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 200 len: 1361 microversion: 2.47 time: 0.173676 Oct 04 17:59:45.859546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1130/2344] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:45.994659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:46.003422 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52fadcf9-191f-4714-af0f-4163bbbea3fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.298681 Oct 04 17:59:46.006443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1215/2345] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:45 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:46.117806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.118467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.128306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.130138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.131633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.132979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.134351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.134947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.196078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1952cc2f-479a-4156-b26f-052d4561355c", "name": "network-vif-plugged", "status": "completed", "tag": "7900280e-adce-4234-8c4f-b2214cf99a62"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:46.220416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.221236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.221862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.248604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] Creating event network-vif-plugged:7900280e-adce-4234-8c4f-b2214cf99a62 for instance 1952cc2f-479a-4156-b26f-052d4561355c on n-h2-831194-21 Oct 04 17:59:46.262967 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0dc85dc2-c198-4460-b06f-95e2cd7e142e req-c6127d14-9b35-4757-8d06-d60f51fe6ae7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071706 Oct 04 17:59:46.266668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1216/2346] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:46.379232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.381758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.395341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.395869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.397211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.398938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.402687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.405203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.473736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:46.484547 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-967a7d9f-7311-49b2-b7ca-8bb55afb8d77 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.372399 Oct 04 17:59:46.486453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1131/2347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:46 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:46.496823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.500218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.514245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.515654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.517480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.518561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.521565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.523723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.715738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:46.729766 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b54e62a-b168-42f0-88b4-9fbd82e5a7ff tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.354821 Oct 04 17:59:46.731391 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1217/2348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:46 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:46.875384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:46.876817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:46.885247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.886069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.886745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.887676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.888352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.888881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.899597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:46.948125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:46.948980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:46.949652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:46.950370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lazy-loading 'fault' on Instance uuid bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:47.019106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.039682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.044898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '040dcc7e702f4585b1657a7b36c1dda1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bcbef20c46d49e39767796552359db1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.046897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-faf5a80b-4b01-4779-ba9f-2e779b770c0c tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 200 len: 1366 microversion: 2.47 time: 0.175111 Oct 04 17:59:47.050408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1218/2349] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:46 2022] GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 17:59:47.067560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:47.069281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:47.081801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.093921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.094533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.096744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.101979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.102827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.476671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.493749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-43aacfa0-1e09-439b-8be9-5e34853d6363 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 1.004282 Oct 04 17:59:47.494904 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1132/2350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:46 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:47.508029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.517949 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59da7090-8665-4f44-ad39-91f7cc38de19 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1325 microversion: 2.1 time: 0.464988 Oct 04 17:59:47.520363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:47.521548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:47.528385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.528980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.529643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.530820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.531592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.532165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.536472 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1219/2351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:47 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1325 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:47.735507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:47.747707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4aa5b1c8-316b-4091-897d-414a0c176c66 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.231429 Oct 04 17:59:47.748583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1133/2352] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:47 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:47.754962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:47.756007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:47.763009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.763858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.765037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:47.766012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:47.766978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:47.767753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.000739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:48.017778 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b62eafb1-10c2-4617-a95a-215f879db694 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.265939 Oct 04 17:59:48.023946 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1220/2353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:47 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:48.083801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:48.086226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] [instance: bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:48.093355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.095572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.096795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.097925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.099123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.099631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.151110 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] HTTP exception thrown: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Request method failure captured: Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 HTTP/1.1 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRaqW-fH9BCPPEu1_JPis8PNfaIIAvPlk-in_ly3dSW4a22euVtDwYdZ-cFUKmdropPWAfCBT0h5L1Mcpl8A1TptI1a2qDCU4MgeNawNwyzjKbSSjXerm7tySfIVW8prOKg9mmFNOjdXx35s6qEAvJnEmKRoXLCx8vVoeT_llIuhLE Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 3bcbef20c46d49e39767796552359db1 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerShowV247Test-950952239 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3bcbef20c46d49e39767796552359db1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bcbef20c46d49e39767796552359db1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3bcbef20c46d49e39767796552359db1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3bcbef20c46d49e39767796552359db1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerShowV247Test-950952239 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 3bcbef20c46d49e39767796552359db1 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerShowV247Test-950952239 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerShowV247Test-950952239-project Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 040dcc7e702f4585b1657a7b36c1dda1 Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerShowV247Test-950952239-project Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8'} Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:48.154210 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. Oct 04 17:59:48.158773 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:48.160284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] Returning 404 to user: Instance bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:48.161919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-090cea25-cef5-443f-a68f-e4e7b80a7c67 tempest-ServerShowV247Test-950952239 tempest-ServerShowV247Test-950952239-project] 10.222.0.42 "GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8" status: 404 len: 111 microversion: 2.47 time: 0.085939 Oct 04 17:59:48.162961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1134/2354] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 17:59:48 2022] GET /compute/v2.1/servers/bf8e4f1e-4b3f-4263-adf0-3ec3eec62ed8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 17:59:48.226237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-734529946", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "013ecc7d-e383-45f2-a537-57f128d21147"}, {"uuid": "2ceed7c8-797d-4983-91fa-7076a15232b6"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:48.306513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] validate_networks() for [('013ecc7d-e383-45f2-a537-57f128d21147', None, None, None, None, None), ('2ceed7c8-797d-4983-91fa-7076a15232b6', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:48.516260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:48.516857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:48.526521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.529206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.531208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.531954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.532411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.532840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.815851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:48.830604 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82eab57f-2714-45ca-a9a2-e33dbb9872ea tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.316787 Oct 04 17:59:48.831202 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1135/2355] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:48 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:48.847826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:48.849176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:48.871854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.873493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.875353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:48.879859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:48.880780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:48.882559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.070693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:49.073601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:49.091237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-324edc1c-ad77-4776-9d49-c49635d80df7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1522 microversion: 2.1 time: 0.255115 Oct 04 17:59:49.097046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1136/2356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:48 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:49.112313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:49.113896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:49.137490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.139121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.139743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.144184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.147066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.147741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.452142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:49.456793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:49.459262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:49.461349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:49.461903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:49.464624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:49.476794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d202e15-e153-494b-8e32-1c8c4de36650 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.377668 Oct 04 17:59:49.495127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1137/2357] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:49 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:49.504209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.505496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.508061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.509042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.510420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.511962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.512384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:49.513175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:49.530996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.532272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.532866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.533743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.534366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.536872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.560502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Getting quotas for project 42151954583a4ff68618a0a783fdc7d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:49.575237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Getting quotas for user 61d553fff0e64a2ca5970bf9897eaff1 and project 42151954583a4ff68618a0a783fdc7d7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:49.605448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:49.607809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:49.682012 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37ba07a7-4816-4d62-89b1-e00703cb81d8 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.460695 Oct 04 17:59:49.692854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1221/2358] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1473 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:49.706365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:49.710830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:49.729358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.730566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.732882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.739733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.742634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.743033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.856059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:49.874182 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97a42069-862f-42fa-9fec-984b5e9f4fdb tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.370665 Oct 04 17:59:49.875864 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1138/2359] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:49 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:49.886681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ded9c24-1981-40bb-af64-362fdcd00bb7", "name": "network-vif-plugged", "status": "completed", "tag": "405db06d-ced9-402e-a6ee-735dfb7e07eb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:49.901624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:49.902595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:49.903466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:49.919760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] Creating event network-vif-plugged:405db06d-ced9-402e-a6ee-735dfb7e07eb for instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 on n-h1-831194-21 Oct 04 17:59:49.927392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-81bf0e8e-2095-4380-9efc-705b1b28497c req-c034b33d-ea94-4753-b62c-59f0854b4dd7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048370 Oct 04 17:59:49.929305 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1139/2360] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:49.948188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ca65254-5ebe-4cbf-887e-ad0d5d9acaf2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:49.951114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ca65254-5ebe-4cbf-887e-ad0d5d9acaf2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:50.155975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:50.168366 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07a2a594-ec57-4ec8-96a0-c65294b2211d tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1522 microversion: 2.1 time: 0.471131 Oct 04 17:59:50.168366 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1222/2361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:49 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1522 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:50.174398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:50.175086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:50.186452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.187482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.192560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.192560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.193737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.194766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.224529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ca65254-5ebe-4cbf-887e-ad0d5d9acaf2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:50.241749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ca65254-5ebe-4cbf-887e-ad0d5d9acaf2 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1212 microversion: 2.1 time: 0.308464 Oct 04 17:59:50.244785 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1140/2362] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:49 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1212 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:50.262683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1227982580"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:50.273992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:50.318049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.324107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.328107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.329251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.335715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.337770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.690157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:50.699796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1acd200b-f07a-4794-b72b-14c39ac2a302 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.530322 Oct 04 17:59:50.719698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1223/2363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:50 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:50.733890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:50.734727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:50.747211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.747977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.748900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.749921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.750661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.751189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.889323 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2cfa434e-ef9f-42d2-a441-c5598dfc52f9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c/action" status: 202 len: 0 microversion: 2.1 time: 0.642960 Oct 04 17:59:50.899090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1141/2364] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:50 2022] POST /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c/action => generated 0 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:59:50.906618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:50.908331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:50.919923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.923422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.924881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:50.927284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:50.927976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:50.930379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:51.106396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:51.117396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-903730b1-dc04-408c-9a07-21e8188f84d5 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.388722 Oct 04 17:59:51.121661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1224/2365] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:50 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:51.138969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:51.150085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eaf18634-eb67-4ba4-99f6-13874245d62a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1319 microversion: 2.1 time: 0.248827 Oct 04 17:59:51.153004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1142/2366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:50 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:51.154121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dba644bb-95d3-48dc-95ff-c8416dd75b5e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdc1e4c940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:51.277370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97c763e3-a23c-410a-a701-7c371d2dc78d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:51.281636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97c763e3-a23c-410a-a701-7c371d2dc78d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:51.438254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97c763e3-a23c-410a-a701-7c371d2dc78d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:51.452548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97c763e3-a23c-410a-a701-7c371d2dc78d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1212 microversion: 2.1 time: 0.185394 Oct 04 17:59:51.453154 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1143/2367] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:51 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1212 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:51.529083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dba644bb-95d3-48dc-95ff-c8416dd75b5e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095" status: 204 len: 0 microversion: 2.1 time: 0.405293 Oct 04 17:59:51.530050 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1225/2368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:51 2022] DELETE /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:51.540327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5d911f1-3b7d-4a63-9042-14712f60c876 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdbd868ca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:51.606105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c5d911f1-3b7d-4a63-9042-14712f60c876 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Image not found. Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5d911f1-3b7d-4a63-9042-14712f60c876 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095 HTTP/1.1 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'ca0322af-733f-48ae-8254-6403663a8095'} Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ca0322af-733f-48ae-8254-6403663a8095 Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:59:51.609614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca0322af-733f-48ae-8254-6403663a8095 could not be found. Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:51.613209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:51.622418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5d911f1-3b7d-4a63-9042-14712f60c876 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:51.623972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5d911f1-3b7d-4a63-9042-14712f60c876 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095" status: 404 len: 62 microversion: 2.1 time: 0.089417 Oct 04 17:59:51.627814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1144/2369] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:51 2022] GET /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095 => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:51.636314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:51.637596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:51.648696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:51.649200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:51.649639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:51.650377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:51.650837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:51.651266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:51.751357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:51.752934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:51.765400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:51.769691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:51.772290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:51.773938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:51.774682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:51.776020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:51.900443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:51.913076 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b01694bc-7072-4e52-84b0-f54afe129731 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1534 microversion: 2.1 time: 0.280970 Oct 04 17:59:51.913982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1226/2370] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:51 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1534 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:52.061335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:52.070451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e10709c6-0bb2-44d5-9ef8-63f186e2c902 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.332956 Oct 04 17:59:52.073618 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1145/2371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:51 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:52.093412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393fd824-cf3b-4f32-aac0-f16616e64bcd", "name": "network-vif-plugged", "status": "completed", "tag": "b835fb23-df11-4dd0-aa23-3b7a973d9d2c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:52.111010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.111418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.111904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.131585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] Creating event network-vif-plugged:b835fb23-df11-4dd0-aa23-3b7a973d9d2c for instance 393fd824-cf3b-4f32-aac0-f16616e64bcd on n-h2-831194-21 Oct 04 17:59:52.139429 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-28138977-058e-4a73-974d-205b8e8e6c7e req-bdd6d94f-02dd-456f-ae10-9518c417f769 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051695 Oct 04 17:59:52.140223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1146/2372] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:52.151885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:52.152734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:52.162106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.162774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.163376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.165035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.165573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.166142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.183659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a92128c-309c-4615-8445-481c14b67023 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Action: 'create', calling method: .version_select at 0x7fbdbdb2cee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1916212276", "metadata": {"Type": "work"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:52.530753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:52.548487 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a8552e9a-46fa-4b35-9367-8dd17150e4c6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.403343 Oct 04 17:59:52.549613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1147/2373] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:52 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:52.564411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:52.568132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:52.591943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.594003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.595036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.596580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.597216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.598179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.798458 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a92128c-309c-4615-8445-481c14b67023 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.883194 Oct 04 17:59:52.799716 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1227/2374] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 17:59:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 885 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 17:59:52.815296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:52.817810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:52.847211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.847718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.848953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.849590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:52.850077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:52.850510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:52.903773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:52.919282 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74ef17cc-24f4-417d-920b-e1acabf48a59 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1469 microversion: 2.1 time: 0.367637 Oct 04 17:59:52.922780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1148/2375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:52 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:52.952742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85fabe1d-c62b-4567-b401-e370a1a3e2d9 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdbd868940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.017861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.033654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c2b79bc-9d90-43dc-a92a-c130a7a966b1 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1272 microversion: 2.1 time: 0.220248 Oct 04 17:59:53.034319 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1228/2376] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:52 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1272 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:53.040361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.041190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.047815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.048485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.049281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.050414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.051218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.052615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.054834 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85fabe1d-c62b-4567-b401-e370a1a3e2d9 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 353 microversion: 2.1 time: 0.130154 Oct 04 17:59:53.055226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1149/2377] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:52 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:53.306732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-730451484", "block_migration": true, "disk_over_commit": false}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:53.310557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.325624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.326407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.327029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.328089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.328706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.329031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.329674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.343391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-274b7133-3890-4577-a03b-44d285ec24ef tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1540 microversion: 2.1 time: 0.307696 Oct 04 17:59:53.343831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1229/2378] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1540 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:53.350114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.350864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.352926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:53.358499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.359043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.359488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.360183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.360947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.361530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.377761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lazy-loading 'flavor' on Instance uuid 0ded9c24-1981-40bb-af64-362fdcd00bb7 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 17:59:53.395628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Going to try to live migrate instance to tempest-host-730451484 {{(pid=128850) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 17:59:53.404295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] HTTP exception thrown: Compute host tempest-host-730451484 could not be found. Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Request method failure captured: Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7/action HTTP/1.1 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 106 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHSApKCiQDr3XDBT4-qI2RTkwft6OLF1-G7SUz7AYBrc1wiSmriybxNdA32HfQ0QtIfbaEYtVsTMkQfGlsdNUmfLKIZyIFCBvZIu-CLhiQ2uinVqYaolbPykQvyf5Q4eNYWlTt9UMjHlBAOuqijmZojD3fN8pubicq0PBsuaJ5B9OGI Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ceb99765b9f44ff2b4f2b414ffa54c78 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ceb99765b9f44ff2b4f2b414ffa54c78 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveMigrationNegativeTest-1618548972-project-admin Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ac736cd8b36249e79836f86afb9465e8 Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveMigrationNegativeTest-1618548972-project-admin Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: {"os-migrateLive": {"host": "tempest-host-730451484", "block_migration": true, "disk_over_commit": false}} Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: exception: Compute host tempest-host-730451484 could not be found. Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0ded9c24-1981-40bb-af64-362fdcd00bb7', 'body': {'os-migrateLive': {'host': 'tempest-host-730451484', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 04 17:59:53.415713 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-730451484 could not be found. Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-730451484 could not be found. Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-730451484 could not be found. Oct 04 17:59:53.419372 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 17:59:53.423980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Returning 400 to user: Compute host tempest-host-730451484 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:53.425539 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5ce9b41-8692-4bb4-bab8-0f48594a38b3 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7/action" status: 400 len: 99 microversion: 2.1 time: 0.369118 Oct 04 17:59:53.427007 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1150/2379] 10.222.0.42 () {60 vars in 1279 bytes} [Tue Oct 4 17:59:53 2022] POST /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7/action => generated 99 bytes in 371 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 17:59:53.435378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.436474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.447282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.448013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.448831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.449699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.450329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.450951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.545472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.555445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af2c58da-5f41-4445-8d27-bbec3f7e7a14 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1308 microversion: 2.1 time: 0.210420 Oct 04 17:59:53.586661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1230/2380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1308 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:53.596731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:53.600062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:53.609301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.611088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.611532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.612469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:53.613131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:53.614435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:53.727585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.751497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec56d240-bd68-4275-b356-527043b061db tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1469 microversion: 2.1 time: 0.314206 Oct 04 17:59:53.751497 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1151/2381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1469 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:53.813200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:53.826510 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b4f36d7e-1185-4f0a-b443-a8e9df901116 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.236517 Oct 04 17:59:53.845565 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1231/2382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:53 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:53.971183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1983680337", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:54.049949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 17:59:54.062350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.063416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.077885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.078110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.083301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.084774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.087178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.087178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.299755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:54.312344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-613b37d1-1d2c-44ee-9fbd-d2523db30279 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1312 microversion: 2.1 time: 0.253880 Oct 04 17:59:54.328229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1232/2383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1312 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:54.336133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0d1f7f6-e2ae-4e2d-a7fa-95a966e9785e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdc1e78790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.451561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0d1f7f6-e2ae-4e2d-a7fa-95a966e9785e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 354 microversion: 2.1 time: 0.121034 Oct 04 17:59:54.452163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1233/2384] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:54.459186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.459810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.469320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.469865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.470317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.475272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.475775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.476242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.487577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 17:59:54.489970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 17:59:54.490658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 17:59:54.492279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 17:59:54.492897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 17:59:54.519132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.520705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.522416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.523706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.525817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.526497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.592668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Getting quotas for project 3b49a1b90e7b4efbbcfa61ecd450d4ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 17:59:54.616022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Getting quotas for user 4e5a98dffe494800adbd9c540c33588b and project 3b49a1b90e7b4efbbcfa61ecd450d4ff. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 17:59:54.637190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 17:59:54.643236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 17:59:54.721065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:54.721500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7bdd9328-daaa-4027-b775-dcc0b2736589 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754753 Oct 04 17:59:54.723514 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1152/2385] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 17:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 17:59:54.734460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-036f69b3-f3ea-4962-bd7a-57b272b3b1d4 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdbdb8cca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.740028 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-878ddcf4-4966-4a8c-8c3c-ccb462c02e7f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1540 microversion: 2.1 time: 0.285012 Oct 04 17:59:54.741252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1234/2386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1540 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:54.757811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.772359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.808103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.813239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.813944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.814884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:54.815533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:54.816157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:54.854467 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-036f69b3-f3ea-4962-bd7a-57b272b3b1d4 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 354 microversion: 2.1 time: 0.129184 Oct 04 17:59:54.854990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1153/2387] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 354 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:54.861257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c4a70a0-294f-4fc3-9ab4-40408a066700 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:54.861992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c4a70a0-294f-4fc3-9ab4-40408a066700 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:54.996479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c4a70a0-294f-4fc3-9ab4-40408a066700 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:55.028443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c4a70a0-294f-4fc3-9ab4-40408a066700 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1219 microversion: 2.1 time: 0.172351 Oct 04 17:59:55.029313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1154/2388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:55.059100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.068224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.089902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.091115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.091815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.092775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.093444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.094107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.113558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:55.151337 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-904e11eb-dc2a-469f-af12-c96e4cf1454a tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1487 microversion: 2.1 time: 0.390661 Oct 04 17:59:55.151337 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1235/2389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:54 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1487 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:55.159994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c0238b7-a29a-4bb5-a4cc-41b955b1b92e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdc1e4c310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.293245 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c0238b7-a29a-4bb5-a4cc-41b955b1b92e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 202 len: 0 microversion: 2.1 time: 0.155055 Oct 04 17:59:55.293855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1236/2390] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 17:59:55 2022] DELETE /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 17:59:55.309255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-419533809"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:55.319455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.335938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.336926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.337744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.341654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.343200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.344352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.439450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:55.456856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ed2f68f-5040-4e56-b8a6-c013b9fd18c2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.422245 Oct 04 17:59:55.458049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1155/2391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:55.487694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f342cb64-dd85-458e-a99d-633e77e786cb tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdbd6a83a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.638182 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f342cb64-dd85-458e-a99d-633e77e786cb tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 353 microversion: 2.1 time: 0.164954 Oct 04 17:59:55.638886 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1156/2392] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:55.654384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.655020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.669790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.670312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.670751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.673795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.676460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.677191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.733263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:55.777131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-333625e4-0279-4327-b1e6-8f8c0f38c7b1 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "POST /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd/action" status: 202 len: 0 microversion: 2.1 time: 0.477936 Oct 04 17:59:55.782879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1237/2393] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 17:59:55 2022] POST /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 17:59:55.790377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:55.791717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:55.815125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.815837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.819678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:55.820571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:55.821065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:55.821513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.072803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.089533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3d0641a-c32f-4089-82b0-5b3948dafeab tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.436405 Oct 04 17:59:56.103940 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1157/2394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.111714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1eec0a2-465b-41c2-923b-07d971a0ab23 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbcfe5e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.117809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.136904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8ac3742-39e4-423e-af8a-97a59f4b1830 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1522 microversion: 2.1 time: 0.352422 Oct 04 17:59:56.139646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1238/2395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:55 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.150803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.151490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.158196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.158698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.159201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.160036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.161124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.161869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.179353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1eec0a2-465b-41c2-923b-07d971a0ab23 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09" status: 200 len: 1413 microversion: 2.1 time: 0.085212 Oct 04 17:59:56.180136 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1158/2396] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.185474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.186228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.194745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.195269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.195713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.196433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.196890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.197319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.249126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.249394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 17:59:56.260525 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d9248f8-ed2c-492f-a959-bf920584c036 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1215 microversion: 2.1 time: 0.118827 Oct 04 17:59:56.261367 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1239/2397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.319287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13c16a34-f848-4b40-88f4-3305a5f06804 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdc1e7a670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.379043 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec0ce01d-9aa5-42db-ac5b-09bf59e8d151 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 204 len: 0 microversion: 2.1 time: 0.194274 Oct 04 17:59:56.384285 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1159/2398] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 17:59:56 2022] DELETE /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:56.398148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.399019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.429587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.431369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.433672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.434597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.436422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.438174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13c16a34-f848-4b40-88f4-3305a5f06804 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09" status: 200 len: 1413 microversion: 2.1 time: 0.175355 Oct 04 17:59:56.440244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.440934 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1240/2399] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 => generated 1413 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.445048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:56.467759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e27ad5cc-a6dd-4155-bba7-840e2820a3a4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdc1e5e550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.673862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e27ad5cc-a6dd-4155-bba7-840e2820a3a4 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09" status: 204 len: 0 microversion: 2.1 time: 0.220534 Oct 04 17:59:56.674439 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1241/2400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] DELETE /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 17:59:56.680926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.681539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.712332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.712861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.713453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.714196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.714655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.715080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.880195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.888816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-873c5509-66b3-4be0-98c5-83c0e2f35cbe tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1528 microversion: 2.1 time: 0.502595 Oct 04 17:59:56.889593 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1160/2401] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1528 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.895588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:56.907266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-352278e9-94b6-413b-ba0d-32f38e36e977 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.230644 Oct 04 17:59:56.908696 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1242/2402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:56.914269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b7e4903-e2b7-40a5-aa23-1586e1ac1284 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd02da60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.935836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-728914dd-8b41-4ed9-9a92-073d02ea8f50 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdc1eb35e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.940939 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7b7e4903-e2b7-40a5-aa23-1586e1ac1284 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Image not found. Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b7e4903-e2b7-40a5-aa23-1586e1ac1284 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 HTTP/1.1 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '6b36d368-8d9b-4736-af48-2a2cea073f09'} Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6b36d368-8d9b-4736-af48-2a2cea073f09 Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 17:59:56.944457 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b36d368-8d9b-4736-af48-2a2cea073f09 could not be found. Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 17:59:56.948284 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:56.953115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b7e4903-e2b7-40a5-aa23-1586e1ac1284 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:56.954170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b7e4903-e2b7-40a5-aa23-1586e1ac1284 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09" status: 404 len: 62 microversion: 2.1 time: 0.044312 Oct 04 17:59:56.955821 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1243/2403] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 17:59:56.965124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:56.965720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:56.977471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.978085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.978680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:56.979459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:56.981163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:56.981661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.042122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-728914dd-8b41-4ed9-9a92-073d02ea8f50 tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 353 microversion: 2.1 time: 0.133580 Oct 04 17:59:57.049112 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1161/2404] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:57.119203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:57.120168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:57.141961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.141961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.141961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.142911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.143564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.144067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.241289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:57.250929 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b37d1871-0475-4f3d-bc0a-b114ce15834b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1499 microversion: 2.1 time: 0.289973 Oct 04 17:59:57.253237 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1244/2405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:56 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:57.285124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:57.287033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:57.295316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.298820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.299710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.304812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.305511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.306171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.404328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:57.423582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2295b658-18c2-4442-8dde-23f609680243 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1277 microversion: 2.1 time: 0.142691 Oct 04 17:59:57.424618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1245/2406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:57 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1277 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:57.498338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:57.510944 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a1da814-4753-4bbe-9bd8-21155b534c67 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.395698 Oct 04 17:59:57.511863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1162/2407] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:57 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 17:59:57.822291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "tag": "e6a9c776-494d-4867-b963-21021a62a3ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 17:59:57.847915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.849504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.850516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.875244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] Creating event network-changed:e6a9c776-494d-4867-b963-21021a62a3ab for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 17:59:57.880306 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-aada3593-ee7c-4795-a3c3-e6a7709a0c11 req-e205ec40-ef94-414b-92be-12153160e179 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.209537 Oct 04 17:59:57.881244 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1246/2408] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 17:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:57.925450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:57.928952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:57.936363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:57.937619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:57.949322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.949853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.950292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.951003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.951460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.951885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.956170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.957001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.958201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:57.958931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:57.959397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:57.963433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.374401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:58.387544 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08435bc2-8d32-4dd8-a170-e38c993efbec tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.455380 Oct 04 17:59:58.388073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:58.399256 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6d7ebc4-46ab-4b79-8f52-b8865fd3ad75 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1528 microversion: 2.1 time: 0.489506 Oct 04 17:59:58.409872 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1247/2409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:57 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:58.410092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1163/2410] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:57 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1528 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:58.415441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07d6106e-8c83-49e6-b6d6-f00367cd668e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdc1e90820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:58.416082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:58.417028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:58.436193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.437052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.437812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.439071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.439874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.448279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.525044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07d6106e-8c83-49e6-b6d6-f00367cd668e tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 200 len: 353 microversion: 2.1 time: 0.121065 Oct 04 17:59:58.526086 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1248/2411] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:58 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 17:59:58.540201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:58.540950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:58.549488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.550136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.550687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.551575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.552312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.552846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.639864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:58.651143 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e403d8b-e9f6-4887-b1b6-12e3de3081bd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1277 microversion: 2.1 time: 0.122526 Oct 04 17:59:58.652077 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1249/2412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:58 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1277 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:58.657733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:58.658851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:58.666518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.667468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.668145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.669099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:58.669816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:58.670790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:58.937252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:58.961370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66110689-8f9f-4f65-8eda-8607be15a417 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.307106 Oct 04 17:59:58.962991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1250/2413] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:58 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:59.368707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:59.379805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec795b7a-e8d1-4417-8d92-3bf1791e2409 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1505 microversion: 2.1 time: 0.974196 Oct 04 17:59:59.393932 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1164/2414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:58 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1505 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:59.415540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:59.417015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:59.431632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.433015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:59.434442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.434924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:59.435597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.438687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.441680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.443252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.451072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.451711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.458542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.459727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.460416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.461066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.529682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:59.593206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=34 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 17:59:59.659680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:59.670186 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6f32c342-af35-4a40-9fdf-7ca128c5e0c1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.258426 Oct 04 17:59:59.672412 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1251/2415] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:59 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:59.700077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9a3033a-9cdb-4de7-9560-72e843e85d7b tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Calling method '.version_select at 0x7fbdc1e5eb80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:59.738198 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f9a3033a-9cdb-4de7-9560-72e843e85d7b tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] HTTP exception thrown: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9a3033a-9cdb-4de7-9560-72e843e85d7b tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Request method failure captured: Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb HTTP/1.1 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHSXGLZX50CrSsvG8OuAK9IOxCfBC4njhf-smQ6MorSTnGPas8WD2HgWvkXViEVI9dPzUHqITZn5xAw0w4tZRGtkso1mMipxs89Z4EjAp_TGSacy41dIHEnS2pIFhpQOT3phItoIpAVYUWUiI2vBNtKj4JIcVFfc_XBT1VEJwbrYvOk Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 9c71d835518842b0acc67a320e0d75b2 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesGetTestJSON-596699320 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c71d835518842b0acc67a320e0d75b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c71d835518842b0acc67a320e0d75b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c71d835518842b0acc67a320e0d75b2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c71d835518842b0acc67a320e0d75b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesGetTestJSON-596699320 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 9c71d835518842b0acc67a320e0d75b2 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesGetTestJSON-596699320 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesGetTestJSON-596699320-project Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 11bcd537b06440af850a8e5ffcd43b35 Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesGetTestJSON-596699320-project Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: exception: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3ba09678-1cc6-4418-8914-c42de4731fcb'} Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. (HTTP 404) (Request-ID: req-2c4cd18c-d428-4c88-a84e-a396aa0599c1) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 17:59:59.740508 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. Oct 04 17:59:59.744271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 17:59:59.751680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9a3033a-9cdb-4de7-9560-72e843e85d7b tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] Returning 404 to user: Volume 3ba09678-1cc6-4418-8914-c42de4731fcb could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 17:59:59.751680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9a3033a-9cdb-4de7-9560-72e843e85d7b tempest-VolumesGetTestJSON-596699320 tempest-VolumesGetTestJSON-596699320-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb" status: 404 len: 109 microversion: 2.1 time: 0.073824 Oct 04 17:59:59.751680 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1252/2416] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 17:59:59 2022] GET /compute/v2.1/os-volumes/3ba09678-1cc6-4418-8914-c42de4731fcb => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 17:59:59.759329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:59.760667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:59.768751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.769494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.770933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.773069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 17:59:59.774446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 17:59:59.775183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 17:59:59.877529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 17:59:59.885325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8444e30-c82d-4628-b56c-76b0853bfd5b tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1528 microversion: 2.1 time: 0.464522 Oct 04 17:59:59.898058 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1165/2417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:59 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1528 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 17:59:59.991853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 17:59:59.992692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 17:59:59.995396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:00.001493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.009247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.016315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.018528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.020193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.020770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.094852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:00.121691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a22944f-0a49-4ab6-9df3-9cdd66ca7ac4 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.372325 Oct 04 18:00:00.122668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1253/2418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:59 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:00.403389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:00.404012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:00.412664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.413164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.413604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.421347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.422552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.423309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.634057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:00.649858 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4dba5aa8-6d9f-42fa-b355-f36bcff37f35 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.661681 Oct 04 18:00:00.650391 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1166/2419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 17:59:59 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:00.676467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:00.688704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4218afb5-692a-4637-91e9-25e37bd9cd63 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1505 microversion: 2.1 time: 0.288222 Oct 04 18:00:00.690847 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1254/2420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:00 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:00.704119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:00.705175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:00.720221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.722235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.724381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:00.726643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:00.728484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:00.729275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.017033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393fd824-cf3b-4f32-aac0-f16616e64bcd", "name": "network-vif-plugged", "status": "completed", "tag": "b835fb23-df11-4dd0-aa23-3b7a973d9d2c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:01.038575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.039061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.039962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.070746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] Creating event network-vif-plugged:b835fb23-df11-4dd0-aa23-3b7a973d9d2c for instance 393fd824-cf3b-4f32-aac0-f16616e64bcd on n-h2-831194-21 Oct 04 18:00:01.086503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5a17b7d3-844b-440c-aafe-f099a30c318a req-b355f2b7-5e3d-440a-bc05-ee932b1256d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.417361 Oct 04 18:00:01.087104 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1167/2421] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:01.119249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.119996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.134391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.140568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.141128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.141587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.142360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.142832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.142962 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b8cbf0b-5ac9-434c-9d3f-72dd56f97435 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.449246 Oct 04 18:00:01.143460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.149822 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1255/2422] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:00 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:01.170954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "tag": "93957b9e-c000-4e89-9ec8-213adc1eca3d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:01.190292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.195751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.196435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.226385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] Creating event network-changed:93957b9e-c000-4e89-9ec8-213adc1eca3d for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 18:00:01.236526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8b0009cf-1de1-42e0-b32b-35ea3403bc8a req-830f01b0-aeab-422c-b355-72917cacfeaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083674 Oct 04 18:00:01.241777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1256/2423] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:01.246036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.246447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.246888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.250345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lazy-loading 'fault' on Instance uuid 1952cc2f-479a-4156-b26f-052d4561355c {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:01.253162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.258046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.272219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.272727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.273170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.273908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.274525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.275101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.464792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.475205 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-685ade7e-fcbf-4ce1-b4de-17384f42f022 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.231904 Oct 04 18:00:01.477723 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1257/2424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:01.478504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.487301 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5ac155d-2b1a-4fe3-8859-d662bc47683f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 200 len: 1315 microversion: 2.1 time: 0.390856 Oct 04 18:00:01.490659 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1168/2425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:01.681844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.683682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.696777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.697589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.698375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.700711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.701588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.702283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.718816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:01.719439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:01.735634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.736129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.736745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.737615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:01.738254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:01.738950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:01.952640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:01.968667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db2a7997-96f7-41cb-ae7c-c563d8d29e5f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.292352 Oct 04 18:00:01.983027 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1258/2426] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:02.167895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.168750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.175578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.176394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.176914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:02.177291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.178214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.179495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.180615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.187086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33345b19-5b4f-4ab8-a06c-ac21c73d2078 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1487 microversion: 2.1 time: 0.472036 Oct 04 18:00:02.204673 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1169/2427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:01 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1487 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:02.211934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.212447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.218932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.219417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.220039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.220974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.221642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.222588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.254374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:02.369738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-028e0237-c337-4ffc-bdd5-ac2108ba8479 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 204 len: 0 microversion: 2.1 time: 0.162732 Oct 04 18:00:02.372163 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1170/2428] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:02 2022] DELETE /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:00:02.391357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf6dc579-cb0e-4150-848d-c6940681bab9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdc1ebc310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.399632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:02.411569 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d2d2c99-b57b-4c5c-b667-3c2cc4ffa56a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.246814 Oct 04 18:00:02.413017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1259/2429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:02.438484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-bf6dc579-cb0e-4150-848d-c6940681bab9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Image not found. Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf6dc579-cb0e-4150-848d-c6940681bab9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 HTTP/1.1 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6b36d368-8d9b-4736-af48-2a2cea073f09'} Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6b36d368-8d9b-4736-af48-2a2cea073f09 to delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6b36d368-8d9b-4736-af48-2a2cea073f09 could not be found. Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.440836 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:02.445908 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.449126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf6dc579-cb0e-4150-848d-c6940681bab9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:02.450180 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf6dc579-cb0e-4150-848d-c6940681bab9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09" status: 404 len: 62 microversion: 2.1 time: 0.069978 Oct 04 18:00:02.451200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1171/2430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] DELETE /compute/v2.1/images/6b36d368-8d9b-4736-af48-2a2cea073f09 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:02.460114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.460611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.476657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.477332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.477585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.478513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.479123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.479706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.501636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.503936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.512876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:02.514056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.514610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.515056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.515771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.516430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.517001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.517699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:02.576328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Instance is already in deleting state, ignoring this request Oct 04 18:00:02.577565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-638d268d-0769-45df-b3f6-8139c7aca9cc tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 204 len: 0 microversion: 2.1 time: 0.122525 Oct 04 18:00:02.578825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1260/2431] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:02 2022] DELETE /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:02.586106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.587644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.594901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.595619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.596565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.597437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.599049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.599655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.627835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c HTTP/1.1 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '1952cc2f-479a-4156-b26f-052d4561355c'} Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.632360 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:02.636768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:02.637744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:02.639557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4bd9daf8-f478-49bc-8f58-0a95a0810b6a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 404 len: 111 microversion: 2.1 time: 0.058310 Oct 04 18:00:02.649567 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1261/2432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:02.656041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:02.656860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:02.664943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.665623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.666241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.667251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:02.667978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:02.668664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:02.891416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:02.905052 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-737f4788-5be0-4d8f-96c6-9920ec41e18d tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1493 microversion: 2.1 time: 0.258826 Oct 04 18:00:02.906145 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1262/2433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1493 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:02.931581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1427292975", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:02.969224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:02.996995 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a8beb8a-6b75-47ca-acc4-b2bafd4d587e tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.499846 Oct 04 18:00:02.998282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1172/2434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:03.004382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:03.005290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:03.012909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.013083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] validate_networks() for [('fce7ff1e-70f3-4550-b825-58c99b6e82a7', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:03.013761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.014448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.015684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.016355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.017325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.671200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:03.680159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67b99af1-1896-4613-a865-c8ba006d2e8b tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.680572 Oct 04 18:00:03.681101 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1173/2435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:02 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:03.686746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:03.687540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:03.701708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.702645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.703408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.704520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.705548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.706285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.892057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:03.894108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:03.896010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:03.896841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:03.905114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:03.935551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.936316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.936923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.940616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:03.946678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.946678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.946678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:03.954743 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3b574e6-fa6e-4b05-adb1-f1aae149a663 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.272365 Oct 04 18:00:03.955605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1174/2436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:03 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:03.969639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1952cc2f-479a-4156-b26f-052d4561355c", "name": "network-vif-deleted", "tag": "7900280e-adce-4234-8c4f-b2214cf99a62"}, {"name": "network-changed", "server_uuid": "3996315c-68bb-4733-8862-1cb35afe086a", "tag": "c7571545-55e8-4c0b-9677-2122c2abeff9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:03.993497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:03.994015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:03.995335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:03.996226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.006769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Getting quotas for user 9c110945b1ec49fb91c8d3e67a6c2178 and project c881903a7ca74d89bfe90b5aa5a535da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:04.024919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:04.027860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:04.032921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Creating event network-vif-deleted:7900280e-adce-4234-8c4f-b2214cf99a62 for instance 1952cc2f-479a-4156-b26f-052d4561355c on n-h2-831194-21 Oct 04 18:00:04.033516 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] Creating event network-changed:c7571545-55e8-4c0b-9677-2122c2abeff9 for instance 3996315c-68bb-4733-8862-1cb35afe086a on n-h1-831194-21 Oct 04 18:00:04.045159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b34dc85e-eb38-43e3-bf8a-91b48521c0fc req-7f228dec-833f-422a-9717-9217ffd72fa0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.087064 Oct 04 18:00:04.046122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1175/2437] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:04.058278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.059609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.071271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.072307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.073024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.074030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.074730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.075507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.095585 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3fded21-6ef0-4ca4-ba82-63ae6e7da4eb tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.187406 Oct 04 18:00:04.096959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1263/2438] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:04.114236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.115115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.123798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.124464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.125056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.125966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.126573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.127231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.318711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.333066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a77dd1ca-3ecb-4ffa-9dd1-995f5eee99cc tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.232745 Oct 04 18:00:04.334138 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1264/2439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:04.340093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52c0d7fb-f113-4e26-bd8d-065ac741d232 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.341177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52c0d7fb-f113-4e26-bd8d-065ac741d232 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.438375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52c0d7fb-f113-4e26-bd8d-065ac741d232 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.447371 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52c0d7fb-f113-4e26-bd8d-065ac741d232 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1225 microversion: 2.1 time: 0.110858 Oct 04 18:00:04.448464 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1265/2440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1225 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:04.562965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:04.620552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:04.630834 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8111487f-50cb-47f6-a024-297b4d3ebe9b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1493 microversion: 2.1 time: 0.577205 Oct 04 18:00:04.632617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393fd824-cf3b-4f32-aac0-f16616e64bcd", "name": "network-vif-unplugged", "status": "completed", "tag": "b835fb23-df11-4dd0-aa23-3b7a973d9d2c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:04.634335 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1176/2441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1493 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:04.658883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.664962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.665509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.693466 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] Creating event network-vif-unplugged:b835fb23-df11-4dd0-aa23-3b7a973d9d2c for instance 393fd824-cf3b-4f32-aac0-f16616e64bcd on n-h2-831194-21 Oct 04 18:00:04.704959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:04.706484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:04.711772 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6dca8437-56cb-4382-9710-095dbea99f38 req-2d0f16aa-c8dc-453f-a0c7-5bddaf8a86dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091763 Oct 04 18:00:04.714455 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1266/2442] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:00:04.717650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.723324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.723867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:04.724691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:04.726384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:04.727018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.007752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.008432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.015079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:05.022796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.023293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.023734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.024437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.024892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.025316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.169417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.187027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52332f93-df0b-435c-b40c-679f3586c45e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.484558 Oct 04 18:00:05.187647 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1177/2443] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:05.260801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.274330 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a44127a9-e9c2-43a5-ba92-329493d6c9f0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1517 microversion: 2.1 time: 0.294068 Oct 04 18:00:05.274918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1267/2444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:04 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1517 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:05.360003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.360622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.376215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.376716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.377148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.377885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.378337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.379152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.408426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:05.475282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.476715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.491468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.493407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.497500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.500250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.502337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.505219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.605881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.635713 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-071809ba-b077-4291-8423-1cf92373c629 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1229 microversion: 2.1 time: 0.156920 Oct 04 18:00:05.639110 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1268/2445] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1229 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:05.657808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:05.658394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:05.681605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.682133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.683587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.684345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:05.684820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:05.685259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:05.977255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:05.985583 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-154bcbcf-8593-485a-a13c-aa57baa72c4b tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1493 microversion: 2.1 time: 0.332192 Oct 04 18:00:05.986699 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1269/2446] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1493 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:05.999926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.011026 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf207f2d-63e2-40cc-85bf-f794f6686465 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.654643 Oct 04 18:00:06.012099 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1178/2447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:05 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:06.215392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.217663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.227837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.228867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.229528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.231564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.232400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.233052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.302939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.304467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.335749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.336638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.337517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.338484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.339456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.340217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.531388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.543941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-842da161-482c-44e8-9108-3607be8f7479 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.334507 Oct 04 18:00:06.547856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1270/2448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:06.607547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "393fd824-cf3b-4f32-aac0-f16616e64bcd", "name": "network-vif-deleted", "tag": "b835fb23-df11-4dd0-aa23-3b7a973d9d2c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:06.627201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.628643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.631855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.672845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] Creating event network-vif-deleted:b835fb23-df11-4dd0-aa23-3b7a973d9d2c for instance 393fd824-cf3b-4f32-aac0-f16616e64bcd on n-h2-831194-21 Oct 04 18:00:06.696604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-faccdf9e-e3ec-488f-9886-b0ed97c2ee37 req-757d723c-4e05-4348-88ec-38aca2991382 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095604 Oct 04 18:00:06.700616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1271/2449] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:06.724770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:06.725781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:06.744781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.745418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.746188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.747737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:06.749537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:06.750816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:06.821850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.841694 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06823ac3-52f1-4daf-be85-d9bb6cd5e1ef tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.544949 Oct 04 18:00:06.842784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1179/2450] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:06.895843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:06.910320 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25efe3d3-c308-43ee-9dd9-e798701fe172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1277 microversion: 2.1 time: 0.206926 Oct 04 18:00:06.912489 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1272/2451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:06 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.022288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.026495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.039020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.039941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.046190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.046744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.047504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.049596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.049775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.050613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.052741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.053403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.053884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.054622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.058967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.059655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.154992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.155862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.157099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.157757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lazy-loading 'fault' on Instance uuid 393fd824-cf3b-4f32-aac0-f16616e64bcd {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:07.300328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3ae7cc3d854e0690d8354dbca1e6c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138709a891374e24af26f00fe61b2125', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:07.318954 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e74eba9-43bb-486c-b69e-0aa151158e55 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 200 len: 1298 microversion: 2.1 time: 0.309367 Oct 04 18:00:07.334718 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1180/2452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 1298 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.406638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:07.438766 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4cf82d1-268d-488b-9318-aa66a4d5f8d7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.402692 Oct 04 18:00:07.456548 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1273/2453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:07.577332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.582816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.596460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.597612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.598822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.600106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.600798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.614568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.875423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:07.879614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:07.897770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.899188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.900016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:07.901224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:07.913597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:07.916898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.217703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.228799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3bd909ba-ff2a-4172-a032-a6a6ee6dc36c tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.359107 Oct 04 18:00:08.230005 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1274/2454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:08.238305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.239662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.255236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.255987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.256681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.257561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.258365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.258799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.377580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.391603 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33ddb3be-bb4c-48ad-be4f-10f97452d9a9 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1283 microversion: 2.1 time: 0.159409 Oct 04 18:00:08.398147 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1275/2455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:08.412043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.412698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 393fd824-cf3b-4f32-aac0-f16616e64bcd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.429472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.430166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.430687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.433132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.433681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.435006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.461430 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd HTTP/1.1 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '393fd824-cf3b-4f32-aac0-f16616e64bcd'} Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.463860 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance 393fd824-cf3b-4f32-aac0-f16616e64bcd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:08.468644 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3d083a4-64d2-4f50-9749-9daa8ddf00c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd" status: 404 len: 111 microversion: 2.1 time: 0.065144 Oct 04 18:00:08.469764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1276/2456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/393fd824-cf3b-4f32-aac0-f16616e64bcd => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:08.478760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.481087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.497423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.497939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.498380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.499096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.499548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.503731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.529629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.543724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79050588-fc6d-4565-ab66-47b76188a640 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.974229 Oct 04 18:00:08.547591 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1181/2457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:07 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:08.579246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-742bc877-f9e9-4981-bbe2-a6518728de7e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd16bca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.623544 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-742bc877-f9e9-4981-bbe2-a6518728de7e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Image not found. Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-742bc877-f9e9-4981-bbe2-a6518728de7e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd HTTP/1.1 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5501589a-ffa3-4b76-8a8b-d39dfc37c5dd'} Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5501589a-ffa3-4b76-8a8b-d39dfc37c5dd to delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5501589a-ffa3-4b76-8a8b-d39dfc37c5dd could not be found. Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.625663 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-742bc877-f9e9-4981-bbe2-a6518728de7e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:08.631081 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-742bc877-f9e9-4981-bbe2-a6518728de7e tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd" status: 404 len: 62 microversion: 2.1 time: 0.081390 Oct 04 18:00:08.632951 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1182/2458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] DELETE /compute/v2.1/images/5501589a-ffa3-4b76-8a8b-d39dfc37c5dd => generated 62 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:08.643482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.646788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.658342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.659514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.660787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.671654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.673027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.689570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.728168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc HTTP/1.1 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'dfe661fe-d8ea-4211-afaf-0c7461c6a7bc'} Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:08.738736 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24b98089-d1f0-4995-9934-a7f5eb406c7f tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 404 len: 111 microversion: 2.1 time: 0.104116 Oct 04 18:00:08.743766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1183/2459] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:08 2022] DELETE /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:00:08.755844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.756958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: dfe661fe-d8ea-4211-afaf-0c7461c6a7bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.772628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.775299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.775939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.778015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.778593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.779918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.801337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:08.811747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6442b01-b0e5-4435-bfb5-52275f3f4f1a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.341076 Oct 04 18:00:08.812528 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1277/2460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:08.825414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc HTTP/1.1 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'dfe661fe-d8ea-4211-afaf-0c7461c6a7bc'} Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.829318 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. Oct 04 18:00:08.834747 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.836746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance dfe661fe-d8ea-4211-afaf-0c7461c6a7bc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:08.838870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34672bf9-4c6c-47ae-a41e-f53b77fc14d9 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc" status: 404 len: 111 microversion: 2.1 time: 0.092837 Oct 04 18:00:08.839464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1184/2461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] GET /compute/v2.1/servers/dfe661fe-d8ea-4211-afaf-0c7461c6a7bc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:08.857853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73269d72-d7b4-46e6-9cce-045acacc81ab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd02df70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.871152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-858797493", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "0d00d17a-1f2f-4d1c-a39a-93ff893f6b91"}], "block_device_mapping_v2": [{"uuid": "eb767d6e-4f35-472c-b2a0-e3b73dfc02e2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:08.900270 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-73269d72-d7b4-46e6-9cce-045acacc81ab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Image not found. Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73269d72-d7b4-46e6-9cce-045acacc81ab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 HTTP/1.1 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b8175f65-c726-4d87-8b32-c0d720367021'} Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b8175f65-c726-4d87-8b32-c0d720367021 to delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b8175f65-c726-4d87-8b32-c0d720367021 could not be found. Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.902882 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73269d72-d7b4-46e6-9cce-045acacc81ab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:08.906697 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-73269d72-d7b4-46e6-9cce-045acacc81ab tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021" status: 404 len: 62 microversion: 2.1 time: 0.058822 Oct 04 18:00:08.910109 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1278/2462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:08 2022] DELETE /compute/v2.1/images/b8175f65-c726-4d87-8b32-c0d720367021 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:08.921365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3991e40-32c7-4df3-9eb4-e29000bf8180", "name": "network-vif-unplugged", "status": "completed", "tag": "90c6ffdf-46d8-4042-badc-9cb08c77e977"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:08.946606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.947806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.950257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.963944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] validate_networks() for [('0d00d17a-1f2f-4d1c-a39a-93ff893f6b91', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:08.975714 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] Creating event network-vif-unplugged:90c6ffdf-46d8-4042-badc-9cb08c77e977 for instance c3991e40-32c7-4df3-9eb4-e29000bf8180 on n-h2-831194-21 Oct 04 18:00:08.981100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2162c204-ee48-4231-86a2-6cbe8dbe65c1 req-bc25eb9f-369d-45df-90e2-8a6f074d5148 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068938 Oct 04 18:00:08.982246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1279/2463] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:08.988026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:08.988690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:08.995341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:08.997470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.997987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:08.998567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:08.999424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:08.999885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.000333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.020312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 HTTP/1.1 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bae59853-8da0-4004-a56e-d44726a17207'} Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:09.022153 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ed3f60c-6c79-4cd3-bdf0-5c15776957c3 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 404 len: 111 microversion: 2.1 time: 0.040228 Oct 04 18:00:09.026334 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1280/2464] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:08 2022] DELETE /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:09.037315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.038041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: bae59853-8da0-4004-a56e-d44726a17207] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.045462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.046237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.046833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.048422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.049043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.049873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.069253 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 HTTP/1.1 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bae59853-8da0-4004-a56e-d44726a17207'} Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.071210 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. Oct 04 18:00:09.075038 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.083767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance bae59853-8da0-4004-a56e-d44726a17207 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:09.085153 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8457d309-9208-493d-ad7b-02007d23c474 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207" status: 404 len: 111 microversion: 2.1 time: 0.054030 Oct 04 18:00:09.090420 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1281/2465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/bae59853-8da0-4004-a56e-d44726a17207 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:09.094059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c90e70c-d745-4d26-9b05-c55171a67962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '.version_select at 0x7fbdbd02d040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.123959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3c90e70c-d745-4d26-9b05-c55171a67962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Image not found. Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c90e70c-d745-4d26-9b05-c55171a67962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 HTTP/1.1 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '59657aae-c2bd-4527-b181-8345971ce091'} Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 59657aae-c2bd-4527-b181-8345971ce091 to delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 59657aae-c2bd-4527-b181-8345971ce091 could not be found. Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.125699 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c90e70c-d745-4d26-9b05-c55171a67962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c90e70c-d745-4d26-9b05-c55171a67962 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091" status: 404 len: 62 microversion: 2.1 time: 0.037588 Oct 04 18:00:09.132660 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1282/2466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] DELETE /compute/v2.1/images/59657aae-c2bd-4527-b181-8345971ce091 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:00:09.142990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.143999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.153650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.155872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.156560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.157618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.158312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.158961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.174181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 HTTP/1.1 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '12fcdafe-41b2-42ee-832e-350f2f537be8'} Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:09.177232 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b24be44c-4ebc-4fe8-a212-f61d1499aa80 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "DELETE /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 404 len: 111 microversion: 2.1 time: 0.039769 Oct 04 18:00:09.183998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1283/2467] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:09 2022] DELETE /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:09.201604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.202290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] [instance: 12fcdafe-41b2-42ee-832e-350f2f537be8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.215699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.217280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.218041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.219427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.220845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.221728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.243099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] HTTP exception thrown: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Request method failure captured: Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 HTTP/1.1 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHOpy5wlaouq7mhsmOJMaPQdQwGNleVcN615iafbXxhbawo6fDu_WgQNeSx25G3nx7nvNhjhSu92eKfyPN1uj4mtUICMLNtr_YJOU_Bx3-Fubsatc9Vux8rnuUL3GhkFHxqMjOXqVJYEb_rZRsy7FiaaK0k3bRLhFogRr0VJ8NsgVKw Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/138709a891374e24af26f00fe61b2125"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/138709a891374e24af26f00fe61b2125"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_138709a891374e24af26f00fe61b2125"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 138709a891374e24af26f00fe61b2125 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesTestJSON-1730745245 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2e3ae7cc3d854e0690d8354dbca1e6c6 Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesTestJSON-1730745245-project Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '12fcdafe-41b2-42ee-832e-350f2f537be8'} Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.245504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. Oct 04 18:00:09.249896 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:09.252521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] Returning 404 to user: Instance 12fcdafe-41b2-42ee-832e-350f2f537be8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:09.253663 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb2e6ca7-dce0-4b39-a742-10d6ecd1dc11 tempest-ImagesTestJSON-1730745245 tempest-ImagesTestJSON-1730745245-project] 10.222.0.42 "GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8" status: 404 len: 111 microversion: 2.1 time: 0.070308 Oct 04 18:00:09.256115 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1284/2468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/12fcdafe-41b2-42ee-832e-350f2f537be8 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:09.265526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.266682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.278265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.279322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.279986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.281948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.283181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.284193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.618515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:09.628964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:09.634842 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52fe99f0-94ff-424f-84d8-a409556ebad6 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.376987 Oct 04 18:00:09.635683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1285/2469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:09.644281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.645890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.654769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.655635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.656347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.657542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.659623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.661539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.857214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:09.857720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:09.858075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:09.858493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:09.858911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:09.874586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.875083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.880261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.881601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:09.884386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:09.885061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:09.922017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:09.937164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Getting quotas for user 606a8a3f1311407498ad45ed8d78e558 and project b9a0ab319603408d99c87a900deb5a0f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:09.960309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:09.968673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4409446d-ae7a-426f-a74e-0d2601daab9f tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.331627 Oct 04 18:00:09.974944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1286/2470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:09.979756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:09.984249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:09.996893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.002344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.002984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.003748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.005544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.006026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.084000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:10.086714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eb767d6e-4f35-472c-b2a0-e3b73dfc02e2',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:10.319845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4d82412-3d8e-4724-ac1b-5e53db6ca2e8 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.454306 Oct 04 18:00:10.327263 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1185/2471] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:00:10.333556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.334636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.342374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.343216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.343896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.345034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.345856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.346496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.520628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.531996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01af62cd-5242-4f38-9516-62cfa8e2c74d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.555827 Oct 04 18:00:10.534008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1287/2472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:09 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:10.550551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.551856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.684275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.697946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ed24f9a-77c4-4088-93db-3ed18aaa6e95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.367910 Oct 04 18:00:10.698545 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1186/2473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:10.729234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.734072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:10.749001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.749996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.750599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.751861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:10.752534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:10.753163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:10.860968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.874699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.876554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:10.881908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6029b7ca-c8c3-4a86-8640-ec0430422d01 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1103 microversion: 2.25 time: 0.345301 Oct 04 18:00:10.886519 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1288/2474] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1103 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:10.996999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:10.997749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.015571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.018114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.019829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.021175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.023670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.025213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.097724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:11.118651 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f125aac9-07e6-4ca8-9e5f-e05693da0385 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.406228 Oct 04 18:00:11.120002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1187/2475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:11.133813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "name": "network-vif-plugged", "status": "completed", "tag": "93957b9e-c000-4e89-9ec8-213adc1eca3d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:11.155038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.155966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.156722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.175535 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] Creating event network-vif-plugged:93957b9e-c000-4e89-9ec8-213adc1eca3d for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 18:00:11.182273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ee435760-a2b0-4197-9cbe-1fd8e3255a6d req-88d60e19-11c6-4501-a6a6-d66f15860914 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060838 Oct 04 18:00:11.183170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1188/2476] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:11.506014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:11.517580 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-461d9d63-9889-49f7-8183-ff2f47ae1ca4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.524628 Oct 04 18:00:11.518468 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1289/2477] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:10 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:11.561094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:11.562013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.574349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.575172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.575826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.579047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.579755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.580720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.725349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:11.726307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.735125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.736047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.736642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.737506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.738159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.738889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.903267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:11.912147 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85d24a65-523f-4faa-81d5-87b0b4f27163 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.356605 Oct 04 18:00:11.913011 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1189/2478] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:11 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:11.927331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:11.928294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:11.935753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.936465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.937068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:11.937966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:11.938576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:11.939161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.046010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.054863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-51defad2-5cfc-4d8b-adeb-5519985f8a92 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.334714 Oct 04 18:00:12.055651 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1290/2479] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:11 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:12.069688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.078168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be544051-c955-40f7-9add-74881201f342", "tag": "fde89d2a-7cac-416b-955b-72d9372afd4f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:12.089430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.089621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.090119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.090570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.092465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.094271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f119aa6c-f724-4ec8-ad6d-a639514c8ccf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1232 microversion: 2.25 time: 0.179998 Oct 04 18:00:12.096146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1190/2480] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:11 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1232 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:12.119328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] Creating event network-changed:fde89d2a-7cac-416b-955b-72d9372afd4f for instance be544051-c955-40f7-9add-74881201f342 on n-h2-831194-21 Oct 04 18:00:12.126501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a06b03f5-582b-4400-a17d-a2413d20ad51 req-ee0ed790-daa4-4f4c-9091-a40026249a9c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054444 Oct 04 18:00:12.127392 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1291/2481] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:12.150942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.152184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.159017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.159713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.160895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.161775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.162266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.162697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.546531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.547263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.555801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.564292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.564750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.567075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.567555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.567992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.630989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:12.639813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-669877d5-8ce5-461e-9479-4899baa49c13 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.495395 Oct 04 18:00:12.646913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1191/2482] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:12 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:12.652040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.657986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.665094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:12.674089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.674978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.690690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.692128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.693748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.720381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.885850 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-400fe607-7df7-449b-bdb8-5c68e89a9b67 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 204 len: 0 microversion: 2.32 time: 0.694009 Oct 04 18:00:12.889709 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1292/2483] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:00:12 2022] DELETE /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 0 bytes in 696 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:00:12.898308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:12.898684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:12.906927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.907431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.907912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:12.908669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:12.909745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:12.911043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.219207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.229319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.230800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.232077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0508d030-2b38-480d-88b9-836968728fdd tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2949 microversion: 2.32 time: 0.340842 Oct 04 18:00:13.232654 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1293/2484] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:12 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2949 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:13.253389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:13.255077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:13.265902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.270862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.271613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.272549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.273194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.273808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.298409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.316278 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fb00f366-0682-493b-a127-4ff05366fc7c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.667392 Oct 04 18:00:13.333287 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1192/2485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:12 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:13.347841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:13.350298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:13.368440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.369007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.369523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.370292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.373748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.374416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.656604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.665200 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-efbe99ec-112a-4de7-82ca-6fbd1f29506d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.425889 Oct 04 18:00:13.669452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1294/2486] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:13 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:13.683603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:13.684482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:13.708488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.709316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.710003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.710998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.711664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.712335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.806839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.818229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f8281c8-68bb-42a5-81d8-a5b7202252b7 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.483704 Oct 04 18:00:13.835221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1193/2487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:13 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:13.846240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.852976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "name": "network-vif-plugged", "status": "completed", "tag": "e6a9c776-494d-4867-b963-21021a62a3ab"}, {"server_uuid": "c3991e40-32c7-4df3-9eb4-e29000bf8180", "name": "network-vif-plugged", "status": "completed", "tag": "90c6ffdf-46d8-4042-badc-9cb08c77e977"}, {"server_uuid": "3996315c-68bb-4733-8862-1cb35afe086a", "name": "network-vif-plugged", "status": "completed", "tag": "c7571545-55e8-4c0b-9677-2122c2abeff9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:13.868784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.871541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:13.873623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-452be0fa-9811-467e-958c-44dd4e90b241 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1250 microversion: 2.25 time: 0.202898 Oct 04 18:00:13.875606 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1295/2488] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:13 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1250 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:13.884001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:13.884904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:13.892729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.893478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.895855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.898399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.899177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.899860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.901576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:13.903456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:13.904241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:13.948845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Creating event network-vif-plugged:e6a9c776-494d-4867-b963-21021a62a3ab for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 18:00:13.949521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Creating event network-vif-plugged:90c6ffdf-46d8-4042-badc-9cb08c77e977 for instance c3991e40-32c7-4df3-9eb4-e29000bf8180 on n-h2-831194-21 Oct 04 18:00:13.950045 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] Creating event network-vif-plugged:c7571545-55e8-4c0b-9677-2122c2abeff9 for instance 3996315c-68bb-4733-8862-1cb35afe086a on n-h1-831194-21 Oct 04 18:00:13.967497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3caada6a-41b6-43ab-81d3-4d21b8da0467 req-c71556c5-9440-44b9-85c1-66aa9abda981 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.130460 Oct 04 18:00:13.973964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:13.976602 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1194/2489] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:14.249813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:14.258896 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58787643-edd8-4622-9282-2e12b3638b74 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.382061 Oct 04 18:00:14.259704 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1296/2490] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:13 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:14.267906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:14.268830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:14.286201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.295395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.296302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.298980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.300336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.303079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.353240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:14.356671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:14.376238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.378550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.379286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:14.382579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:14.383449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:14.384039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.115880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.135481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.137098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.144457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44ee00f5-1f6b-4e44-a26a-83208907c4cb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2949 microversion: 2.32 time: 0.877694 Oct 04 18:00:15.147028 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1195/2491] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:14 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2949 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:15.155543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:15.156166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:15.169887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.173428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.175368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.182378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.183200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.185389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.549811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.562287 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a3afd19-53cb-483c-9887-dba35d9d5e70 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 1.219926 Oct 04 18:00:15.578526 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1297/2492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:14 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:15.583807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:15.584501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:15.599491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.600248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.604359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.605319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.605991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.606591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.808032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.818973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e03e2b27-5151-4300-997e-8ee8ffee9f95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.254437 Oct 04 18:00:15.820407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1298/2493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:15.825675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:15.826592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:15.834079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.835016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.835712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.836648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.837331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.838029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.871815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:15.884512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-868c5bf0-4f9d-46b8-8f62-83d29572941d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.735365 Oct 04 18:00:15.889882 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1196/2494] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:15.890069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:15.890532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:15.920231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.921015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.921503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:15.925038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:15.925575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:15.927053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.081033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.091550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.092564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.094631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55acf307-0838-429e-998a-81becf977e84 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1292 microversion: 2.25 time: 0.272238 Oct 04 18:00:16.095930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1299/2495] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1292 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:16.182576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.183528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.194810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.196484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.197642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.198586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.199815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.201091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.507463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.524159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.528184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.530009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-933203d6-6f4f-40aa-bf49-ad0b04832973 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2949 microversion: 2.32 time: 0.352125 Oct 04 18:00:16.532200 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1300/2496] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:16 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2949 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:16.589635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.590843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.592264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.603500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3483a136-656f-40ec-8729-7fee692dc836 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1523 microversion: 2.1 time: 0.717005 Oct 04 18:00:16.604737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1197/2497] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:15 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1523 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:16.606147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.606829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.609718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.614110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.615020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.615615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.847424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:16.848639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:16.859790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.860283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.866872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.868037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:16.868669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:16.869261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:16.982400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:16.993794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5921ef64-594e-4c79-9cf7-ea03199593f7 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.410527 Oct 04 18:00:17.013219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1301/2498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:16 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:17.021065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.022406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.031703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.032397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.033183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.034152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.036365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.037800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.062200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:17.275673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.293725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa3c43d1-3750-48bf-bd66-6de84b9bf55c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1333 microversion: 2.1 time: 0.278397 Oct 04 18:00:17.304707 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1302/2499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1333 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:17.336908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.337951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.359432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.360618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.361308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.362607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.364774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.366491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.429624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.437094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:17.444709 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cab12629-2cd7-4957-9b1d-e14251885af2 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1319 microversion: 2.1 time: 0.603265 Oct 04 18:00:17.445956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1198/2500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:16 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1319 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:17.562576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.563527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.576216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.576717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.577414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.577905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.578366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.578805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.653375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.661810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.663303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.664449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad425278-1585-44a2-ba64-d17095ed2f4c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1292 microversion: 2.25 time: 0.341996 Oct 04 18:00:17.665011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1303/2501] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1292 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:17.693970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.694611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.702854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.703473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.703983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.705658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.706182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.706788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.876097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:17.887595 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a698da22-de44-4341-84fd-ee0812217165 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1508 microversion: 2.1 time: 0.215769 Oct 04 18:00:17.888522 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1304/2502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1508 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:17.915252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:17.916308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:17.923434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.923935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.924375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:17.925180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:17.926362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:17.927050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.123947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.137080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23775c36-7bd2-4d0d-8611-efa2558af21b tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 200 len: 1508 microversion: 2.1 time: 0.226583 Oct 04 18:00:18.153904 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1305/2503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:18.162368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.163107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.173950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.175003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.175555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.176804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.177370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.178153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.449153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.463585 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00cda1e7-7385-4a7a-8b81-93f2838fc199 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.324284 Oct 04 18:00:18.464248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1306/2504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:18 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:18.470765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.472394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.481014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.485303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.485780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.486584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.487064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.487510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.538973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:18.624702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.651136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.654878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:18.661724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3edcdf10-7ef9-499e-9a6e-820b302dc0eb tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2949 microversion: 2.32 time: 1.101655 Oct 04 18:00:18.663157 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1199/2505] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:17 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2949 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:18.676867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb690201-1c8d-482b-97c4-7cb4d55ce575", "tag": "d3772592-0a4c-44be-9433-4dec3335ee85"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:18.720633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.734924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.735543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.774856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] Creating event network-changed:d3772592-0a4c-44be-9433-4dec3335ee85 for instance fb690201-1c8d-482b-97c4-7cb4d55ce575 on n-h2-831194-21 Oct 04 18:00:18.787370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca064120-442f-49a9-be6b-14cfd10c3692 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 204 len: 0 microversion: 2.1 time: 0.321628 Oct 04 18:00:18.790241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1307/2506] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:18 2022] DELETE /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:18.791653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-703c3192-3fa4-4e0e-9c2f-8efab65cfe0b req-6dac6351-a9ad-4421-a9ae-87c07aed6566 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124982 Oct 04 18:00:18.795156 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1200/2507] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:18.809755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.810754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:18.811534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.813067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:18.826215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.828026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.831761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.834330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.837034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.837620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.838092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.838627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.839087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:18.839823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:18.840291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:18.840734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.302687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.323897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-449f774e-695d-4ec5-b110-8cb76a123f1a tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1669 microversion: 2.1 time: 0.530847 Oct 04 18:00:19.324517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1308/2508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:18 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1669 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:19.333166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.335944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.349416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.350198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.350801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.351669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.353128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.354085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.506340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.518970 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd411201-46db-4eb1-8ce3-6cfa0430a64b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1469 microversion: 2.1 time: 0.719302 Oct 04 18:00:19.523848 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1201/2509] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:18 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1469 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:19.529546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2116570649", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5aedda1f-baf0-459d-966b-7a8f7e6088bb"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:19.570298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.581063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.583534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.584979 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2759cd4-019c-4403-8b60-a8f3ad56563f tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1292 microversion: 2.25 time: 0.257636 Oct 04 18:00:19.586077 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1309/2510] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1292 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:19.602714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be544051-c955-40f7-9add-74881201f342", "name": "network-vif-plugged", "status": "completed", "tag": "fde89d2a-7cac-416b-955b-72d9372afd4f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:19.614751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.615410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.616014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.630961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] validate_networks() for [('5aedda1f-baf0-459d-966b-7a8f7e6088bb', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:00:19.632564 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] Creating event network-vif-plugged:fde89d2a-7cac-416b-955b-72d9372afd4f for instance be544051-c955-40f7-9add-74881201f342 on n-h2-831194-21 Oct 04 18:00:19.640512 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cf31c7ec-6d2d-4312-a436-9de0c8402ade req-8f964c8b-3ff9-4b62-91f6-91fa5f70d87c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052491 Oct 04 18:00:19.641801 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1310/2511] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:19.649091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.650296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.657951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.658791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.659378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.661338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.662504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.663098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.700829 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1d1a619-4209-47ea-9e3d-bd673b520775 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d/ips" status: 200 len: 180 microversion: 2.1 time: 0.057526 Oct 04 18:00:19.701951 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1311/2512] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d/ips => generated 180 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:19.709109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:19.710104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.721239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.722110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.723374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.724540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.725124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.725728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.908083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:19.951887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:19.952925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:19.967487 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e01693e8-54e4-4df1-8af1-eca70046f115 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1325 microversion: 2.1 time: 0.264145 Oct 04 18:00:19.981866 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1312/2513] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:19 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1325 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:19.981866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:19.981866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:19.981866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.982790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.983628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:19.984704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:19.985519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:19.986232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.037030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lazy-loading 'flavor' on Instance uuid 3996315c-68bb-4733-8862-1cb35afe086a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:20.155561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fb767ba-7fc2-4068-bdf1-0157352c4b45 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a/action" status: 202 len: 0 microversion: 2.1 time: 0.185342 Oct 04 18:00:20.159509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1313/2514] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:19 2022] POST /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:00:20.177906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.178684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.192079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.192551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.193046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.193774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.194264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.194741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.816227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.851989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.855622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:20.856997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93986c4f-c9dc-4e6d-a8a5-b9aeea0b35d2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2928 microversion: 2.32 time: 0.699321 Oct 04 18:00:20.857979 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1314/2515] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:20 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2928 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:20.865243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:20.865818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:20.873794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:20.875690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.876192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.876689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.877481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:20.878175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:20.878831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:20.921232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:20.975476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:21.102775 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-438b83cd-970d-4f3d-bc72-79e977f89e8d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 204 len: 0 microversion: 2.1 time: 0.242136 Oct 04 18:00:21.103460 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1315/2516] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:20 2022] DELETE /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:21.116986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.119917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.128920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.129592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.130175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.131704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.132428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.133305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.169413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:00:21.172056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:00:21.173177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:00:21.184119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:00:21.186218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:00:21.212135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.224860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.227188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.230927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.234962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.236294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.276105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:21.282794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Getting quotas for user 56b04b3d7b1e413292af14ed0e2edb09 and project 0683140028754f90b34960150150068d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:21.297007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:21.328909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:00:21.333685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:00:21.445948 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5120996f-c50c-49a5-a971-27d1e6099038 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919230 Oct 04 18:00:21.454780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1202/2517] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:00:21.525371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:21.538259 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93c823df-bfba-4415-b4ec-377be93d492b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1460 microversion: 2.1 time: 0.432097 Oct 04 18:00:21.540231 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1316/2518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1460 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:21.559776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:21.561112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:21.577788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.578644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.583633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:21.585350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:21.586855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:21.588506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.011222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.025133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.028279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.030700 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc307351-c585-480f-8496-0992be891e73 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1292 microversion: 2.25 time: 0.488642 Oct 04 18:00:22.046921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1317/2519] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:21 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1292 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:22.063137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.063817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.075924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.076419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.076856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.077563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.077686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e73e540-f497-464a-9627-03ffdef4537c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdbd16a5e0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5QXObB3875JpLXMfaMEbDxwqA/AjIPRwCIwIFlMT5WbsIZTfL7vljQ1lTZeqL+JOcZCzawaMBjdgpFpj8ACQoLQIuzSNDz/kujILMAcKFO3+K1jGaTX4z3mELn0TYLjA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:22.078310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.078746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e73e540-f497-464a-9627-03ffdef4537c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 257 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5QXObB3875JpLXMfaMEbDxwqA/AjIPRwCIwIFlMT5WbsIZTfL7vljQ1lTZeqL+JOcZCzawaMBjdgpFpj8ACQoLQIuzSNDz/kujILMAcKFO3+K1jGaTX4z3mELn0TYLjA=="}} Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5QXObB3875JpLXMfaMEbDxwqA/AjIPRwCIwIFlMT5WbsIZTfL7vljQ1lTZeqL+JOcZCzawaMBjdgpFpj8ACQoLQIuzSNDz/kujILMAcKFO3+K1jGaTX4z3mELn0TYLjA=='}}} Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 04 18:00:22.086315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e73e540-f497-464a-9627-03ffdef4537c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:22.090894 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e73e540-f497-464a-9627-03ffdef4537c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.637752 Oct 04 18:00:22.101910 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1203/2520] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:21 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 644 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:22.321327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3991e40-32c7-4df3-9eb4-e29000bf8180", "name": "network-vif-deleted", "tag": "90c6ffdf-46d8-4042-badc-9cb08c77e977"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:22.345743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.349601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.350413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.356377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.372010 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eedb75be-0033-4cd0-bf79-fa80bde3f99e tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1522 microversion: 2.1 time: 0.322355 Oct 04 18:00:22.372973 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1318/2521] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.386130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.386889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.388083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] Creating event network-vif-deleted:90c6ffdf-46d8-4042-badc-9cb08c77e977 for instance c3991e40-32c7-4df3-9eb4-e29000bf8180 on n-h2-831194-21 Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.400099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.436707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5a84c423-e4a1-43de-b38f-039cb6650424 req-3c06d4da-cfe6-46de-8cbf-ae21c223ff4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.330752 Oct 04 18:00:22.439074 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1204/2522] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:22.449997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.450996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.459897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.460820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.461451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.462610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.463464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.464129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.619173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.627957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e88b770b-587d-4202-8c87-c62dcfb0030c tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1675 microversion: 2.1 time: 0.253365 Oct 04 18:00:22.637929 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1319/2523] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.637929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:22.637929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:22.642859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.643364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.643810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.644566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.645198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.645907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:22.934780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:22.946620 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13e0ae00-6f3e-4b01-96d6-455db71529c3 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1222 microversion: 2.1 time: 0.505887 Oct 04 18:00:22.947319 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1205/2524] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1222 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:22.958696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-unplugged", "status": "completed", "tag": "5c7a6da1-ba4c-454e-8f5c-970dfade82c8"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-unplugged", "status": "completed", "tag": "78e075c1-d1f1-4533-bab5-3813daaa8bae"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-unplugged", "status": "completed", "tag": "e910d5c6-456a-4049-803a-bd29699c9db8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:22.982175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:22.982657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:22.991285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.006735 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Creating event network-vif-unplugged:5c7a6da1-ba4c-454e-8f5c-970dfade82c8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:23.007631 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Creating event network-vif-unplugged:78e075c1-d1f1-4533-bab5-3813daaa8bae for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:23.008325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] Creating event network-vif-unplugged:e910d5c6-456a-4049-803a-bd29699c9db8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:23.015481 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-045d862d-4646-4875-aeda-0c565794aab3 req-a04feb7f-b709-4e2a-ba47-1d54b177d1c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.060286 Oct 04 18:00:23.022196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1206/2525] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:23.022326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed0e0aa0-bd2b-4c90-9de7-65fbabcbf523 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1613 microversion: 2.1 time: 0.391632 Oct 04 18:00:23.028629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.029110 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1320/2526] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:22 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1613 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:23.029680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.036205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1e5e8b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-423209268", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:23.038268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.039264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.039872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.040752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.041365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.042432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.050722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:23.064380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:23.072341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for user 75ba1b2b3e934963bcf9d0d0af3d2806 and project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:23.091878 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 2166 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-423209268", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:23.108154 n-d-831194-21 devstack@n-api.service[128849]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-423209268', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:23.110618 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8b6213a-6767-4e34-92f1-0d7aa6df7e4b tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.083023 Oct 04 18:00:23.114962 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1321/2527] 10.222.0.42 () {60 vars in 1160 bytes} [Tue Oct 4 18:00:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:00:23.120786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.121625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.129383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.129911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.130469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.131363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.131931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.132368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.165135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:23.244110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3e1b6b3-3775-4026-82e9-4bcbe8a8f80a tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 204 len: 0 microversion: 2.1 time: 0.127629 Oct 04 18:00:23.244623 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1322/2528] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:23 2022] DELETE /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:23.249696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.253221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.253707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.254310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.255064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.255518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.255951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.281248 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-addcc815-aa62-45e2-b99d-a9014d5ebe10 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.035419 Oct 04 18:00:23.282201 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1323/2529] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:23.286906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.287642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.293536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.294067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.294511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.295222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.295680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.296110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.446351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.455967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.458278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.459419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e4bdb30-8cd6-440d-a3e7-c329d3bfec3c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.176279 Oct 04 18:00:23.460422 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1324/2530] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:23.464847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fafaaef4-ff2b-4070-8077-7c7f6efcfe3c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1e5eca0>, body: {"keypair": {"name": "tempest-keypair-1680434811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP30M5qhwotuO2x12nkvkCwKt23Q/Xiv2xFQx0c+we1J99bQdYfB/cjHaQOO5wdSX1fI1zAO/F9+MM2drwQXYRmcUU/VO/25WRX2mfyC2VSeUghLs/eI2tbucyP54nXTEA=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:23.482282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fafaaef4-ff2b-4070-8077-7c7f6efcfe3c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:23.487648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fafaaef4-ff2b-4070-8077-7c7f6efcfe3c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for user 75ba1b2b3e934963bcf9d0d0af3d2806 and project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:23.516454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fafaaef4-ff2b-4070-8077-7c7f6efcfe3c tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055092 Oct 04 18:00:23.517359 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1325/2531] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:23.526775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.527398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.534673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.535201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.535906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.536845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.537535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.538002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.596514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.607984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.609521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.611037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b80ccd9b-83d0-4e62-8c5d-50167e817e33 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2907 microversion: 2.32 time: 0.587120 Oct 04 18:00:23.612204 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1207/2532] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2907 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:23.618982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-831194-21", "block_migration": true, "disk_over_commit": false}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:23.637844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.657740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.659565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.660302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.661422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.662725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.663427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.697248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Lazy-loading 'flavor' on Instance uuid 3996315c-68bb-4733-8862-1cb35afe086a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:23.725492 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3996315c-68bb-4733-8862-1cb35afe086a while it is in vm_state suspended Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Request method failure captured: Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a/action HTTP/1.1 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 98 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHSApKCiQDr3XDBT4-qI2RTkwft6OLF1-G7SUz7AYBrc1wiSmriybxNdA32HfQ0QtIfbaEYtVsTMkQfGlsdNUmfLKIZyIFCBvZIu-CLhiQ2uinVqYaolbPykQvyf5Q4eNYWlTt9UMjHlBAOuqijmZojD3fN8pubicq0PBsuaJ5B9OGI Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ceb99765b9f44ff2b4f2b414ffa54c78 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ceb99765b9f44ff2b4f2b414ffa54c78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ceb99765b9f44ff2b4f2b414ffa54c78 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1618548972 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveMigrationNegativeTest-1618548972-project-admin Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ac736cd8b36249e79836f86afb9465e8 Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveMigrationNegativeTest-1618548972-project-admin Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: {"os-migrateLive": {"host": "n-h2-831194-21", "block_migration": true, "disk_over_commit": false}} Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot 'os-migrateLive' instance 3996315c-68bb-4733-8862-1cb35afe086a while it is in vm_state suspended Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3996315c-68bb-4733-8862-1cb35afe086a', 'body': {'os-migrateLive': {'host': 'n-h2-831194-21', 'block_migration': True, 'disk_over_commit': False}}} Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3996315c-68bb-4733-8862-1cb35afe086a in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.731800 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 3996315c-68bb-4733-8862-1cb35afe086a while it is in vm_state suspended Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 3996315c-68bb-4733-8862-1cb35afe086a while it is in vm_state suspended Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.735727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3996315c-68bb-4733-8862-1cb35afe086a while it is in vm_state suspended {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:23.739416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6cf033e-9220-472f-abc1-b3c97de2ce36 tempest-LiveMigrationNegativeTest-1618548972 tempest-LiveMigrationNegativeTest-1618548972-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a/action" status: 409 len: 155 microversion: 2.1 time: 0.122543 Oct 04 18:00:23.739416 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1208/2533] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:00:23 2022] POST /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a/action => generated 155 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:23.763306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1ebf3a0>, body: {"keypair": {"name": "tempest-keypair-1680434811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBwNM/sLhI1A1kqMqU0CFGIc3WFPEysYyTw4hwsg3zQGDi9c+5mSJ6Xfc8yH/qTETZfmq5PdgDp3NUw58WDRXp8HzbJ8ZxeLCHEm/8to0ayN8PyxrfNF9ukYKqNcfdQg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:23.766334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:23.774338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3dd21e0e-12d5-4d71-af6b-e5ce26c31f53 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1528 microversion: 2.1 time: 0.256217 Oct 04 18:00:23.777052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1326/2534] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1528 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:23.787781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.788452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.800142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.800650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.801154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.801930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.802401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.802839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.803072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:23.818358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for user 75ba1b2b3e934963bcf9d0d0af3d2806 and project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:23.859538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] HTTP exception thrown: Key pair 'tempest-keypair-1680434811' already exists. Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 273 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: {"keypair": {"name": "tempest-keypair-1680434811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBwNM/sLhI1A1kqMqU0CFGIc3WFPEysYyTw4hwsg3zQGDi9c+5mSJ6Xfc8yH/qTETZfmq5PdgDp3NUw58WDRXp8HzbJ8ZxeLCHEm/8to0ayN8PyxrfNF9ukYKqNcfdQg=="}} Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: exception: Key pair 'tempest-keypair-1680434811' already exists. Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1680434811', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBwNM/sLhI1A1kqMqU0CFGIc3WFPEysYyTw4hwsg3zQGDi9c+5mSJ6Xfc8yH/qTETZfmq5PdgDp3NUw58WDRXp8HzbJ8ZxeLCHEm/8to0ayN8PyxrfNF9ukYKqNcfdQg=='}}} Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '75ba1b2b3e934963bcf9d0d0af3d2806-tempest-keypair-1680434811' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:00:23.866883 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi session.flush() Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result.read() Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 04 18:00:23.870399 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '75ba1b2b3e934963bcf9d0d0af3d2806-tempest-keypair-1680434811' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 4, 18, 0, 23, 851746), 'updated_at': None, 'name': 'tempest-keypair-1680434811', 'user_id': '75ba1b2b3e934963bcf9d0d0af3d2806', 'fingerprint': 'e1:5d:1f:b9:6b:6a:c8:dc:ac:2a:cd:ab:84:d0:29:eb', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZBwNM/sLhI1A1kqMqU0CFGIc3WFPEysYyTw4hwsg3zQGDi9c+5mSJ6Xfc8yH/qTETZfmq5PdgDp3NUw58WDRXp8HzbJ8ZxeLCHEm/8to0ayN8PyxrfNF9ukYKqNcfdQg==', 'type': 'ssh'}] Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi keypair.create() Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._create() Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1680434811' already exists. Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 04 18:00:23.873848 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1680434811' already exists. Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1680434811' already exists. Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 409 to user: Key pair 'tempest-keypair-1680434811' already exists. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-823f1c0a-ed6c-423b-8105-e3ba2e860d61 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.113161 Oct 04 18:00:23.884315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1209/2535] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:23 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:23.890033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:23.890033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:23.901816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.904744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.905208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.906520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:23.906644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:23.907025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:23.973247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:24.004411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.021338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-521d504e-f6cb-4465-b0ae-8c154c2f2a7d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1675 microversion: 2.1 time: 0.240195 Oct 04 18:00:24.024453 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1327/2536] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:23 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:24.048485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-084f341e-4a09-48ed-97ce-1d800dbca1d3 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Calling method '.version_select at 0x7fbdc1da5e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.125352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-084f341e-4a09-48ed-97ce-1d800dbca1d3 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680434811" status: 202 len: 0 microversion: 2.1 time: 0.095647 Oct 04 18:00:24.130389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1328/2537] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1680434811 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:00:24.142758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.147856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:24.171926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6ed7c1f-4e8a-475b-a0c9-f890e5a8ea5a tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 204 len: 0 microversion: 2.1 time: 0.290622 Oct 04 18:00:24.176939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1210/2538] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:23 2022] DELETE /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:24.194200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-575a7e0e-035f-4036-89c2-c5f0ab15c18a tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1e69b80>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCdkNxPyVh93DMXJxDTBU9CfFxt5BuNP0JmDkqVvq4mkaASbXdJZ4xoSG+sYNBeUIp/1Mmw/V2+MAMVtr+lhYdoFP4P3p2kgYox7nZoY6qqLyzoX5kSY+Ulw4c7vqaF5w=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:24.200083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.200689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.201162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-575a7e0e-035f-4036-89c2-c5f0ab15c18a tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 247 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCdkNxPyVh93DMXJxDTBU9CfFxt5BuNP0JmDkqVvq4mkaASbXdJZ4xoSG+sYNBeUIp/1Mmw/V2+MAMVtr+lhYdoFP4P3p2kgYox7nZoY6qqLyzoX5kSY+Ulw4c7vqaF5w=="}} Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCdkNxPyVh93DMXJxDTBU9CfFxt5BuNP0JmDkqVvq4mkaASbXdJZ4xoSG+sYNBeUIp/1Mmw/V2+MAMVtr+lhYdoFP4P3p2kgYox7nZoY6qqLyzoX5kSY+Ulw4c7vqaF5w=='}}} Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '' Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:24.207588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:00:24.212547 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.214095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.214095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.214095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.220719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-575a7e0e-035f-4036-89c2-c5f0ab15c18a tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:24.224331 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-575a7e0e-035f-4036-89c2-c5f0ab15c18a tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.042301 Oct 04 18:00:24.231151 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1211/2539] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:24 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:24.242584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "name": "network-vif-deleted", "tag": "93957b9e-c000-4e89-9ec8-213adc1eca3d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:24.259147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.259957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.260621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.277095 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] Creating event network-vif-deleted:93957b9e-c000-4e89-9ec8-213adc1eca3d for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 18:00:24.283738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-24be9a6b-9f8f-4578-bbe3-da62d3d4c0f4 req-7521ffc5-5d06-417e-803e-7304628b16fd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050589 Oct 04 18:00:24.285052 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1212/2540] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:24.304279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.305569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:24.332822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.337163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.338309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.339525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.340856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.343951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.365288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.378324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5843277-d55f-4754-a725-4f25367fe925 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1278 microversion: 2.1 time: 0.249649 Oct 04 18:00:24.379827 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1329/2541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:24 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:24.393626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1e5e820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508232935", "public_key": " "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:24.429059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:24.443830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for user 75ba1b2b3e934963bcf9d0d0af3d2806 and project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:24.467300 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 94 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-508232935", "public_key": " "}} Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-508232935', 'public_key': ' '}}} Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.470987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d764f543-a9d9-4426-b4bc-9d97aac88a3e tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.092305 Oct 04 18:00:24.476187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1330/2542] 10.222.0.42 () {60 vars in 1158 bytes} [Tue Oct 4 18:00:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:00:24.485938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.487047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:24.497154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.498018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.498653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.499546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.500163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.500752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.721404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.735396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.737223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.739162 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3fe645e-564e-4185-a9ac-820dd924e238 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.256477 Oct 04 18:00:24.740794 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1331/2543] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:24 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:24.750191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ebe4e8b-672b-42ca-831e-bdd5e4888d39 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdc1da5940>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2hwPRUgGNhpvL5LFNPw4uUwfjfGqh1mSiZkv9aw1kmUdhNgYIsro1eQ7IzAiXUEX2J8Lzg+x+T1XYca+Y9QDIX9Pd//1gz2S6KqIjaHZ2s6WJq2+f3PwEbdTcfz9NMiw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ebe4e8b-672b-42ca-831e-bdd5e4888d39 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 507 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2hwPRUgGNhpvL5LFNPw4uUwfjfGqh1mSiZkv9aw1kmUdhNgYIsro1eQ7IzAiXUEX2J8Lzg+x+T1XYca+Y9QDIX9Pd//1gz2S6KqIjaHZ2s6WJq2+f3PwEbdTcfz9NMiw=="}} Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2hwPRUgGNhpvL5LFNPw4uUwfjfGqh1mSiZkv9aw1kmUdhNgYIsro1eQ7IzAiXUEX2J8Lzg+x+T1XYca+Y9QDIX9Pd//1gz2S6KqIjaHZ2s6WJq2+f3PwEbdTcfz9NMiw=='}}} Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 04 18:00:24.758034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ebe4e8b-672b-42ca-831e-bdd5e4888d39 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ebe4e8b-672b-42ca-831e-bdd5e4888d39 tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.017371 Oct 04 18:00:24.761002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1332/2544] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:24 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:24.771559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.772594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:24.784301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:24.788809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.792434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.794814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.796071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.797768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.798379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.803802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c436591-2d02-41f7-b363-57e5790f0c95 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1466 microversion: 2.1 time: 0.516717 Oct 04 18:00:24.804716 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1213/2545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:24 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1466 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:24.812411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Action: 'create', calling method: .version_select at 0x7fbdbd868940>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1265415320", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:24.873291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:24.889578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Getting quotas for user 75ba1b2b3e934963bcf9d0d0af3d2806 and project 40b904c7986f440f86055e76e10d64ff. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:24.916798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 118 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1265415320", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: exception: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1265415320', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 04 18:00:24.920034 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 04 18:00:24.923906 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:24.929130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:24.930158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c22d21bb-6ed7-4a26-adc5-74e2ab9629fd tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.123587 Oct 04 18:00:24.934804 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1214/2546] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:00:24 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 127 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:00:24.939266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:24.940021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:24.949097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.949604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.950081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:24.950810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:24.951268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:24.951700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.108779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.132603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.136297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.149361 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca67e6bf-1924-485f-9a20-b257d7c99499 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2861 microversion: 2.32 time: 0.376602 Oct 04 18:00:25.151364 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1333/2547] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:24 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2861 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:25.157493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c48fc392-7e08-4cb6-af0b-dfaea75c21fe tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Calling method '.version_select at 0x7fbdc1e48e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.187450 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c48fc392-7e08-4cb6-af0b-dfaea75c21fe tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c48fc392-7e08-4cb6-af0b-dfaea75c21fe tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Request method failure captured: Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-323977579 HTTP/1.1 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHS0G-dDJ0cDdq4ds22XmiA_a4Z1WWq24cIXX-uxdCMRUvPo8UQgQfzWtaN8iAkBm_eSbUzGeTbzyP4ckeXzWmWHrghGb4BnWCUnOYG2WsU_kdV9DNQTvc1Kbq9NQ0_g84_jAzxVXFhtekbd2ZojW6iPyy9M6wtyn6Pl8lPyC9AnCGU Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/40b904c7986f440f86055e76e10d64ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_40b904c7986f440f86055e76e10d64ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 40b904c7986f440f86055e76e10d64ff Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-865547280 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-KeyPairsNegativeTestJSON-865547280-project Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: exception: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'tempest-keypair-non-existent-323977579'} Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise self.value Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.191820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c48fc392-7e08-4cb6-af0b-dfaea75c21fe tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] Returning 404 to user: Keypair tempest-keypair-non-existent-323977579 not found for user 75ba1b2b3e934963bcf9d0d0af3d2806 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c48fc392-7e08-4cb6-af0b-dfaea75c21fe tempest-KeyPairsNegativeTestJSON-865547280 tempest-KeyPairsNegativeTestJSON-865547280-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-323977579" status: 404 len: 144 microversion: 2.1 time: 0.040651 Oct 04 18:00:25.195513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1334/2548] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 18:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-323977579 => generated 144 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:25.205371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-unplugged", "status": "completed", "tag": "9ee68e4b-b282-44d0-9a38-8266e4d20a88"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-unplugged", "status": "completed", "tag": "c0e2a82b-d291-45a2-a17a-2b9ae86d6207"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:25.228196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.228697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.229142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.250766 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Creating event network-vif-unplugged:9ee68e4b-b282-44d0-9a38-8266e4d20a88 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:25.251474 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] Creating event network-vif-unplugged:c0e2a82b-d291-45a2-a17a-2b9ae86d6207 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:25.258716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0405e51f-f83f-4a75-8732-bba41b72288b req-f4623997-7bdf-4fd9-a68c-622acd044e97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.062316 Oct 04 18:00:25.260694 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1335/2549] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:25.267136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.268004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.277349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.277715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.278342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.279502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.279970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.280461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.430608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d553fff0e64a2ca5970bf9897eaff1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42151954583a4ff68618a0a783fdc7d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.440090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-527ab475-106f-47d0-b51b-e8703ebc652e tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 200 len: 1612 microversion: 2.1 time: 0.178344 Oct 04 18:00:25.440800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1336/2550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 1612 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:25.443867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.465099 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2f47a91-ac2a-403c-b4da-6a5b268b6935 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1528 microversion: 2.1 time: 0.532009 Oct 04 18:00:25.466148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1215/2551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:24 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1528 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:25.468436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.469106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.477649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.478523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.478971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.479678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.480142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.480569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.543757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:25.743906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:25.753670 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5de7aab-c1d8-49c2-847e-36727d744dc4 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1276 microversion: 2.1 time: 0.311543 Oct 04 18:00:25.757303 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1337/2552] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1276 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:25.779092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.779092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.789566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.792632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.793301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.795319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.795959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.797340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.830307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:25.831382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:25.851033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.853646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.854405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:25.856162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:25.859461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:25.861579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.283035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.294572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4350a30c-6f9b-4283-a36f-2c31bde10936 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1466 microversion: 2.1 time: 0.469117 Oct 04 18:00:26.297415 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1338/2553] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1466 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:26.308312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.308894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.325185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.327132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.329140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.334522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.335080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.335538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.596792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.605526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.607008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.608139 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d8deeb4-ab83-42f8-a1d4-b264dc97a4a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.839273 Oct 04 18:00:26.617660 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1216/2554] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:25 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:26.633978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be544051-c955-40f7-9add-74881201f342", "name": "network-vif-deleted", "tag": "fde89d2a-7cac-416b-955b-72d9372afd4f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:26.654758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.655391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.655909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.670738 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] Creating event network-vif-deleted:fde89d2a-7cac-416b-955b-72d9372afd4f for instance be544051-c955-40f7-9add-74881201f342 on n-h2-831194-21 Oct 04 18:00:26.678576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-165f3a30-2a15-43af-b2aa-97a5c5e56234 req-7a0b387e-ac93-47fc-bd6f-7bff2a01dc8f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058772 Oct 04 18:00:26.680975 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1217/2555] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:26.688820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.690142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.701401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.703192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.705697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.708503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.709346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.710063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.737511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d HTTP/1.1 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7451688f-258e-4401-9fd8-3e41c26f321d'} Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:26.741353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:26.746078 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:26.748546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:26.749972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2675e21-96e6-472a-932d-f62d2b665488 tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 404 len: 111 microversion: 2.1 time: 0.067262 Oct 04 18:00:26.751932 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1218/2556] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:26.759053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:26.759964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:26.768102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.768785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.771005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.771907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.772517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.773095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.854847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:26.856287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:26.857641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:26.858818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lazy-loading 'fault' on Instance uuid be544051-c955-40f7-9add-74881201f342 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:26.931889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.959844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.965282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:26.970863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0778a103-d2e8-4c66-92b9-d49acc11d73a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2861 microversion: 2.32 time: 0.672255 Oct 04 18:00:26.987517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1339/2557] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2861 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:27.003098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-deleted", "tag": "78e075c1-d1f1-4533-bab5-3813daaa8bae"}, {"server_uuid": "7451688f-258e-4401-9fd8-3e41c26f321d", "name": "network-vif-deleted", "tag": "e6a9c776-494d-4867-b963-21021a62a3ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:27.015202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.015680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.016102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.046804 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Creating event network-vif-deleted:78e075c1-d1f1-4533-bab5-3813daaa8bae for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:27.047320 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] Creating event network-vif-deleted:e6a9c776-494d-4867-b963-21021a62a3ab for instance 7451688f-258e-4401-9fd8-3e41c26f321d on n-h1-831194-21 Oct 04 18:00:27.070542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-78228f4e-35be-4f52-bb16-6df355e66375 req-3eee1678-c9d8-432c-97a9-dc194c68eabb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.078971 Oct 04 18:00:27.073414 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1340/2558] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:27.079983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c110945b1ec49fb91c8d3e67a6c2178', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c881903a7ca74d89bfe90b5aa5a535da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.089973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-486d6d17-373f-497d-b4fb-ab4a6f0cbd0c tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 200 len: 1315 microversion: 2.1 time: 0.336655 Oct 04 18:00:27.090586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.091384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.110220 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1219/2559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:26 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:27.124025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.124929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.125562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.126523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.127210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.127828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.320780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.321407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.341606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.342133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.342785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.343508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.343972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.344398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.665377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:27.674080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-790fd545-1427-4015-acba-cbaa503899a1 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.598348 Oct 04 18:00:27.676079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1341/2560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:27 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:27.684898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:27.685513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:27.701454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.702232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.702835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:27.703837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:27.704446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:27.705036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.147407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.165587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.170695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.177040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f25c56df-5972-46bc-83ec-6c68c1377da4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.499424 Oct 04 18:00:28.201864 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1342/2561] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:27 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:28.201864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.201864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.202328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.208799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.209448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.217042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.217782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.218611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.561114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.575117 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ed983fe-4770-445f-8760-dcdae23fbf87 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1466 microversion: 2.1 time: 1.258656 Oct 04 18:00:28.576532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1220/2562] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:27 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1466 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:28.586485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.589438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: be544051-c955-40f7-9add-74881201f342] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.598489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.599228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.599863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.601214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.601965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.602982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.605175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.623673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.624714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance be544051-c955-40f7-9add-74881201f342 could not be found. Oct 04 18:00:28.625487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 HTTP/1.1 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance be544051-c955-40f7-9add-74881201f342 could not be found. Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'be544051-c955-40f7-9add-74881201f342'} Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be544051-c955-40f7-9add-74881201f342 could not be found. Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be544051-c955-40f7-9add-74881201f342 could not be found. Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.627117 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be544051-c955-40f7-9add-74881201f342 could not be found. Oct 04 18:00:28.632950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.635187 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c06fb8d3-f56a-4382-aa58-8712cb28d648 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2701 microversion: 2.32 time: 0.446664 Oct 04 18:00:28.635821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance be544051-c955-40f7-9add-74881201f342 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.637187 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9891d4b-0814-4882-bf54-67923e601a09 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342" status: 404 len: 111 microversion: 2.1 time: 0.059476 Oct 04 18:00:28.638254 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1221/2563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/be544051-c955-40f7-9add-74881201f342 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.651341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67751253-a339-48fc-8899-f376fb454ce4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdbd9a4550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.658316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1343/2564] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2701 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:28.702521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.703746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.717416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-67751253-a339-48fc-8899-f376fb454ce4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Image not found. Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67751253-a339-48fc-8899-f376fb454ce4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095 HTTP/1.1 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'ca0322af-733f-48ae-8254-6403663a8095'} Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image ca0322af-733f-48ae-8254-6403663a8095 to delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ca0322af-733f-48ae-8254-6403663a8095 could not be found. Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.720542 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:28.726123 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.727733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.729175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67751253-a339-48fc-8899-f376fb454ce4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.730230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67751253-a339-48fc-8899-f376fb454ce4 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095" status: 404 len: 62 microversion: 2.1 time: 0.088291 Oct 04 18:00:28.731292 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1222/2565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] DELETE /compute/v2.1/images/ca0322af-733f-48ae-8254-6403663a8095 => generated 62 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:28.744841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.746715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.762300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.769508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.771549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.775543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.776236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.779635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.814323 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c HTTP/1.1 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1952cc2f-479a-4156-b26f-052d4561355c'} Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.821960 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.826291 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.829878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.832198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-698cedec-7cdb-4375-b4a6-997e383969fc tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 404 len: 111 microversion: 2.1 time: 0.095788 Oct 04 18:00:28.835066 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1223/2566] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:28 2022] DELETE /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.849637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.850705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 1952cc2f-479a-4156-b26f-052d4561355c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:28.872720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.874561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.879263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.882720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:28.885329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:28.887045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:28.929958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c HTTP/1.1 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1952cc2f-479a-4156-b26f-052d4561355c'} Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.932233 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. Oct 04 18:00:28.937176 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:28.938545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 1952cc2f-479a-4156-b26f-052d4561355c could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:28.939602 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c761b4f-0a68-4684-a7a7-0486bd650b63 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c" status: 404 len: 111 microversion: 2.1 time: 0.100299 Oct 04 18:00:28.940806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1224/2567] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/1952cc2f-479a-4156-b26f-052d4561355c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:28.949987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-552696b5-1ae2-4162-8144-ddc8f0e08df3 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdc1ebfca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:28.995334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-552696b5-1ae2-4162-8144-ddc8f0e08df3 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24428751" status: 202 len: 0 microversion: 2.1 time: 0.049141 Oct 04 18:00:28.998478 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1225/2568] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 18:00:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24428751 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:00:29.182751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.197144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4eda65a1-66bb-474d-9df0-b4694def5125 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.499845 Oct 04 18:00:29.200866 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1344/2569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:28 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:29.215399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:29.215961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:29.231052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.234430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.235087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.238452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.239160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.239796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.249689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:29.277102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-deleted", "tag": "5c7a6da1-ba4c-454e-8f5c-970dfade82c8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:29.296366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.297028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.297602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.331664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] Creating event network-vif-deleted:5c7a6da1-ba4c-454e-8f5c-970dfade82c8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:29.346342 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-bf93696b-525a-4e5f-897c-379b96fdd1d5 req-e84176dd-da96-42ae-99e7-b6940c6a0c16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072951 Oct 04 18:00:29.348659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1345/2570] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:00:29.618242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:29.621028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:29.644771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.647664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.651417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.654811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:29.658607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:29.664534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:29.943266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.959140 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21601adb-51f0-48d4-98e7-5bf23e48a4fd tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 200 len: 1424 microversion: 2.1 time: 0.359085 Oct 04 18:00:29.968313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.979836 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1346/2571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:29 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 1424 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:29.984416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.989547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:29.991190 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c24d80a-7b6c-4938-a967-58e56431c76a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.780993 Oct 04 18:00:29.995318 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1226/2572] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:29 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:29.999948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:30.005320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:30.041704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.044147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.044666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.045400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.046770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.049027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.228100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:30.229430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:30.239742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.243602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.244266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.245174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:30.246913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:30.255555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:30.891105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:30.916818 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53af2e17-e914-4505-98bb-dc7c05ce8c5f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.693165 Oct 04 18:00:30.920775 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1227/2573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:30 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:31.259585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:31.284225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77cc403d-9a6c-434d-b7f6-347021186413 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1e931f0>, body: {"keypair": {"name": "tempest-keypair-1506495854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPD9oBUgxLWmLZ8ineXwOAzFX8z+liT0CQ18Or2hVdjVTVy2dYzeggkbAzYbXel2W8NLIhQj22LR6gPAs4jQktMh6ZgECiH5bfKjGaFdtRwvniHcySzaS6aNQgcPtIa6Q=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:31.330621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:31.372965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-77cc403d-9a6c-434d-b7f6-347021186413 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:31.391738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:31.398663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:31.401323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ad7d959-06e4-4120-93d2-e4ff65149ee7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2542 microversion: 2.32 time: 1.417525 Oct 04 18:00:31.418626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-77cc403d-9a6c-434d-b7f6-347021186413 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:31.421764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1347/2574] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:29 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2542 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:31.433642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.434339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 3996315c-68bb-4733-8862-1cb35afe086a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:31.452068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.452559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.457359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.459215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.460868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.461875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.482776 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77cc403d-9a6c-434d-b7f6-347021186413 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.562314 Oct 04 18:00:31.486431 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1228/2575] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 568 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:31.511612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.512723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:31.521610 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] HTTP exception thrown: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. Oct 04 18:00:31.530830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.531333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.531775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.532513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.532976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.533407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Request method failure captured: Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a HTTP/1.1 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHR-s6ZQI8rDa6s8fVuHEWifW95Hz7qNUvMQL1pKeRj92Y65ofdxBU1r7gOpk1Km8a5REhvBYEbGaXXSoceNPItdHI3XPGcy-QrEZXM_2AI-KmjWK9fbsXZ8JIxhOARldd2w1kXS7yX-SRuHb6_g1oo0cAtA1Q7Vpnbh1gRtiVDmPfU Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 3b49a1b90e7b4efbbcfa61ecd450d4ff Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 3b49a1b90e7b4efbbcfa61ecd450d4ff Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-LiveMigrationNegativeTest-229237124-project Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 4e5a98dffe494800adbd9c540c33588b Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-LiveMigrationNegativeTest-229237124-project Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3996315c-68bb-4733-8862-1cb35afe086a'} Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:31.538576 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Returning 404 to user: Instance 3996315c-68bb-4733-8862-1cb35afe086a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-808a2160-d80f-47ec-b8b3-6d982e65b58f tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a" status: 404 len: 111 microversion: 2.1 time: 0.117369 Oct 04 18:00:31.544789 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1348/2576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:31 2022] GET /compute/v2.1/servers/3996315c-68bb-4733-8862-1cb35afe086a => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:31.571432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb690201-1c8d-482b-97c4-7cb4d55ce575", "name": "network-vif-plugged", "status": "completed", "tag": "d3772592-0a4c-44be-9433-4dec3335ee85"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:31.597613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.598139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.598609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.652644 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] Creating event network-vif-plugged:d3772592-0a4c-44be-9433-4dec3335ee85 for instance fb690201-1c8d-482b-97c4-7cb4d55ce575 on n-h2-831194-21 Oct 04 18:00:31.674725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-29ab39a0-b346-4325-9e11-beb2bd716da0 req-2a57a1c6-72ac-4fb9-9fbb-0224659a1e43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131936 Oct 04 18:00:31.676297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1349/2577] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:31.684299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3996315c-68bb-4733-8862-1cb35afe086a", "name": "network-vif-deleted", "tag": "c7571545-55e8-4c0b-9677-2122c2abeff9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:31.715452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.716539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.717254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.732840 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] Creating event network-vif-deleted:c7571545-55e8-4c0b-9677-2122c2abeff9 for instance 3996315c-68bb-4733-8862-1cb35afe086a on n-h1-831194-21 Oct 04 18:00:31.741420 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6302030f-2c2e-40d2-bf32-ef3f1cb5ae93 req-84a25206-33e3-4cc7-8f9f-28e4d072b10a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063129 Oct 04 18:00:31.742771 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1350/2578] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:31.749762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9d670da-b3a0-4625-bde9-4c1efd191153 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d92040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.766507 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9d670da-b3a0-4625-bde9-4c1efd191153 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1506495854" status: 200 len: 513 microversion: 2.2 time: 0.022058 Oct 04 18:00:31.768181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1351/2579] 10.222.0.42 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1506495854 => generated 513 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:31.780656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:31.781634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:31.792488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.793326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.794235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.795193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:31.796097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:31.797181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:31.839791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:31.990417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:32.003557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-072114cd-9649-41a1-ae64-870d37a53c4b tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 204 len: 0 microversion: 2.1 time: 0.229059 Oct 04 18:00:32.006959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1352/2580] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:31 2022] DELETE /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:32.016441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81eae8fc-5a95-44ff-884b-e3f66933d75c tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d928b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.051895 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81eae8fc-5a95-44ff-884b-e3f66933d75c tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506495854" status: 204 len: 0 microversion: 2.2 time: 0.040907 Oct 04 18:00:32.058319 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1353/2581] 10.222.0.42 () {60 vars in 1261 bytes} [Tue Oct 4 18:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1506495854 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:32.073778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9a56adb-da8e-4a55-b098-7f62826c0172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '.version_select at 0x7fbdc1d29dc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.078559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.088612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.100474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.110183 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-468e30a1-0dd3-4785-a5dd-0f5b3a7bb49c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.621537 Oct 04 18:00:32.111819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1229/2582] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:31 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:32.117412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d9a56adb-da8e-4a55-b098-7f62826c0172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Image not found. Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9a56adb-da8e-4a55-b098-7f62826c0172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/images/c864b063-b05a-4f61-bc81-fc2c414597bf HTTP/1.1 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: exception: Image not found. Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c864b063-b05a-4f61-bc81-fc2c414597bf'} Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c864b063-b05a-4f61-bc81-fc2c414597bf to delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c864b063-b05a-4f61-bc81-fc2c414597bf could not be found. Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.119562 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.124359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9a56adb-da8e-4a55-b098-7f62826c0172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Image not found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:32.127751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d9a56adb-da8e-4a55-b098-7f62826c0172 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/images/c864b063-b05a-4f61-bc81-fc2c414597bf" status: 404 len: 62 microversion: 2.1 time: 0.061392 Oct 04 18:00:32.132623 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1354/2583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] DELETE /compute/v2.1/images/c864b063-b05a-4f61-bc81-fc2c414597bf => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:00:32.135789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.138123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.156515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.157340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.159641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.165630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.167589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.173470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.173997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.174439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.185276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.187507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.188029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.188813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.196721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.197419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.507541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.515306 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0378880-0d75-4273-94fd-dddeecdb90fa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.402522 Oct 04 18:00:32.515897 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1230/2584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:32.532478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4883b33-86a7-4a91-a4e4-f92fa8fbe8e1 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1e5f790>, body: {"keypair": {"name": "tempest-keypair-857327059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaSJvajgsYgB2/gHVmslP7NfGnYOZio476dVnWGuPT413CoQ3gVFgAICNunR2d69mO5De4fWqOSIjDwehxsy4xOHj8TNYR4CaTA1myeoZth4bqNDEyxoSWvQG6jiwOUsQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:32.550119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:32.553595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4883b33-86a7-4a91-a4e4-f92fa8fbe8e1 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:32.558875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:32.560128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4883b33-86a7-4a91-a4e4-f92fa8fbe8e1 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:32.568644 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cb4d42b-2619-43ab-93bc-cb850242164d tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1475 microversion: 2.1 time: 0.438128 Oct 04 18:00:32.574619 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1355/2585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1475 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:32.590520 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4883b33-86a7-4a91-a4e4-f92fa8fbe8e1 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.071659 Oct 04 18:00:32.591779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1231/2586] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 73 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:32.599517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.600505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.601466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.601614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.609102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.610202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.610935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.614613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.615422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.616108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.625132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.625633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.626104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.626822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.627284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.627707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.668749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d HTTP/1.1 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d'} Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:32.671344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01b51889-50b8-45ee-96df-001ef435f054 tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 404 len: 111 microversion: 2.1 time: 0.095341 Oct 04 18:00:32.674959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1356/2587] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:32 2022] DELETE /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:32.686174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5d54975-e908-4c2d-9210-a706ebddeee3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d33a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.720002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5d54975-e908-4c2d-9210-a706ebddeee3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-857327059" status: 204 len: 0 microversion: 2.2 time: 0.041349 Oct 04 18:00:32.720733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1357/2588] 10.222.0.42 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-857327059 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:32.736993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:32.738854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] [instance: 40fdcf34-7fa5-4972-b730-26aa3634cd8d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:32.751516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.755099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.757486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.758500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:32.762369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:32.763765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:32.806407 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] HTTP exception thrown: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Request method failure captured: Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d HTTP/1.1 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRWozW8qY2ylSvbdRb9I4edjyok4IFUgbcf_OsKwc-ZVsEXkm_LkExxyu8Qt_loGnquPQvDdrEEV-WSzuc_wq7m4P1ZR3aO-_8iFojNc_g5WXWmcnw8xFaYf7U_B3y_ezFQW9sWVrTj-Q48Y8E-wUulDXDh-ReQFTXmBy9mqdwr-AQ Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c881903a7ca74d89bfe90b5aa5a535da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c881903a7ca74d89bfe90b5aa5a535da Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-573992897 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9c110945b1ec49fb91c8d3e67a6c2178 Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-573992897-project Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '40fdcf34-7fa5-4972-b730-26aa3634cd8d'} Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.812744 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] Returning 404 to user: Instance 40fdcf34-7fa5-4972-b730-26aa3634cd8d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c36b969d-2357-4ff2-a99b-ca76b99b88df tempest-ImagesOneServerNegativeTestJSON-573992897 tempest-ImagesOneServerNegativeTestJSON-573992897-project] 10.222.0.42 "GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d" status: 404 len: 111 microversion: 2.1 time: 0.088319 Oct 04 18:00:32.818296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1358/2589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/40fdcf34-7fa5-4972-b730-26aa3634cd8d => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:32.827088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9d8326d-b2fa-419f-9dcb-973338673489 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1d9b5e0>, body: {"keypair": {"name": "tempest-keypair-265425253", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:32.873235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c9d8326d-b2fa-419f-9dcb-973338673489 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:32.898086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c9d8326d-b2fa-419f-9dcb-973338673489 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:32.933106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9d8326d-b2fa-419f-9dcb-973338673489 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.113487 Oct 04 18:00:32.934867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1359/2590] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:32 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:32.963073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83fd9c75-e4ec-4e72-9d3b-140fe66d13c7 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d92280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.026631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83fd9c75-e4ec-4e72-9d3b-140fe66d13c7 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-265425253" status: 204 len: 0 microversion: 2.2 time: 0.076140 Oct 04 18:00:33.027588 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1360/2591] 10.222.0.42 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-265425253 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:00:33.028699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.041256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d7d7f3a-0b76-4661-aac4-f268f603ff13 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1db88b0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1097703075", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFYXyWPBE/BUgksHYimUylzk577YBPdVyPr5QBhKSPDOQFwX8e56G/4M54FwJ6Wb9ZWtuXw6kPuZsXWkrZ3vyOWxbxZZQ/YZXwsMpARtmhFdUVsA0eq7D9p36yTcBzDWag=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:33.048377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.056829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.060714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-543a1b55-5207-4bbd-852f-059469fac7ed tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2542 microversion: 2.32 time: 0.467016 Oct 04 18:00:33.061531 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1232/2592] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:32 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2542 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:33.094571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0d7d7f3a-0b76-4661-aac4-f268f603ff13 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:33.102447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0d7d7f3a-0b76-4661-aac4-f268f603ff13 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:33.140590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.141560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:33.146593 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d7d7f3a-0b76-4661-aac4-f268f603ff13 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.111318 Oct 04 18:00:33.149210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.149988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.150370 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1361/2593] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:00:33.150831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.151770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.152418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.153169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.166621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49d7187e-2da3-41ea-8c4a-d4aabb589e20 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1df7a60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1281718764", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9L7oacCKH2zTjl1iCVJLdFkuFvcxGD5jntZM/fwkNW7F7FvXdxlpkOUuwu/TGzx1X7FlTGCe+S1qeY82ANqHdlcI0MeE9QyJ24BXlakwaysbFZdL/7YGzrUbr9Wee/Jw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:33.209497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-49d7187e-2da3-41ea-8c4a-d4aabb589e20 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:33.220705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-49d7187e-2da3-41ea-8c4a-d4aabb589e20 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:33.261638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:33.268727 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49d7187e-2da3-41ea-8c4a-d4aabb589e20 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.107780 Oct 04 18:00:33.270673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1362/2594] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:33 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:33.288241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee2980b6-76b0-49f1-999c-38044410f7e3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdbdb43b80>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-291890091", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2SPw5Yh+4Es3pI5TphRBO+ffZ/ikAbvYX5QxdaQ8ubkOBCP4gT0EhrksmhC8Z+3QR8d2cgjKNENkjDz8Z3knvXcAT3ThxbYjuIbbQeoS2FK9/TcWpCL/XSsU4RaktQTw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:33.312872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ee2980b6-76b0-49f1-999c-38044410f7e3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:33.319935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ee2980b6-76b0-49f1-999c-38044410f7e3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:33.362724 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee2980b6-76b0-49f1-999c-38044410f7e3 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.082191 Oct 04 18:00:33.363475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1363/2595] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:33 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 84 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 04 18:00:33.377980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-534d625e-6102-48d3-9c3e-c27392301226 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d29f70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.391957 n-d-831194-21 devstack@n-api.service[128849]: WARNING oslo_db.sqlalchemy.utils [None req-534d625e-6102-48d3-9c3e-c27392301226 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:33.406887 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-534d625e-6102-48d3-9c3e-c27392301226 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.032625 Oct 04 18:00:33.409886 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1364/2596] 10.222.0.42 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:33.433521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5a24be9-c77b-4c87-8619-9700f435443e tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d2b8b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.477129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5a24be9-c77b-4c87-8619-9700f435443e tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-291890091" status: 204 len: 0 microversion: 2.2 time: 0.058923 Oct 04 18:00:33.480169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1365/2597] 10.222.0.42 () {60 vars in 1318 bytes} [Tue Oct 4 18:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-291890091 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:33.491694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e0e942e-e328-442d-bce7-70276805c635 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d33940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.538413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e0e942e-e328-442d-bce7-70276805c635 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1281718764" status: 204 len: 0 microversion: 2.2 time: 0.050857 Oct 04 18:00:33.540844 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1366/2598] 10.222.0.42 () {60 vars in 1321 bytes} [Tue Oct 4 18:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1281718764 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:33.548137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.548722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:33.572587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.573270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.573514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.574734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.575207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.575644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.750099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.765130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.774244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.775530 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfaeb9fd-d00a-47cf-90bf-35aed44fceff tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1280 microversion: 2.25 time: 0.638936 Oct 04 18:00:33.777803 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1233/2599] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1280 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:33.786890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12478f31-cdfe-4406-af86-53d1468fe7a0 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1ebf1f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.828630 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12478f31-cdfe-4406-af86-53d1468fe7a0 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1097703075" status: 204 len: 0 microversion: 2.2 time: 0.048770 Oct 04 18:00:33.829279 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1234/2600] 10.222.0.42 () {60 vars in 1321 bytes} [Tue Oct 4 18:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1097703075 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:33.834319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:33.835261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:33.843927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.844863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.845919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.847780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.848873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.849817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:33.959226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:33.968910 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25707b71-b6e9-476f-8e41-f2f955b61226 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.426938 Oct 04 18:00:33.969686 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1367/2601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:33.980891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e59deb70-60c6-409f-bce4-203c5e7fc499", "tag": "b30115c7-8092-4b46-a01c-8fd9eddd08d6"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-deleted", "tag": "c0e2a82b-d291-45a2-a17a-2b9ae86d6207"}, {"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-deleted", "tag": "9ee68e4b-b282-44d0-9a38-8266e4d20a88"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:33.993671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:33.994166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:33.994598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.015846 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Creating event network-changed:b30115c7-8092-4b46-a01c-8fd9eddd08d6 for instance e59deb70-60c6-409f-bce4-203c5e7fc499 on n-h2-831194-21 Oct 04 18:00:34.016361 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Creating event network-vif-deleted:c0e2a82b-d291-45a2-a17a-2b9ae86d6207 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:34.016862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] Creating event network-vif-deleted:9ee68e4b-b282-44d0-9a38-8266e4d20a88 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:34.050889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b7a0f0bf-582a-433a-b5dd-3f16d276d2a7 req-3817151b-97a5-4de8-af30-5dbdfab8aa5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.077442 Oct 04 18:00:34.053858 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1368/2602] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:34.074326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.075613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.093511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.094635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.097072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.098276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.099286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.099931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.131095 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d HTTP/1.1 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '7451688f-258e-4401-9fd8-3e41c26f321d'} Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:34.133522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.137369 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.140398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:34.141561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a616b9df-9fb4-4bbb-ba4b-05d229f98a8f tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 404 len: 111 microversion: 2.1 time: 0.081601 Oct 04 18:00:34.142814 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1369/2603] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:34 2022] DELETE /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:34.151547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91d5ecf5-fb65-47c0-a1ab-24f010d23669 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdc1df7a60>, body: {"keypair": {"name": "tempest-keypair-1907836051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPRMHMZQKi/Yka5X1SXTNcicYuEDA4Km6fyHu3VEj8MIvO0xByyRSMjVkKsVltWpH1Ms/lc4bvms4PVWLXE5OayW9jwOBQnjktmSTf+QqCjEYhlbR8Wk33nIifqgmaikQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:34.170988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-91d5ecf5-fb65-47c0-a1ab-24f010d23669 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:34.181149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-91d5ecf5-fb65-47c0-a1ab-24f010d23669 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:34.228871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91d5ecf5-fb65-47c0-a1ab-24f010d23669 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.082849 Oct 04 18:00:34.230050 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1370/2604] 10.222.0.42 () {62 vars in 1199 bytes} [Tue Oct 4 18:00:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:00:34.245730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.247601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.256164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.256770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.257541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.258424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.258887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.259535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.293728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:34.393116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:34.401301 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7970f01d-a95b-4344-b11a-e8f2339dd959 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1475 microversion: 2.1 time: 0.570881 Oct 04 18:00:34.402604 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1235/2605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:33 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1475 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:34.407924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.408794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 7451688f-258e-4401-9fd8-3e41c26f321d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.415390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.415970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.416491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.417261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.417815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.418336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.434445 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d HTTP/1.1 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7451688f-258e-4401-9fd8-3e41c26f321d'} Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.436992 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. Oct 04 18:00:34.440778 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.443279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 7451688f-258e-4401-9fd8-3e41c26f321d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:34.444677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-045a0678-7487-438c-afbc-22571aa2f0bd tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d" status: 404 len: 111 microversion: 2.1 time: 0.040930 Oct 04 18:00:34.445853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1236/2606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/servers/7451688f-258e-4401-9fd8-3e41c26f321d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:34.451222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44a45203-56fc-4fcd-8fa2-d69a6db4f4c4 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdbcfe59d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.460041 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44a45203-56fc-4fcd-8fa2-d69a6db4f4c4 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-1907836051" status: 200 len: 513 microversion: 2.2 time: 0.012917 Oct 04 18:00:34.460607 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1237/2607] 10.222.0.42 () {60 vars in 1258 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1907836051 => generated 513 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:34.472766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.473462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.482687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.483180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.483616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.484472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.484965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.485931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.511155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f HTTP/1.1 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '96448918-0969-4f81-ad23-ef464512ed7f'} Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:34.514001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ffde84fd-5fcf-4a5b-8738-8266e716244d tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "DELETE /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 404 len: 111 microversion: 2.1 time: 0.053202 Oct 04 18:00:34.518191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1238/2608] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:34 2022] DELETE /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:34.521932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c35dc6a-dfe8-4805-a277-888d26bf5034 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdbd16bd30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.526072 n-d-831194-21 devstack@n-api.service[128850]: WARNING oslo_db.sqlalchemy.utils [None req-6c35dc6a-dfe8-4805-a277-888d26bf5034 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:34.533717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c35dc6a-dfe8-4805-a277-888d26bf5034 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.016678 Oct 04 18:00:34.537982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1239/2609] 10.222.0.42 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:34.546026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.546666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] [instance: 96448918-0969-4f81-ad23-ef464512ed7f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.560271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.560777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.561218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.561958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.563295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.563730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.590439 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] HTTP exception thrown: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Request method failure captured: Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f HTTP/1.1 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHRZm_6uCZ8gc21MMgm85VtDa8VFFv2ATZu9LGr7jxO9Z-tY9seWQoU4uVo8rhSZMCKVzKOZINUC6ttGIEGGp-uNhIZOCsV3ZLozEUd2yIcOjnPMjQ8XpxUGknAXQKUupdKC7LHgmHDNFMJC1ybefdBe3iUg0Vvh22zwMGK6R4TxIEg Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_42151954583a4ff68618a0a783fdc7d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 42151954583a4ff68618a0a783fdc7d7 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestMultiNic-1043432806 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61d553fff0e64a2ca5970bf9897eaff1 Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestMultiNic-1043432806-project Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '96448918-0969-4f81-ad23-ef464512ed7f'} Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:34.592041 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] Returning 404 to user: Instance 96448918-0969-4f81-ad23-ef464512ed7f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:34.595835 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-866a0ef1-7b69-48d6-bb87-ca628f04e3bb tempest-ServersTestMultiNic-1043432806 tempest-ServersTestMultiNic-1043432806-project] 10.222.0.42 "GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f" status: 404 len: 111 microversion: 2.1 time: 0.054542 Oct 04 18:00:34.596372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1240/2610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/servers/96448918-0969-4f81-ad23-ef464512ed7f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:34.606883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd8dd571-504b-4ac6-a9b6-dc4aabc2c89d tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1e59b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.643229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd8dd571-504b-4ac6-a9b6-dc4aabc2c89d tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907836051" status: 204 len: 0 microversion: 2.2 time: 0.044245 Oct 04 18:00:34.645853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1241/2611] 10.222.0.42 () {60 vars in 1261 bytes} [Tue Oct 4 18:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1907836051 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:34.659326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Action: 'create', calling method: .version_select at 0x7fbdbd9a4940>, body: {"keypair": {"name": "tempest-keypair-90179262", "type": "x509"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:34.683004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:34.698748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:34.704663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:34.706629 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2145f3ed-6c15-48a7-9776-189d1481e33c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 2052 microversion: 2.32 time: 0.475473 Oct 04 18:00:34.718700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:34.731070 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1371/2612] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 2052 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:34.731273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:34.772629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.processutils [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpf9b36vzu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpf9b36vzu/temp.key -subj /CN=81eefa298d6246dbb00dc7f57e2d81d5 -extensions v3_req_client {{(pid=128850) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:00:34.805744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:34.806462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:34.815375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=5,nova_api:INSERT=5 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:34.820440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.822800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.824768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:34.825642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:34.826036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:34.826478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:35.111617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.processutils [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpf9b36vzu/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpf9b36vzu/temp.key -subj /CN=81eefa298d6246dbb00dc7f57e2d81d5 -extensions v3_req_client" returned: 0 in 0.338s {{(pid=128850) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:00:35.115965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.processutils [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpf9b36vzu/temp.key -password pass: {{(pid=128850) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 04 18:00:35.229044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.processutils [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpf9b36vzu/temp.key -password pass:" returned: 0 in 0.114s {{(pid=128850) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 04 18:00:35.370941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:00:35.385374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:35.428594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Getting quotas for user 81eefa298d6246dbb00dc7f57e2d81d5 and project 85846b2d5f3147a2a1fdb1d119757ee3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:00:35.432567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:35.458059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:35.476264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26295733-1300-465e-8b4f-17d3f582dbdf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1477 microversion: 2.25 time: 0.675438 Oct 04 18:00:35.480011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1372/2613] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:34 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1477 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:35.493509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:35.501083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:35.506192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54d1c164-8fef-4dde-bbd0-a151dd974960 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 4691 microversion: 2.2 time: 0.853585 Oct 04 18:00:35.515021 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1242/2614] 10.222.0.42 () {62 vars in 1198 bytes} [Tue Oct 4 18:00:34 2022] POST /compute/v2.1/os-keypairs => generated 4691 bytes in 864 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:35.523383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:35.524489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:35.526933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:35.527601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:35.528251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:35.528365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:35.534216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:35.536489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:35.560711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:35.561257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:35.561952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:35.573130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:35.573641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:35.574129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:35.948286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e5a98dffe494800adbd9c540c33588b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b49a1b90e7b4efbbcfa61ecd450d4ff', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:35.965816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a30d9585-e0e4-4a4c-a31e-17a5ac59d460 tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 200 len: 1433 microversion: 2.1 time: 0.448810 Oct 04 18:00:35.969466 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1243/2615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:35 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 1433 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.200089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:36.208772 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ff64658-cb52-4390-a400-a6dfc8e18b2a tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.723486 Oct 04 18:00:36.216063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1373/2616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:35 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.218961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-659bc384-09b6-4573-a85e-a0cb5cde6df9 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1d90790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.242859 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-659bc384-09b6-4573-a85e-a0cb5cde6df9 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs/tempest-keypair-90179262" status: 200 len: 1532 microversion: 2.2 time: 0.027472 Oct 04 18:00:36.243528 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1374/2617] 10.222.0.42 () {60 vars in 1252 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-90179262 => generated 1532 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.255648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.256272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:36.271212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.271710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.272152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.272861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.273319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.273743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.461856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.462562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:36.475061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.477909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.478382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.479135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.479604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.482268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.754494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid fb690201-1c8d-482b-97c4-7cb4d55ce575 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:36.802012 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c898f41-7ebc-469b-bdd4-d1192ddde0fb tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1971 microversion: 2.25 time: 0.830211 Oct 04 18:00:36.805680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1244/2618] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:35 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1971 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:36.816976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd3d6f88-468d-46ea-8b26-270380a4ec38 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdbdb8c310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.837971 n-d-831194-21 devstack@n-api.service[128850]: WARNING oslo_db.sqlalchemy.utils [None req-fd3d6f88-468d-46ea-8b26-270380a4ec38 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:00:36.849323 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd3d6f88-468d-46ea-8b26-270380a4ec38 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 1389 microversion: 2.2 time: 0.041870 Oct 04 18:00:36.851087 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1245/2619] 10.222.0.42 () {60 vars in 1177 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/os-keypairs => generated 1389 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:36.864680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc830e2d-e54c-4fcb-928c-ff3b730598df", "name": "network-vif-deleted", "tag": "e910d5c6-456a-4049-803a-bd29699c9db8"}, {"server_uuid": "0ded9c24-1981-40bb-af64-362fdcd00bb7", "name": "network-vif-deleted", "tag": "405db06d-ced9-402e-a6ee-735dfb7e07eb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:36.904240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.906105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.906726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.924777 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Creating event network-vif-deleted:e910d5c6-456a-4049-803a-bd29699c9db8 for instance bc830e2d-e54c-4fcb-928c-ff3b730598df on n-h1-831194-21 Oct 04 18:00:36.925545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] Creating event network-vif-deleted:405db06d-ced9-402e-a6ee-735dfb7e07eb for instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 on n-h1-831194-21 Oct 04 18:00:36.934301 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-df42a315-a770-4db6-b150-e244905b4118 req-d4614da7-5d80-4ee5-a7f1-c74f1acbe716 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081124 Oct 04 18:00:36.936102 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1246/2620] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:36.949395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:36.952322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:36.963886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.964807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.965797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.966828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:36.967303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:36.967742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:36.996075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.016919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.021551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.026431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e82d95c-f0dd-48e5-a407-f32c43270409 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.773273 Oct 04 18:00:37.033083 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1375/2621] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:37.050286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c04a75a1-6b2f-48ae-b574-bd268d7e7f78 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] Calling method '.version_select at 0x7fbdc1da5430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.091380 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c04a75a1-6b2f-48ae-b574-bd268d7e7f78 tempest-KeyPairsV22TestJSON-1368886025 tempest-KeyPairsV22TestJSON-1368886025-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90179262" status: 204 len: 0 microversion: 2.2 time: 0.057140 Oct 04 18:00:37.093011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1376/2622] 10.222.0.42 () {60 vars in 1255 bytes} [Tue Oct 4 18:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90179262 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:37.133395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.137319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] [instance: 0ded9c24-1981-40bb-af64-362fdcd00bb7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:37.178908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.179527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.182124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.187022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.189543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.189893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.254899 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] HTTP exception thrown: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Request method failure captured: Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 HTTP/1.1 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHR-s6ZQI8rDa6s8fVuHEWifW95Hz7qNUvMQL1pKeRj92Y65ofdxBU1r7gOpk1Km8a5REhvBYEbGaXXSoceNPItdHI3XPGcy-QrEZXM_2AI-KmjWK9fbsXZ8JIxhOARldd2w1kXS7yX-SRuHb6_g1oo0cAtA1Q7Vpnbh1gRtiVDmPfU Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 3b49a1b90e7b4efbbcfa61ecd450d4ff Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3b49a1b90e7b4efbbcfa61ecd450d4ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 3b49a1b90e7b4efbbcfa61ecd450d4ff Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-229237124 Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-LiveMigrationNegativeTest-229237124-project Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 4e5a98dffe494800adbd9c540c33588b Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-LiveMigrationNegativeTest-229237124-project Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0ded9c24-1981-40bb-af64-362fdcd00bb7'} Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:37.264271 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. Oct 04 18:00:37.269550 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:37.271899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid fb690201-1c8d-482b-97c4-7cb4d55ce575 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:37.275367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] Returning 404 to user: Instance 0ded9c24-1981-40bb-af64-362fdcd00bb7 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:37.277960 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea42476c-91dc-440f-aade-7b276584fc6c tempest-LiveMigrationNegativeTest-229237124 tempest-LiveMigrationNegativeTest-229237124-project] 10.222.0.42 "GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7" status: 404 len: 111 microversion: 2.1 time: 0.183545 Oct 04 18:00:37.283784 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1377/2623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:37 2022] GET /compute/v2.1/servers/0ded9c24-1981-40bb-af64-362fdcd00bb7 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:37.292483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59deb70-60c6-409f-bce4-203c5e7fc499", "name": "network-vif-plugged", "status": "completed", "tag": "b30115c7-8092-4b46-a01c-8fd9eddd08d6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:37.297581 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d1adce2-d38f-4e59-948e-b9f38d71b3ac tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1971 microversion: 2.25 time: 0.357214 Oct 04 18:00:37.298212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1247/2624] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:36 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1971 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:37.306021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.306805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.307507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.322170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] Creating event network-vif-plugged:b30115c7-8092-4b46-a01c-8fd9eddd08d6 for instance e59deb70-60c6-409f-bce4-203c5e7fc499 on n-h2-831194-21 Oct 04 18:00:37.326795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.327442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:37.329288 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f100ed07-9239-4e1a-95da-39ab0b59baac req-e4bdcef4-49f2-49b6-8356-50fce9f8c346 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041315 Oct 04 18:00:37.330643 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1378/2625] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:37.337924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:37.342278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.343713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.344283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.344414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.344889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.345610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.345907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.346107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.346495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.347685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.348498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.349220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.413561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-165f4402-9c4a-424b-b587-75cc5bffc791 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.081339 Oct 04 18:00:37.415333 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1379/2626] 10.222.0.42 () {60 vars in 1217 bytes} [Tue Oct 4 18:00:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:00:37.437289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-831194-21", "block_migration": "auto"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:37.442735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:37.452620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.453706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.454455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.456423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:37.457435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:37.458485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:37.495073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'flavor' on Instance uuid fb690201-1c8d-482b-97c4-7cb4d55ce575 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:37.525653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Going to try to live migrate instance to n-h1-831194-21 {{(pid=128849) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:00:37.807257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:37.826897 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24a5c5c7-60f8-4237-a235-5b09f0961250 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.503812 Oct 04 18:00:37.829041 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1248/2627] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:37 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:38.064401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:38.065144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:38.078910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.079427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.079863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.080584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.081043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.081466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.243242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:38.265493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:38.272486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:38.275304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48c2df51-858d-451c-97f8-4c6b0b9553c2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.214926 Oct 04 18:00:38.276277 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1249/2628] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:38 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:38.855679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:38.856662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:38.868902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.869410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.871234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:38.874708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:38.875373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:38.875964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:39.266967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:39.279541 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4034a5f-99fb-4c70-b4d4-456cff139787 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1318 microversion: 2.1 time: 0.427830 Oct 04 18:00:39.285619 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1250/2629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:38 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:39.324538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:39.325158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:39.339238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:39.339740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:39.340194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:39.340908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:39.341369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:39.341803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:39.548391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:39.564671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:39.569587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:39.571140 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02f66200-2935-45cc-b702-caa834e83984 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.251374 Oct 04 18:00:39.575843 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1251/2630] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:39 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:40.311483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:40.312154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:40.332017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.332642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.333074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.333790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.334275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.334713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.576382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06941b4b-d4ed-41be-a2a5-01618dce3efc tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575/action" status: 202 len: 0 microversion: 2.25 time: 3.146962 Oct 04 18:00:40.577114 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1380/2631] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:00:37 2022] POST /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575/action => generated 0 bytes in 3151 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:40.588941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:40.592641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:40.636045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.640594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.643055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.651859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.652078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.654324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.654897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.664351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:40.701176 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad6931ae-c311-493b-a585-b1bd1927375d tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1509 microversion: 2.1 time: 0.394219 Oct 04 18:00:40.707802 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1252/2632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:40 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1509 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:40.726238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:40.737959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:40.758419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.761882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.762502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.763679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:40.764648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:40.778242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:40.968487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.981009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.994758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:40.996211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9eecd6da-a6c5-4831-8cbe-db5de5cb8645 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.287002 Oct 04 18:00:41.000483 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1253/2633] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:40 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:41.011041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:41.012717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:41.025051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.028225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.030557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.031870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.033241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.037341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.393923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:41.404249 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22b2fc3a-def5-4bb9-a0c6-d6cf622c1478 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1509 microversion: 2.1 time: 0.402378 Oct 04 18:00:41.407298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1254/2634] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:41 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:41.434340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:41.437603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:41.445499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.446103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.460609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.462813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.463893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.468233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.668594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe49ad69-b096-4c3f-ab1f-20e44fae9bba tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "PUT /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1081 microversion: 2.1 time: 0.238887 Oct 04 18:00:41.670368 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1255/2635] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:00:41 2022] PUT /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1081 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:41.688712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:41.689391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:41.698605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.701960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.703635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.706360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:41.710489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:41.711212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:41.907467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:41.929525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:41.931144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:41.932352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7e6f331-4810-4736-a57f-01c028bcfbee tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.351021 Oct 04 18:00:41.933258 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1381/2636] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:40 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:42.026891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:42.027526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:42.036013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.036499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.036938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.042838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.043331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.045760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.287164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:42.297507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:42.312437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:42.314051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:42.319100 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a4480a8-9d6e-4261-8d04-cc7fcee95c60 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1507 microversion: 2.1 time: 0.634595 Oct 04 18:00:42.320373 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1256/2637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:41 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:42.324484 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87618edb-daff-491e-9007-b5f524b37e47 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.301360 Oct 04 18:00:42.342212 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1382/2638] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:42 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:42.362390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:42.366054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:42.383954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.388959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.389632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.390557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.391168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.393309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.788302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:42.797201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d360b20b-b1d3-4903-8df6-11408b490a95 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1507 microversion: 2.1 time: 0.455720 Oct 04 18:00:42.799073 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1257/2639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:42 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:42.823812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:42.826843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:42.835743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.836553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.837241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.838144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.838800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.839381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.962952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:42.963625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:42.978954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.979545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.982283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:42.986592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:42.989548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:42.993936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.052342 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8dd34e74-578e-4adc-8512-891c995e5faf tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "PUT /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1083 microversion: 2.1 time: 0.231318 Oct 04 18:00:43.055940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1383/2640] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:00:42 2022] PUT /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1083 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:43.073067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:43.074024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:43.112339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.112969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.113686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.114801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.115299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.127113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.434327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.443997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.445395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.453489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e87787f-5a4d-4192-accc-a0970281ff32 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.494769 Oct 04 18:00:43.454369 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1258/2641] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:42 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:43.464953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:43.465581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:43.484091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.484614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.485075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.485791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.486291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.486728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.618596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.645818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.648600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.650479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48b57417-14d8-433a-94c3-3b7e7bb5011f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.195054 Oct 04 18:00:43.672639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1259/2642] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:43 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:43.713543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:43.736655 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a907938-0d25-4c7e-82e0-f4c5bf4234a2 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1509 microversion: 2.1 time: 0.664773 Oct 04 18:00:43.737754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1384/2643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:43 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1509 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:00:43.759657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:43.760280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:43.767684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.768213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.768673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:43.769580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:43.770213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:43.770686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:44.482537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:44.484146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:44.491924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=32 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:44.512040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:44.512644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:44.513094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:44.516102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:44.516770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:44.517303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:44.906419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:44.916200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:44.917718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:44.918966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0f588aa3-d313-48a0-9686-5e15f831cd50 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.441909 Oct 04 18:00:44.919555 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1385/2644] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:44 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:45.178761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:45.198135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0efb5f5-bf97-426b-a655-e5550bc00863 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1509 microversion: 2.1 time: 1.442285 Oct 04 18:00:45.209247 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1260/2645] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:43 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1509 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:45.213657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:45.218784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:45.234121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:45.236455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:45.236949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:45.239709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:45.241077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:45.242072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:45.477198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=30 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:45.516078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:45.538963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:45.548246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:45.552742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce2f40dd-febb-4eca-b82a-31343ebb18f8 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.346488 Oct 04 18:00:45.561857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1261/2646] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:45 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:45.576475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:45.580656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:45.585242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7efcf75c-4b73-48a5-a941-c0b35e9c5609 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdc1d42ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:45.615094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:45.620619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:45.632531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:45.634703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:45.640371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:45.644229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:45.731080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:45.952049 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ffa2847d-2182-43b8-b3e9-86cbcd7820e0 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 204 len: 0 microversion: 2.1 time: 0.390419 Oct 04 18:00:45.956025 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1262/2647] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:45 2022] DELETE /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:45.979845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:45.980554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:45.982561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:46.022725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.023850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.025647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:46.030073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.034748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.037407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:46.194863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7efcf75c-4b73-48a5-a941-c0b35e9c5609 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8" status: 200 len: 371 microversion: 2.1 time: 1.274194 Oct 04 18:00:46.197674 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1386/2648] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:00:44 2022] GET /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8 => generated 371 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:46.220255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:46.220978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:46.239609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.241467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.244213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:46.245169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.248373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.249043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:46.327351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:00:46.496110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Instance is already in deleting state, ignoring this request Oct 04 18:00:46.497706 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd11d987-73dd-4958-bb91-dafb57895115 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 204 len: 0 microversion: 2.1 time: 0.296557 Oct 04 18:00:46.499046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1387/2649] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:46 2022] DELETE /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:00:46.509188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Action: 'update', calling method: .version_select at 0x7fbdc1d921f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:46.875336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:46.892301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:46.900982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:46.902561 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd1ef5c3-0069-43eb-9b35-5dc54fed628a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.943419 Oct 04 18:00:46.907434 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1263/2650] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:45 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:46.915825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:46.923204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:46.932176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.937188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.938433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:46.939345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:46.942340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:46.942785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.031660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.032220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.032568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.039015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.039510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.039949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.187804 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30114a6e-20e1-4a7e-afa7-44773d79dded tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8" status: 200 len: 328 microversion: 2.1 time: 0.687048 Oct 04 18:00:47.192021 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1388/2651] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 18:00:46 2022] PUT /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8 => generated 328 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:47.197317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:47.202892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:47.217431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.222823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.226295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.227268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.227922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.232317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.312181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:47.322712 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c861bc2f-2edf-4f47-aa66-49825324e108 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1515 microversion: 2.1 time: 0.413923 Oct 04 18:00:47.329749 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1264/2652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:46 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:47.338502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92ea6d8a-cfc9-41d6-a45c-446d57f46f18 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:47.356599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:47.359924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:47.372091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:47.373952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:47.375381 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b65fb6d1-3cc1-4213-aea8-f0415bf6d25a tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.181981 Oct 04 18:00:47.376457 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1389/2653] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:47 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:47.395858 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92ea6d8a-cfc9-41d6-a45c-446d57f46f18 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8" status: 202 len: 0 microversion: 2.1 time: 0.064721 Oct 04 18:00:47.397499 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1265/2654] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:00:47 2022] DELETE /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:00:47.407699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d17201f-6fa6-438c-a922-e767dc1d9925 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdc1d420d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:47.937466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:47.938732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:47.955102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.955830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.956444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:47.958100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:47.960778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:47.962492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:48.053088 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d17201f-6fa6-438c-a922-e767dc1d9925 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8" status: 200 len: 371 microversion: 2.1 time: 0.651349 Oct 04 18:00:48.058415 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1390/2655] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:00:47 2022] GET /compute/v2.1/os-quota-sets/ec79849ffa0b406c922c01aef5dc25c8 => generated 371 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:00:48.298009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69a73ffc-204c-4c3d-8c3f-5880c6867402 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdc1d33a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:48.717089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:48.733093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:48.740857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:48.742181 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35663a05-6c69-4038-8d6f-c3d7516d17fe tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.809273 Oct 04 18:00:48.742789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1266/2656] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:47 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:48.767259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:48.768228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:48.786169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:48.786952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:48.790768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:48.791812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:48.793933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:48.795611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:48.992314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69a73ffc-204c-4c3d-8c3f-5880c6867402 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.699127 Oct 04 18:00:48.995316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1391/2657] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 18:00:48 2022] GET /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7/defaults => generated 371 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:00:49.008152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:49.015212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:49.033236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.036244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.036982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:49.039774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.041642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.043411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:49.164273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:49.178464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:49.184200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:49.188011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b40348cd-324c-4269-bea3-2aa13dbce9af tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.190750 Oct 04 18:00:49.190477 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1392/2658] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:48 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:49.524689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:49.540667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22b9d957-7329-460d-805f-c8662fcf8afa tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1515 microversion: 2.1 time: 0.789081 Oct 04 18:00:49.542467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1267/2659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:48 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1515 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:49.744681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e59deb70-60c6-409f-bce4-203c5e7fc499", "name": "network-vif-deleted", "tag": "b30115c7-8092-4b46-a01c-8fd9eddd08d6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:49.786047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.786555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.787031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:49.792272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:49.813130 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] Creating event network-vif-deleted:b30115c7-8092-4b46-a01c-8fd9eddd08d6 for instance e59deb70-60c6-409f-bce4-203c5e7fc499 on n-h2-831194-21 Oct 04 18:00:49.825627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1a3c0ace-20fc-4c3f-a5c1-a22654158b75 req-abdd9c12-d8fc-4bf8-b241-9b115ff4b85f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084570 Oct 04 18:00:49.831806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1268/2660] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:00:49.838403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:49.850933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:49.859222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.870679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.871414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:49.872756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:49.873469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:49.874142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.232327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.247340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.249134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.250383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30965821-3821-4f37-af57-cd2bb08355a7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.417164 Oct 04 18:00:50.267145 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1269/2661] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:49 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:50.283865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.287832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:50.300012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.301965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.308863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.310626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.312622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.314950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.325060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df3f8848-51df-4194-85a6-f1b16bebfd93 tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] Calling method '.version_select at 0x7fbdc1db84c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.397890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df3f8848-51df-4194-85a6-f1b16bebfd93 tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] 10.222.0.42 "GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1" status: 200 len: 784 microversion: 2.1 time: 0.829209 Oct 04 18:00:50.398658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1393/2662] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:00:49 2022] GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1 => generated 784 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:50.414961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8a543be-7e9b-454f-aa6f-e9804a88beed tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] Calling method '.version_select at 0x7fbdc1df7670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.514960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.541084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.550663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:50.554286 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82835a50-d7b7-43c0-a0c6-d30f6430475e tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.281460 Oct 04 18:00:50.557145 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1270/2663] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:50 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:50.571125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Action: 'update', calling method: .version_select at 0x7fbdc1df9940>, body: {"quota_set": {"ram": "5120"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:50.644639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8a543be-7e9b-454f-aa6f-e9804a88beed tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] 10.222.0.42 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.233059 Oct 04 18:00:50.654586 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1394/2664] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Oct 4 18:00:50 2022] GET /compute/v2.1/images => generated 445 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:00:50.662524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:50.663409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:50.672587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.673177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.673652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.676095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.676857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.677517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.751016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:50.751508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:50.751945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:50.752399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lazy-loading 'fault' on Instance uuid e59deb70-60c6-409f-bce4-203c5e7fc499 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:00:51.095156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '56b04b3d7b1e413292af14ed0e2edb09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0683140028754f90b34960150150068d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.103242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.104021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.108384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.109421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.110647 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1f6ee4e-e09c-41e3-81a4-8329d339408f tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 200 len: 1308 microversion: 2.1 time: 0.453733 Oct 04 18:00:51.112157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.113058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.130005 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1395/2665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:50 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:00:51.139325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89c05678-8745-4a89-a32e-6927c7665837 tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] Calling method '.version_select at 0x7fbdc1da5430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:51.223040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89c05678-8745-4a89-a32e-6927c7665837 tempest-ListImagesTestJSON-1285843090 tempest-ListImagesTestJSON-1285843090-project] 10.222.0.42 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.090870 Oct 04 18:00:51.238467 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1396/2666] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 18:00:51 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:51.262520 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee99baad-e5bc-4c19-92cc-6ff5aee0d6b8 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d" status: 200 len: 328 microversion: 2.1 time: 0.702600 Oct 04 18:00:51.272393 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1271/2667] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 18:00:50 2022] PUT /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d => generated 328 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:51.282610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdc1d4a3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:51.285728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:51.286408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:51.300033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.302073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.303351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.304609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.305765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.306898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.677928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.702288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.713910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.716461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-179aaf50-af33-4e54-b5cc-a8cea23a8e70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.442979 Oct 04 18:00:51.749853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1272/2668] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:51 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:51.759290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:51.760792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:51.772901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.774687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.775358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.777447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:51.778469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:51.779116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:51.956033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.990350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:51.993905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:52.016047 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-280c6da8-1d6a-4a3a-8c6d-182173a93e46 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.263564 Oct 04 18:00:52.032907 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1273/2669] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:51 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:52.135623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.136714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: e59deb70-60c6-409f-bce4-203c5e7fc499] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.145224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.145369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.146015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.146543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.146886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.147536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.147679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.148104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.148891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.149575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.150166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.150604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.169410 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] HTTP exception thrown: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Request method failure captured: Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 HTTP/1.1 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQlmoJGWlOnfislSZdh1oVB9slfb5JL_liyY2dojCaFBhsumGNBKxIqb23qDnVcNSZW_uFASaVyuVZ-Ui004kEc7terkTGGz63pmGFqFQC507Aq32B5JMBYPjsaUz2V3YFlR5vdH1ur1iX366iy2vG5eeGF0jkHoJjkx2pAVY9edAo Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0683140028754f90b34960150150068d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0683140028754f90b34960150150068d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 56b04b3d7b1e413292af14ed0e2edb09 Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e59deb70-60c6-409f-bce4-203c5e7fc499'} Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.171647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. Oct 04 18:00:52.176187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.178852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Returning 404 to user: Instance e59deb70-60c6-409f-bce4-203c5e7fc499 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:52.180338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7891a38-c5a8-4e00-88c2-382e614c1d33 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499" status: 404 len: 111 microversion: 2.1 time: 0.049685 Oct 04 18:00:52.184532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1274/2670] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:52 2022] GET /compute/v2.1/servers/e59deb70-60c6-409f-bce4-203c5e7fc499 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:00:52.192335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.193337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.201358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.202170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.203013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.204065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.204817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.205520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.218149 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3232e3ac-7f7b-436e-b521-63c010c36b62 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d/detail" status: 200 len: 916 microversion: 2.1 time: 0.946483 Oct 04 18:00:52.219496 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1397/2671] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 18:00:51 2022] GET /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d/detail => generated 916 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:52.230675 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] HTTP exception thrown: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Request method failure captured: Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 HTTP/1.1 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQlmoJGWlOnfislSZdh1oVB9slfb5JL_liyY2dojCaFBhsumGNBKxIqb23qDnVcNSZW_uFASaVyuVZ-Ui004kEc7terkTGGz63pmGFqFQC507Aq32B5JMBYPjsaUz2V3YFlR5vdH1ur1iX366iy2vG5eeGF0jkHoJjkx2pAVY9edAo Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0683140028754f90b34960150150068d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0683140028754f90b34960150150068d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 56b04b3d7b1e413292af14ed0e2edb09 Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c3991e40-32c7-4df3-9eb4-e29000bf8180'} Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:52.242776 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.247443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.251559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Returning 404 to user: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:52.255762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db7dbabb-d475-4580-b6a4-acbbae40e767 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 404 len: 111 microversion: 2.1 time: 0.069155 Oct 04 18:00:52.258167 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1275/2672] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:52 2022] DELETE /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:52.273601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.274603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: c3991e40-32c7-4df3-9eb4-e29000bf8180] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.295520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.296739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.301356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.305385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.307476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.308572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.387064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] HTTP exception thrown: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Request method failure captured: Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 HTTP/1.1 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHQlmoJGWlOnfislSZdh1oVB9slfb5JL_liyY2dojCaFBhsumGNBKxIqb23qDnVcNSZW_uFASaVyuVZ-Ui004kEc7terkTGGz63pmGFqFQC507Aq32B5JMBYPjsaUz2V3YFlR5vdH1ur1iX366iy2vG5eeGF0jkHoJjkx2pAVY9edAo Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0683140028754f90b34960150150068d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0683140028754f90b34960150150068d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 56b04b3d7b1e413292af14ed0e2edb09 Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c3991e40-32c7-4df3-9eb4-e29000bf8180'} Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.395894 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. Oct 04 18:00:52.399808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.400234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Returning 404 to user: Instance c3991e40-32c7-4df3-9eb4-e29000bf8180 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:52.406931 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd5ce9b8-10a8-468c-be37-8028273daf83 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180" status: 404 len: 111 microversion: 2.1 time: 0.138198 Oct 04 18:00:52.409980 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1398/2673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:52 2022] GET /compute/v2.1/servers/c3991e40-32c7-4df3-9eb4-e29000bf8180 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:00:52.417252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.418137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.432145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.433359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.436551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.438785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.440039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.442104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.448262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Action: 'update', calling method: .version_select at 0x7fbdc1d4a550>, body: {"quota_set": {"ram": "2048"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:52.467615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] HTTP exception thrown: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Request method failure captured: Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b HTTP/1.1 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQlmoJGWlOnfislSZdh1oVB9slfb5JL_liyY2dojCaFBhsumGNBKxIqb23qDnVcNSZW_uFASaVyuVZ-Ui004kEc7terkTGGz63pmGFqFQC507Aq32B5JMBYPjsaUz2V3YFlR5vdH1ur1iX366iy2vG5eeGF0jkHoJjkx2pAVY9edAo Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0683140028754f90b34960150150068d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0683140028754f90b34960150150068d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 56b04b3d7b1e413292af14ed0e2edb09 Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5ebaee67-62ca-4988-8f1d-26fb853c7a6b'} Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:52.469967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.477614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.481515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Returning 404 to user: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:52.484527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1bc32778-8ffa-4a48-b49d-3e5d537700e9 tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 404 len: 111 microversion: 2.1 time: 0.071711 Oct 04 18:00:52.487196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1276/2674] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:00:52 2022] DELETE /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:52.505716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.508377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] [instance: 5ebaee67-62ca-4988-8f1d-26fb853c7a6b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.528056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.529013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.529781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.531784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.532428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.534137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.588656 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] HTTP exception thrown: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Request method failure captured: Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b HTTP/1.1 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHQlmoJGWlOnfislSZdh1oVB9slfb5JL_liyY2dojCaFBhsumGNBKxIqb23qDnVcNSZW_uFASaVyuVZ-Ui004kEc7terkTGGz63pmGFqFQC507Aq32B5JMBYPjsaUz2V3YFlR5vdH1ur1iX366iy2vG5eeGF0jkHoJjkx2pAVY9edAo Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0683140028754f90b34960150150068d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0683140028754f90b34960150150068d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0683140028754f90b34960150150068d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 0683140028754f90b34960150150068d Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1478349115 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 56b04b3d7b1e413292af14ed0e2edb09 Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1478349115-project Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5ebaee67-62ca-4988-8f1d-26fb853c7a6b'} Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:52.597191 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. Oct 04 18:00:52.604687 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:52.608378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] Returning 404 to user: Instance 5ebaee67-62ca-4988-8f1d-26fb853c7a6b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:52.609893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd6f8e80-457d-438f-a869-6cc12f3f377e tempest-ServerDiskConfigTestJSON-1478349115 tempest-ServerDiskConfigTestJSON-1478349115-project] 10.222.0.42 "GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b" status: 404 len: 111 microversion: 2.1 time: 0.116526 Oct 04 18:00:52.611307 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1277/2675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:00:52 2022] GET /compute/v2.1/servers/5ebaee67-62ca-4988-8f1d-26fb853c7a6b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:00:52.756933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:52.758336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:52.787784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.790834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.792497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:52.794093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:52.798084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:52.799276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.116503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.117017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.117471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.118254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.118728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.119174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.210439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.211091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.211377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.212126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.212591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.213028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.387322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.399668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.400993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3edad6f8-665f-4e86-a88e-b2cda518518f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d?user_id=f1272c3dca0a4110828c4c69417d4e29" status: 200 len: 328 microversion: 2.1 time: 0.955104 Oct 04 18:00:53.401117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.402715 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1399/2676] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:00:52 2022] PUT /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d?user_id=f1272c3dca0a4110828c4c69417d4e29 => generated 328 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:53.416852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:53.418825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:53.421333 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0487c29-5694-4a38-8bc3-fe5d1788c230 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.671550 Oct 04 18:00:53.427656 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1278/2677] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:52 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:53.448031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7f2c1e7a-5be5-40aa-b910-ecd9376ced3d tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdbd755940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:53.457094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:53.467407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.467990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.468456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.469202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:53.469667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:53.472159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:53.684923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.719085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.729037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:53.743542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5aca65ea-2408-4e37-8b7c-119d6a9a9b5d tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.339463 Oct 04 18:00:53.744147 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1400/2678] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:53 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:54.005887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7f2c1e7a-5be5-40aa-b910-ecd9376ced3d tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d?user_id=f1272c3dca0a4110828c4c69417d4e29" status: 200 len: 370 microversion: 2.1 time: 0.576910 Oct 04 18:00:54.007515 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1279/2679] 10.222.0.42 () {58 vars in 1323 bytes} [Tue Oct 4 18:00:53 2022] GET /compute/v2.1/os-quota-sets/34caae447b9a4fb8a7943353284c0a8d?user_id=f1272c3dca0a4110828c4c69417d4e29 => generated 370 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:54.458558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:54.459942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:54.471312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.471891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.472945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.478383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.481024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.483162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.773423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:54.774345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:54.785047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.794274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.795966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.799969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:54.801517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:54.802262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:54.966286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:54.982966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:54.986046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:54.990431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ddde4b00-700b-4a66-b465-b8456e6e046b tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.222344 Oct 04 18:00:54.991726 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1280/2680] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:54 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:55.012884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b14cd7b6-f4e0-4f25-86d1-c326b424562f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Calling method '.version_select at 0x7fbdc1eb3dc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:55.290830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:55.321943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:55.324453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:55.326112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-093ed3cc-49a0-472b-b9be-9241564e5f00 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.873008 Oct 04 18:00:55.327182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1401/2681] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:54 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:55.476855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b14cd7b6-f4e0-4f25-86d1-c326b424562f tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7/defaults" status: 200 len: 371 microversion: 2.1 time: 0.482693 Oct 04 18:00:55.478289 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1281/2682] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 18:00:54 2022] GET /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7/defaults => generated 371 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:55.492720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Action: 'update', calling method: .version_select at 0x7fbdc1d4aa60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:56.207348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.212055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.213059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.215782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.216562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.218484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.399058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1910f0b-154c-48c4-97d6-5260de33ba42 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-220132797", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:56.409565 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a1910f0b-154c-48c4-97d6-5260de33ba42 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] HTTP exception thrown: min_count must be <= max_count Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1910f0b-154c-48c4-97d6-5260de33ba42 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Request method failure captured: Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 183 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTX_gZSD81hq2F58rGuKnbqvd6kLKpk7yVE-UKfRUv5LxWGigYEgEUTaaMWoCSTes8CjaOiOxdf0gVOqZCPBnCihYBT7V4xdbOIT5VonKGgQD3OFoe32sZVgcgrsEQ2OWq7Q88bsSfmtervddWoxwVVZYBgYq7zIZkdEhLlLBYcviQ Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 89da1947c37349aa92e3b61f56b508a4 Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-220132797", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: exception: min_count must be <= max_count Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-220132797', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 04 18:00:56.424337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.435417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1910f0b-154c-48c4-97d6-5260de33ba42 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Returning 400 to user: min_count must be <= max_count {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:56.436961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1910f0b-154c-48c4-97d6-5260de33ba42 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.677488 Oct 04 18:00:56.438839 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1282/2683] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:55 2022] POST /compute/v2.1/servers => generated 74 bytes in 682 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 04 18:00:56.471400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:56.481136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:56.502777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.509023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.510825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.511754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.518875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.524230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.721290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:56.742371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:56.747497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:56.750654 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f1016d9-f03d-40a7-b9a8-ef8d116db247 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.309059 Oct 04 18:00:56.755280 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1283/2684] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:56 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:56.765813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:56.767412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:56.772333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b57b0911-ce03-4534-b4cf-6a73e7255673 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7" status: 200 len: 329 microversion: 2.1 time: 1.282378 Oct 04 18:00:56.777875 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1402/2685] 10.222.0.42 () {60 vars in 1263 bytes} [Tue Oct 4 18:00:55 2022] PUT /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7 => generated 329 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:56.785976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4126669f-cf1a-449f-a3b5-540ef8d95fe3 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1198636016", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "max_count": 0}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:56.788733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.789585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.790781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.791768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:56.792499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:56.794876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4126669f-cf1a-449f-a3b5-540ef8d95fe3 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Request method failure captured: Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 168 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTX_gZSD81hq2F58rGuKnbqvd6kLKpk7yVE-UKfRUv5LxWGigYEgEUTaaMWoCSTes8CjaOiOxdf0gVOqZCPBnCihYBT7V4xdbOIT5VonKGgQD3OFoe32sZVgcgrsEQ2OWq7Q88bsSfmtervddWoxwVVZYBgYq7zIZkdEhLlLBYcviQ Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 89da1947c37349aa92e3b61f56b508a4 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1198636016", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "max_count": 0}} Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1198636016', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'max_count': 0}}} Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:56.799968 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:56.808708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4126669f-cf1a-449f-a3b5-540ef8d95fe3 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:56.814491 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4126669f-cf1a-449f-a3b5-540ef8d95fe3 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.032544 Oct 04 18:00:56.814491 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1403/2686] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:56 2022] POST /compute/v2.1/servers => generated 130 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:56.820194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Action: 'update', calling method: .version_select at 0x7fbdc1d3b4c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:57.334178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.334690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.335142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.341305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.346631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.351160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.452777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:57.475211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:57.477581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:57.482895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9cebcd56-49f3-4535-8067-fb471927bb10 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.723420 Oct 04 18:00:57.484345 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1284/2687] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:56 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:57.492769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e296b26b-04cc-4c7b-b6f2-15ef89aff875 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-35702108", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "max_count": 2.5}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e296b26b-04cc-4c7b-b6f2-15ef89aff875 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Request method failure captured: Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 168 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTX_gZSD81hq2F58rGuKnbqvd6kLKpk7yVE-UKfRUv5LxWGigYEgEUTaaMWoCSTes8CjaOiOxdf0gVOqZCPBnCihYBT7V4xdbOIT5VonKGgQD3OFoe32sZVgcgrsEQ2OWq7Q88bsSfmtervddWoxwVVZYBgYq7zIZkdEhLlLBYcviQ Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 89da1947c37349aa92e3b61f56b508a4 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-35702108", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "max_count": 2.5}} Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-35702108', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'max_count': 2.5}}} Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:57.504588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:57.508660 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:57.519829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e296b26b-04cc-4c7b-b6f2-15ef89aff875 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:57.522677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e296b26b-04cc-4c7b-b6f2-15ef89aff875 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.034594 Oct 04 18:00:57.523284 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1285/2688] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:57.787585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:57.788620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:57.819883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.828809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.831177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:57.834834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:57.843774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:57.850929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:58.032957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=27,nova_api:UPDATE=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:00:58.152691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18307366-7208-4e37-a4cd-f1d24a3fee67 tempest-QuotasAdminTestJSON-1593174399 tempest-QuotasAdminTestJSON-1593174399-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7" status: 200 len: 329 microversion: 2.1 time: 1.341301 Oct 04 18:00:58.162884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1404/2689] 10.222.0.42 () {60 vars in 1263 bytes} [Tue Oct 4 18:00:56 2022] PUT /compute/v2.1/os-quota-sets/cc3bb2a8f89e4ea2a14211c7ca7e86f7 => generated 329 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:00:58.210755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c2d3503-85f3-4321-8cdc-61f8b0df43f0 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-442238240", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 0}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c2d3503-85f3-4321-8cdc-61f8b0df43f0 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Request method failure captured: Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 167 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTX_gZSD81hq2F58rGuKnbqvd6kLKpk7yVE-UKfRUv5LxWGigYEgEUTaaMWoCSTes8CjaOiOxdf0gVOqZCPBnCihYBT7V4xdbOIT5VonKGgQD3OFoe32sZVgcgrsEQ2OWq7Q88bsSfmtervddWoxwVVZYBgYq7zIZkdEhLlLBYcviQ Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 89da1947c37349aa92e3b61f56b508a4 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-442238240", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 0}} Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-442238240', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'min_count': 0}}} Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 0 Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:58.239058 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.246544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c2d3503-85f3-4321-8cdc-61f8b0df43f0 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:58.258767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9c2d3503-85f3-4321-8cdc-61f8b0df43f0 tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.089103 Oct 04 18:00:58.258767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1405/2690] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:58 2022] POST /compute/v2.1/servers => generated 130 bytes in 91 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:58.315011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:58.356315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:58.366198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:58.374257 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d33305f-cd0b-4e50-b08c-ff3161fcd374 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.591588 Oct 04 18:00:58.378050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1286/2691] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:57 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:00:58.522386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:58.523904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:58.537928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:58.546365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:58.548040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:58.549230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:58.549918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:58.551439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:58.990509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6884e0f-e7a9-4dd2-b172-11a5042cdb9d tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-364978645", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 2.5}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6884e0f-e7a9-4dd2-b172-11a5042cdb9d tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Request method failure captured: Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 169 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTX_gZSD81hq2F58rGuKnbqvd6kLKpk7yVE-UKfRUv5LxWGigYEgEUTaaMWoCSTes8CjaOiOxdf0gVOqZCPBnCihYBT7V4xdbOIT5VonKGgQD3OFoe32sZVgcgrsEQ2OWq7Q88bsSfmtervddWoxwVVZYBgYq7zIZkdEhLlLBYcviQ Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_77e1a9b4adc74219957b6918ed8b5b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 77e1a9b4adc74219957b6918ed8b5b3c Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-558989360 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 89da1947c37349aa92e3b61f56b508a4 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-558989360-project Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-364978645", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 2.5}} Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-364978645', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'min_count': 2.5}}} Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi 2.5 Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:00:58.999797 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:00:59.005285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6884e0f-e7a9-4dd2-b172-11a5042cdb9d tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:00:59.008920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6884e0f-e7a9-4dd2-b172-11a5042cdb9d tempest-MultipleCreateNegativeTestJSON-558989360 tempest-MultipleCreateNegativeTestJSON-558989360-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.020749 Oct 04 18:00:59.011265 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1287/2692] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:00:58 2022] POST /compute/v2.1/servers => generated 139 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:00:59.088539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.098285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.099771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.119409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3200f2f-8d7b-4803-99f4-86c0aa151bbb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.602620 Oct 04 18:00:59.141229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1406/2693] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:58 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:00:59.408110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:00:59.408848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:00:59.436103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:59.439276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:59.444780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:59.458927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:00:59.459570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:00:59.464649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:00:59.767154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.781666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.783188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:00:59.784422 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-abcf8d1d-1325-4b48-962c-a1adc3fba432 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.381322 Oct 04 18:00:59.807555 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1288/2694] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:00:59 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:00.156278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:00.160927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:00.190116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:00.196381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:00.196923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:00.198548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:00.201568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:00.202526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:00.823630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:00.825245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:00.836295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:00.842387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:00.843492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:00.844473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:00.845396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:00.846107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:01.121990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:01.233635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.256960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.269568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.271037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.272227 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-22cb330a-9c03-4f57-8200-83af0c8f0bcd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.120245 Oct 04 18:01:01.272614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.279621 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1407/2695] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:00 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:01.301673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:01.305186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fe6e9b1-2a29-4785-b898-bae7a388f31c tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.485775 Oct 04 18:01:01.316500 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1289/2696] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:00 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:02.300911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:02.302825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:02.343985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:02.345403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.346111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.346622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:02.346870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.348296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.366269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.371819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.381716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.383133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.383674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.389164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:02.390364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:02.392320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:02.860179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:02.879812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:02.888283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:02.892150 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3091235e-32b6-4257-ad8a-7930b4353919 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.555315 Oct 04 18:01:02.898409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1290/2697] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:02 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:03.334653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:03.346740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:03.368809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:03.373048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47c6a5ca-3544-4349-b6ce-6a5ecf4ccd47 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.076887 Oct 04 18:01:03.386218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1408/2698] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:02 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:03.926647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:03.927475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:03.944195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.946232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.947967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:03.948759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:03.949996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:03.952752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.046506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:04.204601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:04.227626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:04.237001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:04.243774 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b210721-5729-4cba-9835-3762850a0d81 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.318268 Oct 04 18:01:04.246899 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1291/2699] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:03 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:04.424629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:04.428019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:04.450216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.452460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.454159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:04.458629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:04.460422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:04.462902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.147216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.192496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.200531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.210980 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-359b56dd-9b09-48f3-9318-2066a55a896b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.792160 Oct 04 18:01:05.216905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1409/2700] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:04 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:05.278314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:05.279548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:05.291360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.295605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.296408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.297355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:05.299509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:05.305501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:05.826895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.841059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.854962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:05.856212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c8d9631-8b66-48d3-a77d-0ffd5a5cd3a6 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.584306 Oct 04 18:01:05.870289 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1292/2701] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:05 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:06.245854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:06.246498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:06.278194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:06.278766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:06.279223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:06.280246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:06.286219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:06.286752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:06.888991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:06.889548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:06.924206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:06.925821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:06.926114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:06.927012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:06.927576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:06.928014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:07.227023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.229804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:07.253127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.263091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.266664 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-471ebb6e-6e0f-4330-b7e4-8691f8f0f600 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.381846 Oct 04 18:01:07.269494 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1293/2702] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:06 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:07.385285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=15 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:07.471288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.485122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.516474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:07.524129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27da8612-0c77-43c8-a32f-42996b277b5a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.281205 Oct 04 18:01:07.527504 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1410/2703] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:06 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:08.303552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:08.304950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:08.323624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.329223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.329854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.335414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.337450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.338042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.559022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:08.560131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:08.567235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=94 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:08.587067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.587739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.588998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.591352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:08.592070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:08.593598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:08.640650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:08.653193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:08.669101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:08.671578 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f783194-da24-4a1a-b718-81995581c1e7 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.376549 Oct 04 18:01:08.682080 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1294/2704] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:08 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:09.345269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-110370079", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:09.369312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.391920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.399988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.417165 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a34fe277-16b5-457f-916e-ce6ff709ede4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.860867 Oct 04 18:01:09.421992 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1411/2705] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:08 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:09.525278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:09.711277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:09.711901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:09.738454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.738970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.739419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.740142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:09.740601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:09.741029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:09.931455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.944752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.946232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '94ec2d1c74a24166b9d437b09103f861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '745bc6877bef48bf94ff8bfa4e87dbf6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:09.953292 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d26a6a1-78cc-499f-a00a-fb7e21ee4f85 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 200 len: 1604 microversion: 2.32 time: 0.242696 Oct 04 18:01:09.961880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1412/2706] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:09 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 1604 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:09.981092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:09.981862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:09.982527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:09.983205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:09.983877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:10.021787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.029220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.029672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.031785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.032270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.033042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.090192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Getting quotas for project c1812eaf71f94c0193c8860e20c357f6. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:10.104179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Getting quotas for user e15f566527c0489e99e39e824cbd18d7 and project c1812eaf71f94c0193c8860e20c357f6. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:10.147283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:10.153808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:10.288123 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7358a7b9-50a1-48a0-82c0-3c23f32ceba8 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.491798 Oct 04 18:01:10.289860 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1295/2707] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:01:10.303200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1ce7071-715b-479b-b77b-3ab20075233b tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:10.306461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1ce7071-715b-479b-b77b-3ab20075233b tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:10.538471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1ce7071-715b-479b-b77b-3ab20075233b tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:10.548720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1ce7071-715b-479b-b77b-3ab20075233b tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1213 microversion: 2.1 time: 0.251039 Oct 04 18:01:10.552992 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1296/2708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:10 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1213 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:10.560001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:10.561873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:10.586470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.586972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.587413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.588126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:10.588579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:10.589002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:10.682006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: .version_select at 0x7fbdc1cdcb80>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1966343780", "policies": ["affinity"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:10.770960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:10.791908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:10.978297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:10.999157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:11.055176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12e315dc-49c3-418e-83ed-5fb57d49c6ca tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 1.089563 Oct 04 18:01:11.064034 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1413/2709] 10.222.0.42 () {60 vars in 1174 bytes} [Tue Oct 4 18:01:09 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:11.071416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:11.074066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:11.090754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.092689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.095028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.096175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.099129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.099780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.134298 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] HTTP exception thrown: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Request method failure captured: Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df HTTP/1.1 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHMnDmLaMMU2pCaoqbcnR0dh-ZLLEHSPcI0ru-iwI-HgKQ3CFwphmIeA_SOtF0laENzvTJ6q9uK83sVFKhwI0KGSWULrNwN9PSnC0_xJurqS_POm4WkNXlVcwIPBNj4x9s4uKZqtYHjhSqN79NuaxNmM1Erju84ckKyrDEaq9uNI51E Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 94ec2d1c74a24166b9d437b09103f861 Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bc830e2d-e54c-4fcb-928c-ff3b730598df'} Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:11.139476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:11.145130 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:11.150396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Returning 404 to user: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:11.151604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2085b754-5038-445e-a0c6-a258993ceca4 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 404 len: 111 microversion: 2.32 time: 0.086105 Oct 04 18:01:11.154700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1414/2710] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:11 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:11.162470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: .version_select at 0x7fbdc1cdc0d0>, body: {"server_group": {"name": "tempest-server-group-94005411", "policies": ["affinity"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:11.200443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:11.207529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:11.286161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:11.302382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:11.347704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df15c623-9664-43ad-ad8f-3dc7cd49998f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.191116 Oct 04 18:01:11.356355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1415/2711] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 18:01:11 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:11.365711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc515ea2-d275-4e89-b336-7abf91fd9f2f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '.version_select at 0x7fbdc1d29940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:11.438958 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc515ea2-d275-4e89-b336-7abf91fd9f2f tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030634744" status: 204 len: 0 microversion: 2.32 time: 0.079560 Oct 04 18:01:11.447248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1416/2712] 10.222.0.42 () {60 vars in 1262 bytes} [Tue Oct 4 18:01:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1030634744 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:01:11.467892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: .version_select at 0x7fbdc1d4a280>, body: {"server_group": {"name": "tempest-server-group-94005411", "policies": ["affinity"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:11.540138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:11.556746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:11.658205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:11.759390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:11.773419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:11.838139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-615b531f-5dc2-4a8f-8f7f-b611b5868241 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 162 microversion: 2.1 time: 0.387628 Oct 04 18:01:11.840296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1417/2713] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 18:01:11 2022] POST /compute/v2.1/os-server-groups => generated 162 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:11.857238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:11.861435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:11.883125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.883845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.885357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:11.886400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:11.891044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:11.891817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:12.103202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:12.120005 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8914bd68-a13d-41ee-90e8-2771e151cb80 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1209 microversion: 2.1 time: 0.277470 Oct 04 18:01:12.123336 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1418/2714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:11 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1209 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:12.156451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd19d2c0-3079-4661-904e-96c80b6118b0 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.260708 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd19d2c0-3079-4661-904e-96c80b6118b0 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/c0fabf0e-7b21-4234-8746-70e771153053" status: 204 len: 0 microversion: 2.1 time: 0.134705 Oct 04 18:01:12.263553 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1419/2715] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:12 2022] DELETE /compute/v2.1/os-server-groups/c0fabf0e-7b21-4234-8746-70e771153053 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:12.286471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47a85fb8-d883-41d7-b65a-39a70170414e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.336714 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47a85fb8-d883-41d7-b65a-39a70170414e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.067980 Oct 04 18:01:12.337430 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1420/2716] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:12 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:12.352105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5f41545-b7fd-4526-9487-626b25f1fb24 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.391099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:12.405630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:12.408453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:12.414351 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab86da51-6125-434f-801a-30031849cb83 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.860173 Oct 04 18:01:12.432793 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1297/2717] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:10 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:12.447916 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f5f41545-b7fd-4526-9487-626b25f1fb24 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/77a43cda-0703-4016-9a01-20980f244853" status: 204 len: 0 microversion: 2.1 time: 0.098958 Oct 04 18:01:12.455241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1421/2718] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:12 2022] DELETE /compute/v2.1/os-server-groups/77a43cda-0703-4016-9a01-20980f244853 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:12.459351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e25117a-2b50-453f-b4e1-b5478a05c2bc tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.490600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e25117a-2b50-453f-b4e1-b5478a05c2bc tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036020 Oct 04 18:01:12.491755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1298/2719] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:12.507163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: .version_select at 0x7fbdc1cdcdc0>, body: {"server_group": {"name": "tempest-server-group-496685578", "policies": ["affinity"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:12.583493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:12.599371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:12.780109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:12.789813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:12.827347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96368b28-b0d7-4cd2-a5df-bcfd7c0f1de2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.325243 Oct 04 18:01:12.828470 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1422/2720] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 18:01:12 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:12.846140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc45733e-4799-4dc7-ae0e-13a3f702e257 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:12.886284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:12.955571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc45733e-4799-4dc7-ae0e-13a3f702e257 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/d91a509b-1e72-4200-834d-cb2a987114b5" status: 204 len: 0 microversion: 2.1 time: 0.118559 Oct 04 18:01:12.964109 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1299/2721] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:12 2022] DELETE /compute/v2.1/os-server-groups/d91a509b-1e72-4200-834d-cb2a987114b5 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:12.972728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-130f6e7f-8042-47c3-9cc3-407acac59622 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.001376 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-130f6e7f-8042-47c3-9cc3-407acac59622 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026919 Oct 04 18:01:13.006144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1423/2722] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:12 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:13.020119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: .version_select at 0x7fbdc1de8280>, body: {"server_group": {"name": "tempest-server-group-615030639", "policies": ["anti-affinity"]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:13.043757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:13.051146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:13.127850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:13.140262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_groups'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:13.150299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.151160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:13.161786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.166776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.169858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.173174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.175882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.176529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.195934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d86fce09-b43f-4a86-be77-20ef7ed138ae tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.180840 Oct 04 18:01:13.198945 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1300/2723] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 18:01:13 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:13.218242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf14f388-211c-4ef9-949e-9c9dd58abbf9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.276131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf14f388-211c-4ef9-949e-9c9dd58abbf9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/d60e3099-35cf-4186-b038-a61a5d098a94" status: 204 len: 0 microversion: 2.1 time: 0.069933 Oct 04 18:01:13.277640 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1301/2724] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:13 2022] DELETE /compute/v2.1/os-server-groups/d60e3099-35cf-4186-b038-a61a5d098a94 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:13.294256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4bfaf3b-908b-45fd-90fb-187c903972df tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.323325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4bfaf3b-908b-45fd-90fb-187c903972df tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.041005 Oct 04 18:01:13.327050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1302/2725] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:13.455935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:13.461469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:13.477034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.479770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.481972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.485993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:13.486508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:13.489929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:13.855573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:13.876718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89c5f170-3527-4b1f-8d9e-9ebb7e8e24e2 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1271 microversion: 2.1 time: 0.729253 Oct 04 18:01:13.878799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1424/2726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:13 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1271 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:13.893940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-2013670044", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ecee5398-8dfd-4f7b-8108-ee893dae261e"}]}, "os:scheduler_hints": {"group": "3199a66a-9784-472a-a7fc-ff4c07676bc2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:14.011645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] validate_networks() for [('ecee5398-8dfd-4f7b-8108-ee893dae261e', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:14.295778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:14.320160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:14.322905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:14.329718 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f01e88a3-a530-4afe-8d16-4ede2029d01b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.880328 Oct 04 18:01:14.341298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1303/2727] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:13 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:14.908417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:14.910888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:14.928994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.930608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.932471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:14.934320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:14.936078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:14.939956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:15.342845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:15.377271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-caaf6829-b6ad-46ef-a556-b55ca2bca191 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1271 microversion: 2.1 time: 0.473171 Oct 04 18:01:15.386515 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1304/2728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:14 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1271 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:15.406157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:15.410805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:15.442982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:15.444551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:15.447505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:15.452334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:15.457924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:15.458421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.051574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:16.052079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:16.052483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:16.052906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:16.053325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:16.080427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.113735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.126625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.137693 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b96946b2-944c-4621-9dbc-525960eeeade tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.741225 Oct 04 18:01:16.142844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1305/2729] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:15 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:16.146304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.147251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.147923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.149482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.150697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.151540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.181880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:16.191994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:16.215084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:16.224770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:16.336203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:16.353564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:16.415943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:16.419800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:16.431685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:16.432948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.433925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.434657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.435401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=6,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:16.436051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:16.436750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:16.437698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:16.440681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Getting quotas for user 9a529c28705c442ab6c3cce59e1cac1f and project 68095bebfcd140b7a7fbd4dd4952f617. Resources: {'server_group_members'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:16.507712 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b75ae54-ca8f-4f1a-bf61-03e46aa712fd tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.626504 Oct 04 18:01:16.509015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1425/2730] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:16.526937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d61e9ba-4cd6-434e-96bd-45ebcb3eca71 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:16.528963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5d61e9ba-4cd6-434e-96bd-45ebcb3eca71 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:16.804431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.817851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-229d5c7e-0335-4ee3-b6ab-b88a7896d7a7 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1271 microversion: 2.1 time: 0.412525 Oct 04 18:01:16.818711 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1306/2731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:16 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1271 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:16.843577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d61e9ba-4cd6-434e-96bd-45ebcb3eca71 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:16.852430 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d61e9ba-4cd6-434e-96bd-45ebcb3eca71 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1213 microversion: 2.1 time: 0.336349 Oct 04 18:01:16.857150 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1426/2732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:16 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1213 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:17.176672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:17.177605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:17.208679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.209544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.210176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.211300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.214103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.214823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.697571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:17.711712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:17.719398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:17.720943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cba6aaa5-ece5-44bd-afc2-b6ffd1870352 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.552335 Oct 04 18:01:17.726263 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1307/2733] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:17 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:17.840855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:17.842291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:17.868419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.869568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.870437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.871706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.872391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.873289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.878984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:17.879787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:17.889075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.895072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:17.897006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.898315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:17.899185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:17.901259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:17.902023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.850713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:18.860656 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-beea3c3f-4d09-4114-bbcc-b7262c3b5e74 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1265 microversion: 2.1 time: 0.985524 Oct 04 18:01:18.866216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1308/2734] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:17 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1265 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:18.871133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:18.878631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:18.885896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.891333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.891964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:18.904478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:18.908311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:18.908873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.356597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:19.361170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:19.372312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:19.373684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-291eee0e-8379-4cc5-ab2e-4ec981c17511 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 1.536715 Oct 04 18:01:19.374315 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1427/2735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:17 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:19.376166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:19.377767 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce8c66ed-ead1-4d85-8ad8-739709ef0c76 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.510390 Oct 04 18:01:19.399728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1309/2736] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:18 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:19.891875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:19.892895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:19.900754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.915815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.917405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:19.918926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:19.921334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:19.922073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.214495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:20.228599 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af4235cb-d55f-441c-be8d-e399a84376ba tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1271 microversion: 2.1 time: 0.337166 Oct 04 18:01:20.229320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1428/2737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:19 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1271 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:20.408892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.414904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:20.418061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:20.419241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:20.434834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.437332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.437712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:20.442647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.444755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.447062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.447520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.453037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.454971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.458208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.458984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:20.459464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:20.459905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:20.937027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:20.963455 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18844b0b-49e0-48fb-844b-12daae6bd7d3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 0.563187 Oct 04 18:01:20.965315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1310/2738] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:21.257696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:21.258569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:21.276824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:21.277564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:21.278199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:21.279081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:21.289992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:21.290408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.017173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.040599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.053202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.054383 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5107f79c-850e-44fb-bc87-98c3d170a679 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.653254 Oct 04 18:01:22.065982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1429/2739] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:20 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:22.075110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c1ec073-4d01-4302-a978-3c7470bd093e", "tag": "f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.137012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.144508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.149877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.200205 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] Creating event network-changed:f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea for instance 2c1ec073-4d01-4302-a978-3c7470bd093e on n-h1-831194-21 Oct 04 18:01:22.208448 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-242f3550-34bb-4d0b-8713-8fcb17994757 req-386e7cf0-3a56-489e-b2d5-d64f33dfda51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146955 Oct 04 18:01:22.212205 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1430/2740] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:22.230610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:22.234235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:22.254889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.255688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.256389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.257272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.258132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.260840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.570683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:22.591489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f800b9e-12f6-412f-99fd-2351ff8f4ee5 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 1.338610 Oct 04 18:01:22.592800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1311/2741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:21 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:22.825859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb690201-1c8d-482b-97c4-7cb4d55ce575", "name": "network-vif-unplugged", "status": "completed", "tag": "d3772592-0a4c-44be-9433-4dec3335ee85"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:22.866982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:22.867905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:22.868373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:22.946170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] Creating event network-vif-unplugged:d3772592-0a4c-44be-9433-4dec3335ee85 for instance fb690201-1c8d-482b-97c4-7cb4d55ce575 on n-h2-831194-21 Oct 04 18:01:22.965452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7d1a48be-77e6-4b68-a4e4-3698edd372b8 req-25e8e416-7017-49e6-be3d-35612f789452 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.148824 Oct 04 18:01:22.973086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1312/2742] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:23.086488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.087083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:23.111122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.111976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.115138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.119332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.120538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.121158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.189020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:23.570325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:23.586045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:23.590774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:23.602571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac9a7577-587f-4403-90b3-d9a3589bca16 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.523251 Oct 04 18:01:23.603561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1313/2743] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:23 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:23.630568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:23.631319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:23.652056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.660444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.661107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:23.662041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:23.663898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:23.664377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.186108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:24.195842 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba0b5fd3-6e44-40d7-9c90-e14628969c70 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.580430 Oct 04 18:01:24.200608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1314/2744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:23 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:24.443877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:24.459023 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e20b910c-205b-4c36-814f-29ed73bbcb3a tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 2.241546 Oct 04 18:01:24.460215 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1431/2745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:22 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:24.574948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69e6740-94b8-452a-b0ef-7cd1a92ee5c6", "tag": "76c06288-e758-4752-a3a1-b89b3f535564"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:24.595708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.596979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.598698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.630690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:24.631412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:24.632539 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] Creating event network-changed:76c06288-e758-4752-a3a1-b89b3f535564 for instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 on n-h1-831194-21 Oct 04 18:01:24.647682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.649116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.649632 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1b454a21-0842-4004-86eb-44078ebe7d01 req-52040612-b421-4981-9172-cea7e7164937 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080516 Oct 04 18:01:24.650227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:24.651565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:24.652846 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1315/2746] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:24.653544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:24.657797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.225796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:25.226775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:25.238288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.239777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.240496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.241888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.242530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.243290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.438164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:25.470128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:25.476061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:25.477629 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93d4f900-579b-4b02-bdd9-96083315052a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.852689 Oct 04 18:01:25.486054 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1432/2747] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:24 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:25.511711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:25.522716 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce09295e-3817-4e8c-b1ad-1c9520b5f27f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.303241 Oct 04 18:01:25.524630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:25.524812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1316/2748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:25 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:25.530553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:25.562952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.564864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.567609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:25.578677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:25.580227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:25.585767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.163098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:26.261768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb690201-1c8d-482b-97c4-7cb4d55ce575", "tag": "d3772592-0a4c-44be-9433-4dec3335ee85"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:26.350956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.351462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.351905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.412502 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] Creating event network-changed:d3772592-0a4c-44be-9433-4dec3335ee85 for instance fb690201-1c8d-482b-97c4-7cb4d55ce575 on n-h2-831194-21 Oct 04 18:01:26.430523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-56c1c0c3-179f-42fe-b26c-42730970ff63 req-6d4f3b2f-9ae5-4ed0-b78b-6f3beca41418 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175051 Oct 04 18:01:26.436943 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1317/2749] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:01:26.521918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:26.523125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:26.545791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.548060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.550746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.556333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.557785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.559106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.734538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:26.754814 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e18da463-c178-4dc3-ab5a-3bd83c9801bc tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 1.265458 Oct 04 18:01:26.756706 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1433/2750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:25 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:26.770869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:26.773291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:26.793799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.798211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.799834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.802417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:26.803903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:26.805736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:26.886561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=48 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:27.621563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.644635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.651488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:27.664545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1acf3b71-6e55-48d6-937d-ef6f2434572c tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.148789 Oct 04 18:01:27.665779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1318/2751] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:26 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:27.781986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:27.782785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:27.793241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.799618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.801988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.803506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:27.805175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:27.805878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:27.816239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:28.016867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:28.026727 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4c017e4-f2e4-45a8-8500-c8cea1d63c32 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 1.267924 Oct 04 18:01:28.030250 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1434/2752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:26 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:28.243861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:28.263183 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2342c52-e94c-425a-82b3-0285199212be tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 0.485723 Oct 04 18:01:28.269038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1319/2753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:27 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:28.709183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:28.710513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:28.724992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.726070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.735014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:28.736984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:28.739093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:28.740911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.059803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.061189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.097515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.101193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.103578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.109376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.110273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.110960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.546725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:29.558168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a57855c5-c277-488c-aeea-fe76e7fd02c1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.505308 Oct 04 18:01:29.563630 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1320/2754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:29.588050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:29.588924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:29.596737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.598029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.598767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.600733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:29.601467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:29.602268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:29.952636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:29.969343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e7c50537-45a6-493a-8f7a-c7cd8d07a932 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 0.403058 Oct 04 18:01:29.971154 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1321/2755] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:29 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:30.323498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.336924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.342935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:30.344718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ea4e562-5a2b-434b-8bbe-9e597cbf84c5 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 1.641502 Oct 04 18:01:30.363973 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1435/2756] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:28 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:30.590095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.591476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:30.610429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.619164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.621291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.625137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:30.626946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:30.633670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:30.999037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:30.999610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.020479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.026354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.027063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.027969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.028582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.029164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.172427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:31.185983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26cf6ad1-6735-42d6-a8a5-56dc62697da1 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.600877 Oct 04 18:01:31.187282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1322/2757] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:31.381358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:31.382161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:31.399116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.403339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.406594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.407604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:31.410150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:31.410612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:31.848205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:31.869199 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8c12e4d-ec5e-4275-81da-16f6b8900b0f tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 0.862740 Oct 04 18:01:31.869903 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1436/2758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:30 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:32.009495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.030746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.035330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:32.037136 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91754538-be4a-4718-adff-820e3c19021a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.660759 Oct 04 18:01:32.038226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1323/2759] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:31 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:32.210745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1ec073-4d01-4302-a978-3c7470bd093e", "name": "network-vif-plugged", "status": "completed", "tag": "f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:32.220771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:32.223001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:32.244139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.244639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.245093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.245809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.246292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.246766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.247077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:32.250195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:32.251438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:32.292831 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] Creating event network-vif-plugged:f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea for instance 2c1ec073-4d01-4302-a978-3c7470bd093e on n-h1-831194-21 Oct 04 18:01:32.303091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6822c35e-116e-4eb5-aaa1-64bda717dc68 req-008b717f-f18f-4fd5-9543-9c0d7a8ed664 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101420 Oct 04 18:01:32.304271 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1437/2760] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:32.960670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1356219", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:33.114369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] validate_networks() for [('1b23a667-4c94-4de3-83f9-7bb689992e52', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:33.157399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:33.170228 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15511fa6-d08f-4245-8bb0-6dc862ac80b9 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.958931 Oct 04 18:01:33.189502 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1324/2761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:32 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.194059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.194685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.224293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.224801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.225244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.226017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.226453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.227098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.896871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:33.917110 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2868576-eae2-41a3-a23f-7091b8868438 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1313 microversion: 2.1 time: 0.721968 Oct 04 18:01:33.917676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1325/2762] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:33 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1313 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:33.927987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:33.928685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:33.969461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.971068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.971585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:33.973012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:33.973393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:33.973867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.564014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:34.564589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:34.564906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:34.565422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:34.565805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:34.592948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.595759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.596530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.598238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.598726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.599179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.625477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.645452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Getting quotas for project d2c133b854094d5d82082773a1e8f3f8. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:34.656479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.658824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:34.661634 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13af75f2-d35d-4adb-93e2-8bc76d39bb78 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.742972 Oct 04 18:01:34.668073 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1326/2763] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:33 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:34.677008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Getting quotas for user 2927d6dbb72d47a0aa8cddb3e0244a08 and project d2c133b854094d5d82082773a1e8f3f8. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:34.689565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.693735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:34.709354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.712008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.712471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.713381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:34.713895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:34.714437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:34.721897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:34.724929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:34.834773 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e6d419e-d636-41b2-bd74-2755491411c6 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.256523 Oct 04 18:01:34.837413 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1438/2764] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:01:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:01:34.868956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2172c97b-0d7c-41e7-bc7c-60b3eb1125ae tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:34.869886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2172c97b-0d7c-41e7-bc7c-60b3eb1125ae tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.115638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2172c97b-0d7c-41e7-bc7c-60b3eb1125ae tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.127902 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2172c97b-0d7c-41e7-bc7c-60b3eb1125ae tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1220 microversion: 2.1 time: 0.280776 Oct 04 18:01:35.128509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1439/2765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1220 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.158167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.195635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.225570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.226136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.226579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.227296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.227750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.249078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.568425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.576311 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d20286f-9c76-4e38-984c-2f28dfc6e6d8 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.906970 Oct 04 18:01:35.595283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:35.605476 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ced7abad-a6dc-480c-8b0f-6a37de30ca58 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1463 microversion: 2.1 time: 0.470144 Oct 04 18:01:35.606604 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1440/2766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1463 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.607919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1327/2767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:34 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:35.611617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:35.612549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:35.619626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.620359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.620971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.621875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:35.622491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:35.623333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:35.658798 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] HTTP exception thrown: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Request method failure captured: Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df HTTP/1.1 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHMnDmLaMMU2pCaoqbcnR0dh-ZLLEHSPcI0ru-iwI-HgKQ3CFwphmIeA_SOtF0laENzvTJ6q9uK83sVFKhwI0KGSWULrNwN9PSnC0_xJurqS_POm4WkNXlVcwIPBNj4x9s4uKZqtYHjhSqN79NuaxNmM1Erju84ckKyrDEaq9uNI51E Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 94ec2d1c74a24166b9d437b09103f861 Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bc830e2d-e54c-4fcb-928c-ff3b730598df'} Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:35.661248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:35.666393 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:35.673099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Returning 404 to user: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:35.678163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0419b0c1-699d-4ce6-860d-2d628e67d4b2 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 404 len: 111 microversion: 2.32 time: 0.068958 Oct 04 18:01:35.680891 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1441/2768] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:01:35 2022] DELETE /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:36.283482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1580336528", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "3f4cd0f7-ff8e-4b66-a8cd-e3a305d28b6c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:36.464926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] validate_networks() for [('3f4cd0f7-ff8e-4b66-a8cd-e3a305d28b6c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:01:36.553703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Calling method '.version_select at 0x7fbdbdc7c5e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.584588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.596099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.599711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.678781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.680001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.680813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.732377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b79dc967-f5e7-4594-acb5-4d312b98b41f tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/c1812eaf71f94c0193c8860e20c357f6?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935" status: 200 len: 693 microversion: 2.1 time: 1.048966 Oct 04 18:01:36.736495 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1442/2769] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Oct 4 18:01:35 2022] GET /compute/v2.1/os-simple-tenant-usage/c1812eaf71f94c0193c8860e20c357f6?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935 => generated 693 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:36.752516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.756171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] [instance: bc830e2d-e54c-4fcb-928c-ff3b730598df] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.769541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.773021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.774030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.774940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.777123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.778053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.817048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] HTTP exception thrown: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Request method failure captured: Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df HTTP/1.1 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHMnDmLaMMU2pCaoqbcnR0dh-ZLLEHSPcI0ru-iwI-HgKQ3CFwphmIeA_SOtF0laENzvTJ6q9uK83sVFKhwI0KGSWULrNwN9PSnC0_xJurqS_POm4WkNXlVcwIPBNj4x9s4uKZqtYHjhSqN79NuaxNmM1Erju84ckKyrDEaq9uNI51E Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.32 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_745bc6877bef48bf94ff8bfa4e87dbf6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 745bc6877bef48bf94ff8bfa4e87dbf6 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TaggedBootDevicesTest-951214583 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 94ec2d1c74a24166b9d437b09103f861 Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TaggedBootDevicesTest-951214583-project Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bc830e2d-e54c-4fcb-928c-ff3b730598df'} Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:36.819965 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. Oct 04 18:01:36.826016 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:36.830640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] Returning 404 to user: Instance bc830e2d-e54c-4fcb-928c-ff3b730598df could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:36.832748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4abce350-003c-4d58-b756-b649a602efb3 tempest-TaggedBootDevicesTest-951214583 tempest-TaggedBootDevicesTest-951214583-project] 10.222.0.42 "GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df" status: 404 len: 111 microversion: 2.32 time: 0.092405 Oct 04 18:01:36.841253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1443/2770] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/bc830e2d-e54c-4fcb-928c-ff3b730598df => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:01:36.852590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:36.855827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:36.875938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.876965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.879728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:36.882535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:36.885522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:36.886247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.212162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.230469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.232158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.234972 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9243a38-21f6-4154-a47f-a987274039e6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.392238 Oct 04 18:01:37.236998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1444/2771] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:36 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:37.243256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e6740-94b8-452a-b0ef-7cd1a92ee5c6", "name": "network-vif-plugged", "status": "completed", "tag": "76c06288-e758-4752-a3a1-b89b3f535564"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:37.257131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.258026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.258705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.274427 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] Creating event network-vif-plugged:76c06288-e758-4752-a3a1-b89b3f535564 for instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 on n-h1-831194-21 Oct 04 18:01:37.285858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8f68e5d1-def0-4072-b9a5-fd22034c3fad req-5e7436bb-c56e-4b99-83b8-d311094faf55 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045432 Oct 04 18:01:37.289904 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1445/2772] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:37.295748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.300907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.312590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.313462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.314190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.315889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.316592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.317727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.406452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.423561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8dc3165a-12de-4574-b018-14028009ab51 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1280 microversion: 2.1 time: 0.126103 Oct 04 18:01:37.432950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1446/2773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1280 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.453259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.457339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:37.503999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.508238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.511100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.512960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.513602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.516291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.836291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:37.845901 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-51743e2c-2a3e-4715-9b43-ac06037eb062 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.408903 Oct 04 18:01:37.847989 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1447/2774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:37.855307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '.version_select at 0x7fbdc1cfb550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.866601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.877595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.878953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.906061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.906559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.907009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:37.933865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c7b9020-59f7-4ff7-bb2e-398d3a323898 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage/c1812eaf71f94c0193c8860e20c357f6?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935" status: 200 len: 694 microversion: 2.1 time: 0.083291 Oct 04 18:01:37.944475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1448/2775] 10.222.0.42 () {58 vars in 1412 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/os-simple-tenant-usage/c1812eaf71f94c0193c8860e20c357f6?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935 => generated 694 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:37.953698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Calling method '.version_select at 0x7fbdc1cfbe50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:37.977008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:37.977503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:37.996355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.036510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.037000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.042336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.358614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a320f93-a1ef-494f-b710-0004ab03d230 tempest-TenantUsagesTestJSON-2046094129 tempest-TenantUsagesTestJSON-2046094129-project-admin] 10.222.0.42 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935&detailed=1" status: 200 len: 33921 microversion: 2.1 time: 0.408473 Oct 04 18:01:38.363761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1449/2776] 10.222.0.42 () {58 vars in 1335 bytes} [Tue Oct 4 18:01:37 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-03T18%3A01%3A35.626935&end=2022-10-05T18%3A01%3A35.626935&detailed=1 => generated 33921 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:01:38.379886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.384072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:38.419747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.420242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.420677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.421410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.421874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.422308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.776556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.779283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:38.823034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.825968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:38.827178 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96ad19ea-a769-4e16-b4dc-2fa172d2764e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.461955 Oct 04 18:01:38.841868 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1450/2777] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:38 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:38.859071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:38.861990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:38.882415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.882907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.883346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.884061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:38.884532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:38.891245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:38.966088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:39.149391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a5765aa-d908-40e4-be34-e8ec663de3ff tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 204 len: 0 microversion: 2.1 time: 0.305718 Oct 04 18:01:39.153705 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1451/2778] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:38 2022] DELETE /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:39.163520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.164286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.171461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.172044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.172486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.173198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.173643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.177940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.271624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.291091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-76393e8c-b483-41a3-b5d6-c4502a9824dc tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1278 microversion: 2.1 time: 0.135462 Oct 04 18:01:39.301916 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1452/2779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:39.301916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.307804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.319452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.319949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.320379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.321085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.321537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.321987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.416886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:01:39.419087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:01:39.419794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:01:39.420544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:01:39.421175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:01:39.436902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.442508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.444397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.445727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.448070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.449571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.517939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Getting quotas for project 770cd5273a08415b9483abdf3b51d609. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:01:39.536822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:39.541422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Getting quotas for user 76e224d616cd49508d58a539c9b0c89b and project 770cd5273a08415b9483abdf3b51d609. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:01:39.570594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:01:39.576971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:01:39.669329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:39.683529 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-39c7c4e2-d0eb-44f5-8b23-f34193a2057c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.390282 Oct 04 18:01:39.693976 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1453/2780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:39.693976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.696057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:39.720698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.722773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.724428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.727043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:39.730202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:39.730919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:39.735987 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe1b51f5-35df-4686-8ea0-f02db7b31351 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.126659 Oct 04 18:01:39.737002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1328/2781] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:01:39.748801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:39.749427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.025149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.035400 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-815b8ebf-4e44-4633-b46f-b61c033d6561 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1469 microversion: 2.1 time: 0.349074 Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1454/2782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.049869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.050710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.051047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.051321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.225809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.243940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.250585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.254002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6463bdc-d4a1-41ac-85df-31ebcb675615 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1259 microversion: 2.21 time: 0.507449 Oct 04 18:01:40.255825 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1329/2783] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:39 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1259 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:40.347306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.348801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.376341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.379869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.381801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.387216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.390492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.392030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.453654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.463918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.470240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.474398 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4438ec5-f205-4396-8743-f6ae77a899fb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.437212 Oct 04 18:01:40.487798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1455/2784] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:40.572766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:40.582662 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2d573ff-e93a-4923-9594-90adab99af88 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1278 microversion: 2.1 time: 0.250017 Oct 04 18:01:40.587980 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1330/2785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:40.723883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:40.725031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:40.737615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.742868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.744432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:40.745608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:40.746464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:40.747346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.066291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.066989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:41.096078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.097568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.101086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.105328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.106092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.106737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.255384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.283889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-121eba6b-71e5-45f0-a747-98ed4934d76c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1313 microversion: 2.1 time: 0.578031 Oct 04 18:01:41.301864 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1456/2786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:40 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1313 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:41.309099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.309735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:41.347086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.356744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.358991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.359766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.360241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.360681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.576891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.592825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.607695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:41.614444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6cdb5cc9-192d-47ed-be3e-16a28ea9f788 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1255 microversion: 2.21 time: 0.323625 Oct 04 18:01:41.632161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1457/2787] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1255 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:41.642787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:41.643819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:41.650948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.651693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.652381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:41.653403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:41.654413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:41.655084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.199618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.214619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f42f0262-2183-4456-a9f0-3903d7c6501d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1469 microversion: 2.1 time: 1.154391 Oct 04 18:01:42.215233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1331/2788] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1469 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:42.241159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.242609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.243237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:42.262493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.268074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.269819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.270547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.271562 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5121a413-ab6a-4703-bf6b-d08ccd416df1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1487 microversion: 2.25 time: 0.636658 Oct 04 18:01:42.273634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.277136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.277846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.279423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.286502 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1458/2789] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:41 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1487 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:42.317229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.318122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:42.333299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.337544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.338156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.340130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:42.345412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:42.347660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:42.960731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:42.972650 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fdc7e4cb-90c4-4969-b98a-18515d743a02 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.733521 Oct 04 18:01:42.973274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1332/2790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:42.988132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:42.992514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.023032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.025933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.030496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.032586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.035157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.037541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44d2e2a5-c2de-444d-8ebf-66206616ed68 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1499 microversion: 2.1 time: 0.726036 Oct 04 18:01:43.041605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.042802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1459/2791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1499 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:43.046576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.056121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c1ec073-4d01-4302-a978-3c7470bd093e", "name": "network-vif-deleted", "tag": "f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:43.090624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.094590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.098721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.133623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] Creating event network-vif-deleted:f3b26dc7-fbd8-4748-bf61-2ffdb25fd4ea for instance 2c1ec073-4d01-4302-a978-3c7470bd093e on n-h1-831194-21 Oct 04 18:01:43.165305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d16194ed-58a5-459e-b031-3bf1590d94af req-f528400a-e614-42c2-9217-a5449b195706 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118084 Oct 04 18:01:43.168666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1460/2792] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.190958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.207313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:43.231699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_groups [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Querying cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) for 1 instances {{(pid=128849) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:01:43.234544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.237430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.238236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.293814 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cf4a41e-60dc-4fef-87cf-d4c21c1cd679 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2" status: 200 len: 222 microversion: 2.1 time: 0.117112 Oct 04 18:01:43.296674 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1461/2793] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2 => generated 222 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:43.302731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.311799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.329642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.330530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.331471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.332638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.333351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.334022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.416291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.416636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.417083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.417545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lazy-loading 'fault' on Instance uuid 2c1ec073-4d01-4302-a978-3c7470bd093e {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:43.482092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.496715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.499006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:43.504958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2788359f-e012-4256-b555-12cb4340eed5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1317 microversion: 2.21 time: 0.520152 Oct 04 18:01:43.507550 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1333/2794] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:42 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1317 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:43.520255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.533449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.555314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.557024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.559451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.562503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.563268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.564715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.657716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:43.910492 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33371aba-5bfa-42ab-b4d9-954cc1a3b5cf tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 204 len: 0 microversion: 2.1 time: 0.401052 Oct 04 18:01:43.912189 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1334/2795] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:43 2022] DELETE /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:43.926416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:43.927614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:43.942833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.943494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.943997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:43.945223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:43.946080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:43.947408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.075940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e15f566527c0489e99e39e824cbd18d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1812eaf71f94c0193c8860e20c357f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.099816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f6d01ca-f6e9-461d-9ef9-5f99cd39def3 tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 200 len: 1303 microversion: 2.1 time: 0.801770 Oct 04 18:01:44.114761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1462/2796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 1303 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:44.125954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.126905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.135822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.137448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.138223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.139228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.139967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.140622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.269274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.276099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:44.286156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.288274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.290021 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d8f575b7-26bf-411d-86b3-9814f928d3b4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1477 microversion: 2.25 time: 0.375726 Oct 04 18:01:44.303835 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1335/2797] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:43 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1477 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:44.327994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.329013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.344232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.345104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.348778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.350924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.351852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.353439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.583886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.595098 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b7466ff-3c26-4ef2-9718-e01f5036bfea tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1505 microversion: 2.1 time: 0.478838 Oct 04 18:01:44.598693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1463/2798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1505 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:44.603581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b0cd51c-2305-4f03-9178-ace58573a769 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '.version_select at 0x7fbdc1dee1f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.621330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b0cd51c-2305-4f03-9178-ace58573a769 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.622416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b0cd51c-2305-4f03-9178-ace58573a769 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.623946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b0cd51c-2305-4f03-9178-ace58573a769 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.646604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b0cd51c-2305-4f03-9178-ace58573a769 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 1956 microversion: 2.25 time: 0.046472 Oct 04 18:01:44.647484 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1464/2799] 10.222.0.42 () {60 vars in 1184 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/os-migrations => generated 1956 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:44.647484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.647484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.673297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.673919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.674492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.676066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.678052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.678726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.730069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.740164 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92d79c29-3d3e-44c5-af6e-057cce82bf7c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.434835 Oct 04 18:01:44.745873 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1336/2800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:44.759445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:44.760792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:44.772947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.775312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.776215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.778412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:44.780138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:44.781349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:44.913918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.929872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.935299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:44.936699 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98869998-1c8d-472c-b2f1-e6ca67acde3b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1317 microversion: 2.21 time: 0.288045 Oct 04 18:01:44.954853 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1465/2801] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1317 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:45.132431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.133598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] [instance: 2c1ec073-4d01-4302-a978-3c7470bd093e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:45.138364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:45.151320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.152683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.153319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.158999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.160729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.161693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.206424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] HTTP exception thrown: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Request method failure captured: Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e HTTP/1.1 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTiDaFh4fiMxSXOGJh0nvl3cSqN13Zb7W8O0j4AYKzow2wrCdukzdleDOW9x7NMGMikGr-qM3Cc63ZUTotYZeOApyXt1TKRYeU3KMu3E7__rFTsdyE49uqumgo_9khnb4iHmLZdHXuQQrrbVx_Bxn_QTaQlhUsyyM4gEcD7QQbI8vo Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c1812eaf71f94c0193c8860e20c357f6 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TenantUsagesTestJSON-813878518 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c1812eaf71f94c0193c8860e20c357f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1812eaf71f94c0193c8860e20c357f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c1812eaf71f94c0193c8860e20c357f6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c1812eaf71f94c0193c8860e20c357f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TenantUsagesTestJSON-813878518 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c1812eaf71f94c0193c8860e20c357f6 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TenantUsagesTestJSON-813878518 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TenantUsagesTestJSON-813878518-project Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e15f566527c0489e99e39e824cbd18d7 Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TenantUsagesTestJSON-813878518-project Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2c1ec073-4d01-4302-a978-3c7470bd093e'} Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:45.227805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] Returning 404 to user: Instance 2c1ec073-4d01-4302-a978-3c7470bd093e could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82fa3398-915b-4343-97f5-3f6712d0843d tempest-TenantUsagesTestJSON-813878518 tempest-TenantUsagesTestJSON-813878518-project] 10.222.0.42 "GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e" status: 404 len: 111 microversion: 2.1 time: 0.103971 Oct 04 18:01:45.232033 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1466/2802] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/servers/2c1ec073-4d01-4302-a978-3c7470bd093e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:45.627035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:45.627755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:45.661282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.662014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.662489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:45.663245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:45.663724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:45.664161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.334339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.337969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:46.360862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1661835-9e71-4b76-9264-af72df0b1332 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1505 microversion: 2.1 time: 0.740903 Oct 04 18:01:46.361643 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1467/2803] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:45 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1505 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:01:46.380012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.383834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:46.402303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.403056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.403687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.406118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.409476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.410311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.850317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] Lazy-loading 'services' on Instance uuid fb690201-1c8d-482b-97c4-7cb4d55ce575 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:46.861006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:46.897618 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1f2db8a-5902-471e-92fd-1cc5e2734387 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.530538 Oct 04 18:01:46.899012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1468/2804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:46.907006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:46.908056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:46.927374 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-682a6223-8580-4d00-a5e0-5e92278c7a62 tempest-LiveAutoBlockMigrationV225Test-1096008452 tempest-LiveAutoBlockMigrationV225Test-1096008452-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1971 microversion: 2.25 time: 2.178956 Oct 04 18:01:46.930016 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1337/2805] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:44 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1971 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:46.954309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.955350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:46.958293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.959728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.960710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.965984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.966674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:46.991980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:46.994331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:46.995016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.035237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] Creating event network-changed:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:01:47.054586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a44cf993-0212-429f-843e-5fc85f8aac57 req-aa75211a-7a13-430f-a087-4a9db7d6699c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107151 Oct 04 18:01:47.056700 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1338/2806] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:47.082589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.083405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:47.092291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.092808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.093498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.100636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.101203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.101605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.248606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:01:47.501034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2532fb81-1019-43ab-b5cf-5b75c3d34cc9 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 204 len: 0 microversion: 2.25 time: 0.438043 Oct 04 18:01:47.502334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1339/2807] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:01:47 2022] DELETE /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:01:47.528618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.536065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:47.550953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.554484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.555245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.558525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.559280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.562337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.762876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:47.787503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:47.790695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:47.797811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a6bf72c-e000-490e-ab4c-0be5745752f4 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 0.891895 Oct 04 18:01:47.799391 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1469/2808] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:46 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:47.812141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:47.816601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:47.836384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.839282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.841913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:47.845738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:47.849676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:47.850675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.021998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:48.370591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.380558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.390537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.392142 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89d44bd9-ebd2-46f6-bf48-180cceb19425 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1483 microversion: 2.25 time: 0.590344 Oct 04 18:01:48.394992 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1470/2809] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:47 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1483 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:48.433329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.435666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:48.449660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.452352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.454910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.457250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.458402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.459429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.745177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.756887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7e25317-4e5b-4f5a-8213-f467dd9f6811 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1505 microversion: 2.1 time: 1.248064 Oct 04 18:01:48.760800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1340/2810] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:47 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1505 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:48.780340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d1c502-6ac8-478c-b771-d1e50a55acd0", "tag": "01a5a499-faf7-46cb-84be-091fe776ef90"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:48.815056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.818650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.819708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:48.820432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.834767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-365fe38d-b5a9-4bc5-a06c-500bbf02e7c0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.410929 Oct 04 18:01:48.838202 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1471/2811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:48.847526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:48.852008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:48.853122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] Creating event network-changed:01a5a499-faf7-46cb-84be-091fe776ef90 for instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 on n-h2-831194-21 Oct 04 18:01:48.871814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.875085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-83e9c352-6df9-477a-aabb-00a09d4999f7 req-5c8f8305-884f-49f5-9575-dd91a6ad2a80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111403 Oct 04 18:01:48.875717 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1341/2812] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:48.876379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.876851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:48.879058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:48.879211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:48.881385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.435225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.435957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:49.458480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.460562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.461015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.463933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.464402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.469365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.512085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:49.652465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.669407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.671102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:49.673540 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e24f608-9f36-4a6d-9494-78acd25ad1f9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 0.834093 Oct 04 18:01:49.684839 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1472/2813] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:48 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:49.699260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69e6740-94b8-452a-b0ef-7cd1a92ee5c6", "name": "network-vif-deleted", "tag": "76c06288-e758-4752-a3a1-b89b3f535564"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:49.730179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.738640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.740761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.804621 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] Creating event network-vif-deleted:76c06288-e758-4752-a3a1-b89b3f535564 for instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 on n-h1-831194-21 Oct 04 18:01:49.819010 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0788f808-6633-49e7-baea-469c332e50c2 req-fd816493-9f7b-4d5d-bbb8-fc8fd77f4cd5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130307 Oct 04 18:01:49.844252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1473/2814] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:49.864972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:49.865733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:49.881399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.881934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.885966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.886885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.890404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.891032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.981693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:49.982192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:49.982727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:49.983417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lazy-loading 'fault' on Instance uuid b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:50.178465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a529c28705c442ab6c3cce59e1cac1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68095bebfcd140b7a7fbd4dd4952f617', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:50.190688 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dfe8979b-f422-4e79-b3fd-e76b0f1392b6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 200 len: 1303 microversion: 2.1 time: 0.344806 Oct 04 18:01:50.202882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1474/2815] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:49 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 1303 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:50.224221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.224865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.238166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:50.239617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.242918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.243579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.246885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.247741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.248662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.625073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:50.643967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:50.650736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:50.652230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0a125aa-164f-4b80-b122-15ac74561b2d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1483 microversion: 2.25 time: 1.224646 Oct 04 18:01:50.667982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1342/2816] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:49 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1483 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:50.712595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:50.713527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:50.725524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.744561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.747987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.749276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:50.750440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:50.755318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:50.776672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:50.788962 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53cb1a1c-c23e-4ca8-a09e-4c7c1620803d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.583641 Oct 04 18:01:50.805854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1475/2817] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:50 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:51.058504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.070161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.093943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:51.093943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90fea683-ffd9-4b3a-9a35-78374e40a0bb tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 0.381039 Oct 04 18:01:51.118150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1343/2818] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:50 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:51.224387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.225293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.239045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.239537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.240795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.243511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.244160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.246071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.281258 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 HTTP/1.1 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b69e6740-94b8-452a-b0ef-7cd1a92ee5c6'} Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.285114 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.289646 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.291772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.295652 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae642b04-c127-4ba2-816a-8b67d70c6e67 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 404 len: 111 microversion: 2.1 time: 0.076005 Oct 04 18:01:51.296791 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1476/2819] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:51.309752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.359071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.compute.server_groups [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Querying cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) for 1 instances {{(pid=128850) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:01:51.359805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.363231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.363852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.413000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-615dd00e-20de-40da-88fc-8028611cb25d tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.106862 Oct 04 18:01:51.414832 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1344/2820] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:51.426907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.455264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_groups [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Querying cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) for 1 instances {{(pid=128849) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 04 18:01:51.456926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.458013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.460008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.483376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "name": "network-vif-plugged", "status": "completed", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:51.504562 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f532c2b-59a0-438f-aa52-57045745fcf6 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2" status: 200 len: 184 microversion: 2.1 time: 0.079471 Oct 04 18:01:51.505933 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1477/2821] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2 => generated 184 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:51.510003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.516441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.516441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.524248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.526602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.549167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.554045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.554508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.555254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.555738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.556170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.562322 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] Creating event network-vif-plugged:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:01:51.577072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ef701caa-2de5-4f12-bfec-cb4ab1a49b51 req-c29abd7c-6fe3-43fe-be89-165094c6c2ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094179 Oct 04 18:01:51.580350 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1345/2822] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:51.599081 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 HTTP/1.1 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b69e6740-94b8-452a-b0ef-7cd1a92ee5c6'} Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:51.600985 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.605283 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.613150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.614186 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb7d11c0-96e3-4e9a-a252-50c6e0e3da3c tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 404 len: 111 microversion: 2.1 time: 0.100347 Oct 04 18:01:51.614818 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1478/2823] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:01:51 2022] DELETE /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:51.627418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.628578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] [instance: b69e6740-94b8-452a-b0ef-7cd1a92ee5c6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.644927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.645698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.646262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.650106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.650670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.651186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.667406 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 HTTP/1.1 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b69e6740-94b8-452a-b0ef-7cd1a92ee5c6'} Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.669412 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. Oct 04 18:01:51.673727 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.676772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.677934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd41ada2-f008-4b12-a855-652cf021311f tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6" status: 404 len: 111 microversion: 2.1 time: 0.057856 Oct 04 18:01:51.678993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1346/2824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/b69e6740-94b8-452a-b0ef-7cd1a92ee5c6 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:01:51.684674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.685455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.688612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93f547dc-27c4-4090-9df3-c59937ac13e2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.699865 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-93f547dc-27c4-4090-9df3-c59937ac13e2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. Oct 04 18:01:51.700064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.700585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.701040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.701776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.707179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.707807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93f547dc-27c4-4090-9df3-c59937ac13e2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-server-groups/d60e3099-35cf-4186-b038-a61a5d098a94 HTTP/1.1 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd60e3099-35cf-4186-b038-a61a5d098a94'} Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.713959 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. Oct 04 18:01:51.721195 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.724893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93f547dc-27c4-4090-9df3-c59937ac13e2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance group d60e3099-35cf-4186-b038-a61a5d098a94 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.727877 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-93f547dc-27c4-4090-9df3-c59937ac13e2 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/d60e3099-35cf-4186-b038-a61a5d098a94" status: 404 len: 117 microversion: 2.1 time: 0.044688 Oct 04 18:01:51.730973 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1347/2825] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:51 2022] DELETE /compute/v2.1/os-server-groups/d60e3099-35cf-4186-b038-a61a5d098a94 => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:51.744838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e4915c6-e638-48eb-8419-5a7e46a7ef4e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.765167 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1e4915c6-e638-48eb-8419-5a7e46a7ef4e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e4915c6-e638-48eb-8419-5a7e46a7ef4e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-server-groups/d91a509b-1e72-4200-834d-cb2a987114b5 HTTP/1.1 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd91a509b-1e72-4200-834d-cb2a987114b5'} Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.770116 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. Oct 04 18:01:51.775721 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.776505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e4915c6-e638-48eb-8419-5a7e46a7ef4e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance group d91a509b-1e72-4200-834d-cb2a987114b5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.779003 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e4915c6-e638-48eb-8419-5a7e46a7ef4e tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/d91a509b-1e72-4200-834d-cb2a987114b5" status: 404 len: 117 microversion: 2.1 time: 0.043018 Oct 04 18:01:51.784331 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1348/2826] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:51 2022] DELETE /compute/v2.1/os-server-groups/d91a509b-1e72-4200-834d-cb2a987114b5 => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:51.795975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efd28b9a-8a94-47a1-ae8b-6ad1e12858db tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.813038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-efd28b9a-8a94-47a1-ae8b-6ad1e12858db tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efd28b9a-8a94-47a1-ae8b-6ad1e12858db tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-server-groups/77a43cda-0703-4016-9a01-20980f244853 HTTP/1.1 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '77a43cda-0703-4016-9a01-20980f244853'} Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.817821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:01:51.821821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efd28b9a-8a94-47a1-ae8b-6ad1e12858db tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance group 77a43cda-0703-4016-9a01-20980f244853 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:51.822343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efd28b9a-8a94-47a1-ae8b-6ad1e12858db tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/77a43cda-0703-4016-9a01-20980f244853" status: 404 len: 117 microversion: 2.1 time: 0.035730 Oct 04 18:01:51.825974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1349/2827] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:51 2022] DELETE /compute/v2.1/os-server-groups/77a43cda-0703-4016-9a01-20980f244853 => generated 117 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:51.840886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:51.842296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:51.868930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.869438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.869926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:51.870630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:51.871252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:51.871902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.095096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.122849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.145504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.155252 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed15a180-f791-474b-a2c9-ffbe9e74b41d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1441 microversion: 2.25 time: 0.474758 Oct 04 18:01:52.165010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1479/2828] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1441 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:52.174454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b021670-ff67-4a1b-aafa-8bf0ec5b2022 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.224774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3b021670-ff67-4a1b-aafa-8bf0ec5b2022 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] HTTP exception thrown: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b021670-ff67-4a1b-aafa-8bf0ec5b2022 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Request method failure captured: Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-server-groups/c0fabf0e-7b21-4234-8746-70e771153053 HTTP/1.1 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTlI5XHXWYlb_JOSKfwE0mRELfLan49E4ao-iUPZaIILABHoXpliPs8SBM9vqkgVCriHeszXHM4Lz-JC3k-sVgc24EfpPKksTC8gXsDEjAHLvQzGrY0F8P0FbV-gXFpbQLSvJdA_UKTkmd7tiSf5KzIAj3riXea-E2ad6g3nXbQFsI Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_68095bebfcd140b7a7fbd4dd4952f617"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 68095bebfcd140b7a7fbd4dd4952f617 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerGroupTestJSON-103678267 Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 9a529c28705c442ab6c3cce59e1cac1f Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerGroupTestJSON-103678267-project Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c0fabf0e-7b21-4234-8746-70e771153053'} Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:52.238333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:01:52.243620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b021670-ff67-4a1b-aafa-8bf0ec5b2022 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Returning 404 to user: Instance group c0fabf0e-7b21-4234-8746-70e771153053 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:01:52.247090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b021670-ff67-4a1b-aafa-8bf0ec5b2022 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/c0fabf0e-7b21-4234-8746-70e771153053" status: 404 len: 117 microversion: 2.1 time: 0.076852 Oct 04 18:01:52.250506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1480/2829] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:52 2022] DELETE /compute/v2.1/os-server-groups/c0fabf0e-7b21-4234-8746-70e771153053 => generated 117 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:01:52.278526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb690201-1c8d-482b-97c4-7cb4d55ce575", "name": "network-vif-deleted", "tag": "d3772592-0a4c-44be-9433-4dec3335ee85"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:52.321132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.323330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.324130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.353021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] Creating event network-vif-deleted:d3772592-0a4c-44be-9433-4dec3335ee85 for instance fb690201-1c8d-482b-97c4-7cb4d55ce575 on n-h1-831194-21 Oct 04 18:01:52.367685 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7d7a4589-5447-4c5d-8767-68cc7a2cae13 req-80dd34bf-17ec-445f-a357-7f434f9a2ec9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114646 Oct 04 18:01:52.370169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1481/2830] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:52.384923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.385822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:52.401567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.404476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.405142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.406223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:52.408245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:52.408938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:52.499396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:52.515881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0fc559f-8693-4356-8edb-e2d8122e2572 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1320 microversion: 2.1 time: 0.687040 Oct 04 18:01:52.518683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1350/2831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:51 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1320 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:52.539780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e3c5ea0-9b1e-44f1-95d5-cf86a2983894 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:52.614381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e3c5ea0-9b1e-44f1-95d5-cf86a2983894 tempest-ServerGroupTestJSON-103678267 tempest-ServerGroupTestJSON-103678267-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2" status: 204 len: 0 microversion: 2.1 time: 0.094212 Oct 04 18:01:52.614994 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1351/2832] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:01:52 2022] DELETE /compute/v2.1/os-server-groups/3199a66a-9784-472a-a7fc-ff4c07676bc2 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:01:53.194467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:53.195113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:53.213279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.218170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.220217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.221166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.221961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.222616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.283365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.293157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.300579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.310007 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f41499e8-953b-4bc9-8e53-1665eb810118 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 0.930536 Oct 04 18:01:53.314178 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1482/2833] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:52 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:53.397615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.420725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.428231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:53.440537 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50851601-33f8-474a-9c0c-6f78e2efa5a6 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.240727 Oct 04 18:01:53.441565 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1352/2834] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:53 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:53.545106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:53.545739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:53.559815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.561747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.564123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:53.567724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:53.572179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:53.572932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.340594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.341217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.360932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.363821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.365068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.370070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.375256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.376020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.588394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.611414 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96623df4-f034-4c24-bf31-e205732628ca tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1514 microversion: 2.1 time: 1.067114 Oct 04 18:01:54.613297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1483/2835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:53 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1514 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:54.626261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:54.633918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.656248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.657261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.658578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.662520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.663295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.664623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.901291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.916584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.921206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:54.924023 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-355ae717-86a0-4452-85a0-dc6ce4ed35a4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.308596 Oct 04 18:01:54.926026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1484/2836] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:54.946401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:54.955293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:54.970520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.974048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.974831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:54.979020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:54.979894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:54.980600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.040226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lazy-loading 'flavor' on Instance uuid 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:01:55.223155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d07d221c-4e47-4731-9a3a-d3f03d23d68c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action" status: 200 len: 32 microversion: 2.1 time: 0.294274 Oct 04 18:01:55.226307 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1485/2837] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:01:54 2022] POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action => generated 32 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:01:55.245136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.246150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:55.279676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.282530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.283218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.285459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.286885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.288944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.346619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:01:55.607642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.628058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.630587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:55.632285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1040fc53-7a32-4060-b951-0057d57da33e tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 1.296284 Oct 04 18:01:55.633521 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1353/2838] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:54 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:01:55.956974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:55.958067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:55.979129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.980107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.981666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:55.984609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:55.988149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:55.988900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:56.227977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:56.248881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:56.250771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:56.251963 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7659ce73-0e39-47ca-9117-410056a4f20a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.301085 Oct 04 18:01:56.258489 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1354/2839] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:56.376001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:56.386851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c72eb5ef-490c-447d-900d-a1c93eb3d76b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.147485 Oct 04 18:01:56.387849 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1486/2840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:55 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:56.664618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:56.665322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:56.691786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.692297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.702758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:56.704274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:56.704771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:56.705212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.285714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.286751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:57.304688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.305477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.306205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.309392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.310468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.311789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.606849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.616858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.626405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.628899 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a940685-1e47-4e4e-b5ca-9db829eee141 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.349390 Oct 04 18:01:57.630816 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1487/2841] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:57.647348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:57.648373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:57.659834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.669557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.677798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:57.683353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.684288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.684951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.685959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:57.686618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:57.688482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:57.690068 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-532175be-fbf4-4215-b81e-98860744d435 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 1.029631 Oct 04 18:01:57.690819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1355/2842] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:56 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:58.109008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d1c502-6ac8-478c-b771-d1e50a55acd0", "name": "network-vif-plugged", "status": "completed", "tag": "01a5a499-faf7-46cb-84be-091fe776ef90"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:01:58.143962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.146908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.149775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.190538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] Creating event network-vif-plugged:01a5a499-faf7-46cb-84be-091fe776ef90 for instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 on n-h2-831194-21 Oct 04 18:01:58.212571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3f36147c-89bc-44d1-8f08-e9dedd270c0b req-d2f2d858-27e9-4530-ac81-78b3c741451c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107738 Oct 04 18:01:58.213210 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1356/2843] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:01:58.632394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:58.641188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b6d41fe-a484-4de2-ba91-2815f08c245c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.002004 Oct 04 18:01:58.644780 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1488/2844] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:57 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:01:58.669298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.670449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.683432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.686932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.689109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.690346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.694398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.695048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.721724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:58.722681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:58.734189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.739230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.741363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:58.742335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:58.744388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:58.745023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.139055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.156293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.157990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.176461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74bcf643-b7cc-451b-9ffe-a3fefc5a096a tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.514454 Oct 04 18:01:59.180688 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1357/2845] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:58 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:59.425449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.455861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.457463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:01:59.458651 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dcc766dd-ac2d-4016-a597-6ae055f0a973 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1359 microversion: 2.21 time: 0.741609 Oct 04 18:01:59.473799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1489/2846] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:01:58 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1359 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:01:59.680320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:01:59.681569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:01:59.695166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.695956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.696739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.697868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:01:59.700686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:01:59.701313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:01:59.752964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:00.206577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:00.210523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:00.231617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.252014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.253609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.256287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.258717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.259364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.603514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.613100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.627924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:00.629249 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fcaabba-9d0d-45f5-8fea-6f7d87c5c2b7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.426743 Oct 04 18:02:00.634519 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1490/2847] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:00 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:00.639601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:00.646963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:00.670451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.671426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.672046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:00.672941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:00.680288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:00.680975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.137802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.147640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.161549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.162955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5d95c6f-b3cc-4bc6-9e0e-93d49c94a3d9 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1552 microversion: 2.21 time: 0.527227 Oct 04 18:02:01.164103 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1491/2848] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:00 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1552 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:01.197094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.198790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.211616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.212913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.213544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.214788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.215404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.216033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.276628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:01.420884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5840ce4-bbcb-46c3-9166-7e00b6a84077 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 204 len: 0 microversion: 2.21 time: 0.230602 Oct 04 18:02:01.422475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1492/2849] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:02:01 2022] DELETE /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:02:01.431144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.431856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.445457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.445986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.446737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.447622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.448239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.448829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.599847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:01.610359 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06068101-7d44-497a-afeb-1d3aa7731341 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.934726 Oct 04 18:02:01.611219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1358/2850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:01:59 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:01.663055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:01.664047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:01.681013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.683658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.684637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:01.687313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:01.689173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:01.689650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.109138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.113739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.115642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.127660 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-20e58cad-a68d-4dee-92ea-a0ceecc3a265 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 200 len: 1265 microversion: 2.25 time: 0.468405 Oct 04 18:02:02.128130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1359/2851] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 1265 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:02.376547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.398463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.401777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:02.406447 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9653440-9197-4226-81e6-09461f8f751d tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1558 microversion: 2.21 time: 0.978493 Oct 04 18:02:02.435813 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1493/2852] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:01 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1558 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:02.638116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:02.639829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:02.652302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.654420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.655067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:02.657527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:02.660203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:02.660900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.154747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.155361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: fb690201-1c8d-482b-97c4-7cb4d55ce575] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.176514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.189205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.205038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.209020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.209524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.209993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.285159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] HTTP exception thrown: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Request method failure captured: Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 HTTP/1.1 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHNYptV5OOOWRgHHMqeQFyPPsiXiMYi1Rf15sogG2lZFgWA6kf8twyZLrHm6fWfsZGe5siTK0uQ7KqlU8QAeaaiw5NNN9dEJ8szLsqKZqfVqzOOmuWWkrIOmM4yC1S74TMHl8vztgj4v_3aj6MnwGy5v7z79LBOh2jY_O1mW11z7jKY Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 606a8a3f1311407498ad45ed8d78e558 Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'fb690201-1c8d-482b-97c4-7cb4d55ce575'} Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. Oct 04 18:02:03.286912 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:03.291156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Returning 404 to user: Instance fb690201-1c8d-482b-97c4-7cb4d55ce575 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:03.301801 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a0d5b07-fa00-45ce-8106-0c5ad6515ce3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575" status: 404 len: 111 microversion: 2.25 time: 0.147640 Oct 04 18:02:03.302628 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1494/2853] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/fb690201-1c8d-482b-97c4-7cb4d55ce575 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:02:03.440688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:03.442169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:03.461588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.462169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.462566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:03.466812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:03.474254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:03.474865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:04.895751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:04.916991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:04.922236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:04.923480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae6cd671-7802-4c3c-b8e9-c6d358de6100 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1558 microversion: 2.21 time: 1.487835 Oct 04 18:02:04.948789 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1495/2854] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:03 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1558 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:05.006671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:05.015051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5368f297-a181-4765-b941-8168a8130a28 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 2.380675 Oct 04 18:02:05.044170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1360/2855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:02 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 2410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:05.962652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:05.963280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:05.982006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.988549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.989478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:05.993860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:05.994601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:05.996445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.052667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:06.053313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:06.070449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.071568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.072666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.073622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:06.086429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:06.087218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:06.810541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.823924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.830845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:06.835839 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3ee7d10-3b55-42b7-892a-4f36bedfeb9b tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1558 microversion: 2.21 time: 0.881671 Oct 04 18:02:06.848693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1496/2856] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:05 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1558 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:07.068515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d1c502-6ac8-478c-b771-d1e50a55acd0", "name": "network-vif-deleted", "tag": "01a5a499-faf7-46cb-84be-091fe776ef90"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:07.115688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.118427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.119042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.163981 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] Creating event network-vif-deleted:01a5a499-faf7-46cb-84be-091fe776ef90 for instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 on n-h2-831194-21 Oct 04 18:02:07.174763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1413165f-8d49-450f-b7cb-704cf35a7631 req-a13785c0-718c-434b-867c-ef905d1116e2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110819 Oct 04 18:02:07.207336 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1497/2857] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:02:07.378877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:07.395633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a05bb90-7781-43d0-a328-c6e7470a5603 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.347489 Oct 04 18:02:07.400231 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1361/2858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:06 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:07.865328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:07.866366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:07.883984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.884497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.884938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.885686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.886322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.886748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.960096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:07.960604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:07.961057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:07.961521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lazy-loading 'fault' on Instance uuid c2d1c502-6ac8-478c-b771-d1e50a55acd0 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:08.032207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:08.048560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:08.049625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '76e224d616cd49508d58a539c9b0c89b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '770cd5273a08415b9483abdf3b51d609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:08.056222 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e73d75f2-d509-4114-bcca-e81b7eb08967 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 200 len: 1349 microversion: 2.21 time: 0.195306 Oct 04 18:02:08.067209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1498/2859] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:07 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 1349 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:08.421320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:08.422105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:08.430729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.431235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.431678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:08.432391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:08.432852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:08.433287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.093031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:09.093644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:09.107710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.108216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.108660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.109374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.109871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.110286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.542882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:09.552837 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c1c9e15-a134-454c-bfd6-8735d60f986a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.135376 Oct 04 18:02:09.556309 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1362/2860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:08 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:09.766114 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] HTTP exception thrown: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Request method failure captured: Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 HTTP/1.1 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHT_aU0q256NElcMxNBIdC-dLjHX0CDlfVYcpuCVwpUkqklp9T7m5_LdkTLr3mpAFz8fBa7LEX9G3gmAVS6XVrglqoqItarPFPnRjWEVAeEh1S3fx_dAVp2ZDzCNrbX9z7MyuugNO1QsbM1pIMdeWqf27Uf2no6m52Pv1VnnPOQMu8w Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_770cd5273a08415b9483abdf3b51d609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 76e224d616cd49508d58a539c9b0c89b Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c2d1c502-6ac8-478c-b771-d1e50a55acd0'} Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:09.779251 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:09.784385 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:09.795437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Returning 404 to user: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:09.796620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5e4757a-0416-4215-86fd-1262dd9335d7 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 404 len: 111 microversion: 2.21 time: 0.707645 Oct 04 18:02:09.797700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1499/2861] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:09 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 111 bytes in 709 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:09.807684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '.version_select at 0x7fbdc1d4f4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:09.808424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:09.819723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:09.827553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.830154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.831284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:09.837996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:09.843076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:09.843674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.137328 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f7cbfd8-25e7-496b-8655-a30ca32cd3e0 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.334626 Oct 04 18:02:10.146814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1363/2862] 10.222.0.42 () {60 vars in 1337 bytes} [Tue Oct 4 18:02:09 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0/os-instance-actions => generated 611 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:02:10.154200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.157058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.168271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.171279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.172489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.176290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.177024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.177700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.213221 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] HTTP exception thrown: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Request method failure captured: Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 HTTP/1.1 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHT_aU0q256NElcMxNBIdC-dLjHX0CDlfVYcpuCVwpUkqklp9T7m5_LdkTLr3mpAFz8fBa7LEX9G3gmAVS6XVrglqoqItarPFPnRjWEVAeEh1S3fx_dAVp2ZDzCNrbX9z7MyuugNO1QsbM1pIMdeWqf27Uf2no6m52Pv1VnnPOQMu8w Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_770cd5273a08415b9483abdf3b51d609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 76e224d616cd49508d58a539c9b0c89b Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c2d1c502-6ac8-478c-b771-d1e50a55acd0'} Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:10.230412 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.234598 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.237525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Returning 404 to user: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:10.241004 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aadffdde-8c55-4770-b36b-c156b71effd5 tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 404 len: 111 microversion: 2.21 time: 0.091306 Oct 04 18:02:10.242205 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1500/2863] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:02:10 2022] DELETE /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:10.251239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.262801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] [instance: c2d1c502-6ac8-478c-b771-d1e50a55acd0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.274117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.275265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.275966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.276923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.277601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.278303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.297629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] HTTP exception thrown: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Request method failure captured: Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 HTTP/1.1 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHT_aU0q256NElcMxNBIdC-dLjHX0CDlfVYcpuCVwpUkqklp9T7m5_LdkTLr3mpAFz8fBa7LEX9G3gmAVS6XVrglqoqItarPFPnRjWEVAeEh1S3fx_dAVp2ZDzCNrbX9z7MyuugNO1QsbM1pIMdeWqf27Uf2no6m52Pv1VnnPOQMu8w Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.21 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/770cd5273a08415b9483abdf3b51d609"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_770cd5273a08415b9483abdf3b51d609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 770cd5273a08415b9483abdf3b51d609 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1823055886 Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 76e224d616cd49508d58a539c9b0c89b Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-InstanceActionsV221TestJSON-1823055886-project Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c2d1c502-6ac8-478c-b771-d1e50a55acd0'} Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.300316 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. Oct 04 18:02:10.304441 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:10.306473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] Returning 404 to user: Instance c2d1c502-6ac8-478c-b771-d1e50a55acd0 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:10.307595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cbcf84c-c1fa-44da-ac02-cf119c41de9f tempest-InstanceActionsV221TestJSON-1823055886 tempest-InstanceActionsV221TestJSON-1823055886-project] 10.222.0.42 "GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0" status: 404 len: 111 microversion: 2.21 time: 0.061539 Oct 04 18:02:10.311959 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1364/2864] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:10 2022] GET /compute/v2.1/servers/c2d1c502-6ac8-478c-b771-d1e50a55acd0 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:10.580126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:10.581555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:10.596227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.596629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.602262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:10.605808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:10.606580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:10.607967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:11.495483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:11.512395 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10655fba-a4c7-45c3-996a-6a17274d204a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 0.936059 Oct 04 18:02:11.514302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1501/2865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:10 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:12.448474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.449019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.475617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.479482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.480981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.487201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.488143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.491816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.542396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.543739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.557246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.558069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.558676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.559633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.566592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.567339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.614970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:12.930626 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35cf586f-f2eb-49ec-87e8-e13633c34ac4 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 204 len: 0 microversion: 2.25 time: 0.482755 Oct 04 18:02:12.932238 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1365/2866] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:02:12 2022] DELETE /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:02:12.952196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:12.957121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:12.977781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.983751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.984217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:12.984968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:12.985444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:12.985888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:13.631797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.646791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.656678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.659583 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1bbad4c5-0464-47e5-967d-4882eb75f82d tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1733 microversion: 2.25 time: 0.722363 Oct 04 18:02:13.664184 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1366/2867] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1733 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:13.829791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:13.847256 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ba79f732-ddf5-4808-a276-2fc9a8f5d74c tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.308588 Oct 04 18:02:13.847840 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1502/2868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:12 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:14.772792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.774334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.786500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.788252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.788942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.790099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.791237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.791909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.891042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:14.894615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:14.904594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:14.909535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.910380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.911040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:14.911988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:14.912658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:14.913292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:15.530421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.538826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:15.546653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80d13ddc-6140-4c5f-af80-6213f132a2bf tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 0.677054 Oct 04 18:02:15.548691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1503/2869] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:15.810445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.831159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.834185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:15.837482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-899a2ea5-e0ab-460d-9121-3feafbbc0a70 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1733 microversion: 2.25 time: 1.080261 Oct 04 18:02:15.838864 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1367/2870] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:14 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1733 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:16.576493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.577715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.594556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.594978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.595615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.598323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.600363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.601003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.866185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:16.867459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:16.880282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.885478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.886268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:16.887232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:16.887901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:16.890433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:17.365457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.388575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.390347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:17.395587 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5917e02-827a-44f6-8558-aa99f1c171ab tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1665 microversion: 2.25 time: 0.530791 Oct 04 18:02:17.415790 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1368/2871] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1665 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:18.428948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:18.429770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:18.436945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.443857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.447022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.450141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.454965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.455995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.632347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.646186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.671429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:18.672841 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e679af5-06ca-4d3a-aabe-9400a9c5379b tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1665 microversion: 2.25 time: 0.247850 Oct 04 18:02:18.681222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1369/2872] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:18 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1665 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:18.793316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c226ccab-1166-407f-8771-ba15586f8216", "name": "network-vif-deleted", "tag": "d529fcb6-1211-4abb-9e53-83539319a026"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:18.825125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:18.829845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:18.832774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:18.883229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] Creating event network-vif-deleted:d529fcb6-1211-4abb-9e53-83539319a026 for instance c226ccab-1166-407f-8771-ba15586f8216 on n-h2-831194-21 Oct 04 18:02:18.921540 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c4877191-4d99-4802-8ed6-0b5dec0da79e req-1ca813f5-b386-4022-ba1a-9007d276be11 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126673 Oct 04 18:02:18.922812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1370/2873] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:19.006039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:19.016393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dfe3a796-7720-48c9-88e5-48c832f9b912 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 2.450229 Oct 04 18:02:19.023533 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1504/2874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:16 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 2458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:19.728691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:19.730178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:19.748992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.750634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.751119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.752376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.755795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.756282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.853453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:19.854011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:19.855282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:19.858831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lazy-loading 'fault' on Instance uuid c226ccab-1166-407f-8771-ba15586f8216 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:20.050050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:20.051265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:20.071200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.072018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.072712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.073738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:20.074532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:20.075236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:20.175147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.190898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.194780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:20.197681 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a2b62e7b-5eea-46e1-8eb1-c3792c42ecb3 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 200 len: 1375 microversion: 2.25 time: 0.488427 Oct 04 18:02:20.216569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1371/2875] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:19 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 1375 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:21.230947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.231668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: c226ccab-1166-407f-8771-ba15586f8216] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:21.241854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.244572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.247981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.249246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:21.253267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:21.259458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:21.314511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] HTTP exception thrown: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Request method failure captured: Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 HTTP/1.1 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHNYptV5OOOWRgHHMqeQFyPPsiXiMYi1Rf15sogG2lZFgWA6kf8twyZLrHm6fWfsZGe5siTK0uQ7KqlU8QAeaaiw5NNN9dEJ8szLsqKZqfVqzOOmuWWkrIOmM4yC1S74TMHl8vztgj4v_3aj6MnwGy5v7z79LBOh2jY_O1mW11z7jKY Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 606a8a3f1311407498ad45ed8d78e558 Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c226ccab-1166-407f-8771-ba15586f8216'} Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. Oct 04 18:02:21.319293 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Returning 404 to user: Instance c226ccab-1166-407f-8771-ba15586f8216 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:21.325001 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6752560-b186-4ec7-b235-6a34bc36c0f1 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216" status: 404 len: 111 microversion: 2.25 time: 0.098089 Oct 04 18:02:21.334250 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1372/2876] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:21 2022] GET /compute/v2.1/servers/c226ccab-1166-407f-8771-ba15586f8216 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:21.348817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4d408ba-c387-4404-a019-44718f564baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '.version_select at 0x7fbdc1c58f70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:21.425064 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4d408ba-c387-4404-a019-44718f564baf tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-338829499" status: 204 len: 0 microversion: 2.25 time: 0.087578 Oct 04 18:02:21.425668 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1373/2877] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 18:02:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-338829499 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:02:21.497289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:21.510673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d64c00bb-e5b4-4e6f-9250-ce90c80c669b tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.466645 Oct 04 18:02:21.515217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1505/2878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:20 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:22.536525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:22.537397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:22.549914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:22.551058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:22.557819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.562842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:22.563993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:22.565229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:22.988361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-618caf85-36f7-4c1a-bbb6-ce7678e79925 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Action: 'create', calling method: .version_select at 0x7fbdc1cdc550>, body: {"keypair": {"name": "tempest-keypair-738137624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIHbm/+eA4s0x8PjZGfFD0s8r8gklaiIRxjd4cAX7IHQbwAfBvHIpUBfSGOT3WB7ymbcF8lq8tig6gnzyZ9MwmOci0DaWxgx8jV5cUD8UcZY3KGKY/bQgpyFxN4gCcm74Q=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:23.031107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-618caf85-36f7-4c1a-bbb6-ce7678e79925 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Getting quotas for project 9df5d1f7410c469d900ada1ba30419df. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:23.044886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-618caf85-36f7-4c1a-bbb6-ce7678e79925 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Getting quotas for user 6c75c3c7449f4d95a28773bf57343f2d and project 9df5d1f7410c469d900ada1ba30419df. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:23.140475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-618caf85-36f7-4c1a-bbb6-ce7678e79925 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.164682 Oct 04 18:02:23.142152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1506/2879] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 18:02:22 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:02:23.723744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:23.757823 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-458a5ef6-55a7-49b4-81a1-c7bea4766cd9 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.223546 Oct 04 18:02:23.770189 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1374/2880] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:22 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:24.272318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:24.273202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.289198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.290603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.291158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.294374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.295263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.296651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.336991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:24.456399 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8863c4de-e038-473f-93bb-a003ef036280 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 204 len: 0 microversion: 2.25 time: 0.188223 Oct 04 18:02:24.457594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1507/2881] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:02:24 2022] DELETE /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:02:24.466922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:24.468254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.477631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.478493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.480112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.481403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.482096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.482710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.711922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:24.749333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:24.755325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:24.762520 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-163c2b9e-45f7-4150-9d7f-844b57263feb tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1548 microversion: 2.25 time: 0.300673 Oct 04 18:02:24.779816 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1375/2882] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:24 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1548 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:24.793354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:24.796735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:24.813341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.815182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.815950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:24.817782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:24.818516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:24.819246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.802316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:25.802943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:25.831362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.831994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.834515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.837981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:25.838618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:25.839159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:25.862456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:26.050501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.061858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.072855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.074691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d8b8e5c-ec04-4891-a024-96f90df363cd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 200 len: 1506 microversion: 2.25 time: 0.277843 Oct 04 18:02:26.076387 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1376/2883] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:25 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:26.088705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b2f0c9c-dbce-4c4d-bc66-be240ab6553a", "name": "network-vif-deleted", "tag": "d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:26.119840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:26.120323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:26.121019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:26.137706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] Creating event network-vif-deleted:d5eb9bb7-25af-42b0-b9e0-5cff27c7a04c for instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a on n-h1-831194-21 Oct 04 18:02:26.143891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7668fd5c-d4e3-4e11-a119-64e0d1af11b1 req-62d75c54-0a63-45e5-a65e-9027f8436205 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064280 Oct 04 18:02:26.144862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1377/2884] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:26.608305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:26.637733 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c6623e0-1259-4c37-9e6b-1a73c52501c2 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1520 microversion: 2.1 time: 1.845632 Oct 04 18:02:26.640245 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1508/2885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:24 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1520 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:27.106630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.108448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.131106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.131530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.132377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.133524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.138821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.146518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.177053 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] HTTP exception thrown: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Request method failure captured: Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a HTTP/1.1 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHNYptV5OOOWRgHHMqeQFyPPsiXiMYi1Rf15sogG2lZFgWA6kf8twyZLrHm6fWfsZGe5siTK0uQ7KqlU8QAeaaiw5NNN9dEJ8szLsqKZqfVqzOOmuWWkrIOmM4yC1S74TMHl8vztgj4v_3aj6MnwGy5v7z79LBOh2jY_O1mW11z7jKY Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 606a8a3f1311407498ad45ed8d78e558 Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5b2f0c9c-dbce-4c4d-bc66-be240ab6553a'} Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. Oct 04 18:02:27.179870 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. Oct 04 18:02:27.186950 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:27.190463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Returning 404 to user: Instance 5b2f0c9c-dbce-4c4d-bc66-be240ab6553a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:27.193773 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-345fb4c8-e5c2-40be-aa03-4fd891b7e3d7 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a" status: 404 len: 111 microversion: 2.25 time: 0.090389 Oct 04 18:02:27.201081 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1378/2886] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:27 2022] GET /compute/v2.1/servers/5b2f0c9c-dbce-4c4d-bc66-be240ab6553a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:02:27.206217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.206754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.222093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.222615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.223056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.223769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.224222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.224649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.278206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:02:27.440537 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-803c89b2-cc36-4e3f-b30b-6546a0fdb07e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 204 len: 0 microversion: 2.25 time: 0.237027 Oct 04 18:02:27.453115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.453876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.457217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1509/2887] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:02:27 2022] DELETE /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:02:27.462836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.463644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.464407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.465420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.467136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.468572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.675309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:27.677067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:27.695780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.696415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.697756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.699926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:27.703341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:27.706426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:27.964818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:27.989460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:27.992269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:27.994189 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c805dc9-b095-48ed-8546-18293820ecae tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1565 microversion: 2.25 time: 0.546813 Oct 04 18:02:28.015949 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1379/2888] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:27 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1565 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:28.303971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:28.320705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2f8c6d5-f346-4140-bde3-86f47cf1df74 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1500 microversion: 2.1 time: 0.651238 Oct 04 18:02:28.321627 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1510/2889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:27 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1500 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:28.351033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db6a3907-9067-44fa-a98d-0ee0fb7f1a1f tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'create', calling method: .version_select at 0x7fbdc1cdd1f0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-414245045", "description": "tempest-description-1477392198"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:29.023019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:29.023635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:29.038240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.038823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.039275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.040019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.040476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.040901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.688363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:29.709992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:29.712712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:29.715285 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c597d666-7993-4122-8f2f-fe32c4e35b2e tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1565 microversion: 2.25 time: 0.695244 Oct 04 18:02:29.718161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1511/2890] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:29 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1565 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:29.800863 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db6a3907-9067-44fa-a98d-0ee0fb7f1a1f tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 1.454779 Oct 04 18:02:29.802936 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1380/2891] 10.222.0.42 () {60 vars in 1180 bytes} [Tue Oct 4 18:02:28 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:29.817713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-414245045"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:29.818571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:29.824961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.825898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.826580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:29.827616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:29.828507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:29.829151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.194779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Adding security group 07f1b1a0-7878-4c6a-8b96-cf7f8079909e to port 11e29b11-7f68-4a34-82d9-34e562ac678f Oct 04 18:02:30.747438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:30.748303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:30.758268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.759012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.759650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:30.760535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:30.761156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:30.761749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.070227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:31.099128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:31.105546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:31.110651 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f0c6206-da55-4e0a-aefa-6704c4bb6651 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1523 microversion: 2.25 time: 0.364928 Oct 04 18:02:31.112649 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1381/2892] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:30 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1523 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:02:31.125611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2675c593-64c2-4f3f-afe2-95c16acfd0a0", "name": "network-vif-deleted", "tag": "300ba45e-98fd-4b51-afc8-87c09c85ed51"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:31.184439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:31.185146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:31.188265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:31.240353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] Creating event network-vif-deleted:300ba45e-98fd-4b51-afc8-87c09c85ed51 for instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 on n-h2-831194-21 Oct 04 18:02:31.261769 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4881db25-0695-4f61-b41a-89bb58b95546 req-c69dd92b-fa0c-4f18-9ba8-679bf1bb27ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147605 Oct 04 18:02:31.266066 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1382/2893] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:32.145494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:32.146362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:32.171135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.179236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.180222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.183577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.184493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.185221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.227498 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b2d99e1-d8fc-45d3-a5ed-cdf67b002cc5 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action" status: 202 len: 0 microversion: 2.1 time: 2.370247 Oct 04 18:02:32.235049 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1512/2894] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:29 2022] POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action => generated 0 bytes in 2422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:32.261872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:32.313911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.317346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.321095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.364110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] Creating event network-changed:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:02:32.381964 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dd6f6c46-9eef-4c51-93e8-d0a923b44a75 req-79bfaded-375c-4e9a-894a-fd786df851bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133044 Oct 04 18:02:32.384035 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1513/2895] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:32.391871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-414245045"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:32.401660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:32.451871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.467171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.468975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.471363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.478742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.480203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:32.483779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lazy-loading 'fault' on Instance uuid 2675c593-64c2-4f3f-afe2-95c16acfd0a0 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:02:32.490330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:32.494624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:32.495183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:33.060764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:33.580978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Removing security group 07f1b1a0-7878-4c6a-8b96-cf7f8079909e from port 11e29b11-7f68-4a34-82d9-34e562ac678f Oct 04 18:02:33.651376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:33.664619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:33.670154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '606a8a3f1311407498ad45ed8d78e558', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a0ab319603408d99c87a900deb5a0f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:33.677592 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80dacb36-1eda-431d-a125-7f4677c56866 tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 200 len: 1352 microversion: 2.25 time: 1.537804 Oct 04 18:02:33.696632 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1383/2896] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:32 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 1352 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:34.718821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:34.719447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] [instance: 2675c593-64c2-4f3f-afe2-95c16acfd0a0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:34.740992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.746740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.758017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.760648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:34.765042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:34.765850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:34.807263 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] HTTP exception thrown: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Request method failure captured: Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 HTTP/1.1 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHNYptV5OOOWRgHHMqeQFyPPsiXiMYi1Rf15sogG2lZFgWA6kf8twyZLrHm6fWfsZGe5siTK0uQ7KqlU8QAeaaiw5NNN9dEJ8szLsqKZqfVqzOOmuWWkrIOmM4yC1S74TMHl8vztgj4v_3aj6MnwGy5v7z79LBOh2jY_O1mW11z7jKY Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.25 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b9a0ab319603408d99c87a900deb5a0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b9a0ab319603408d99c87a900deb5a0f Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-470108936 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 606a8a3f1311407498ad45ed8d78e558 Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-470108936-project Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2675c593-64c2-4f3f-afe2-95c16acfd0a0'} Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. Oct 04 18:02:34.812702 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. Oct 04 18:02:34.819132 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:02:34.823844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] Returning 404 to user: Instance 2675c593-64c2-4f3f-afe2-95c16acfd0a0 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:02:34.827431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b4183ba-79e7-4f43-8c7a-80915cda9bbd tempest-LiveAutoBlockMigrationV225Test-470108936 tempest-LiveAutoBlockMigrationV225Test-470108936-project] 10.222.0.42 "GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0" status: 404 len: 111 microversion: 2.25 time: 0.115438 Oct 04 18:02:34.837594 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1384/2897] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:34 2022] GET /compute/v2.1/servers/2675c593-64c2-4f3f-afe2-95c16acfd0a0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:02:35.031612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1937195736", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "ee276894-f993-4785-9ea0-b1e28debd1ce"}, {"port": "4cac5198-8159-48df-b2c3-dfd5f86feace", "tag": "port-1"}, {"port": "92dfa124-5ad1-4328-b6e5-27dcb4998361", "tag": "port-2"}, {"uuid": "fd519904-aad2-43de-b24a-1e6ec5974f38", "tag": "net-1"}, {"uuid": "fd519904-aad2-43de-b24a-1e6ec5974f38"}, {"uuid": "d62a3994-61a0-412f-a387-203085fd25a4", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d62a3994-61a0-412f-a387-203085fd25a4", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "26d2a11a-46f6-48bb-a333-46c87d3a9f6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "d5b46289-0822-4b7a-b81f-0c23bbb2b088", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5e637eae-5a5e-4e36-aeeb-88037f688570", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1876870105"}], "key_name": "tempest-keypair-738137624", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:36.169301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] validate_networks() for [('ee276894-f993-4785-9ea0-b1e28debd1ce', None, None, None, None, None), (None, None, '4cac5198-8159-48df-b2c3-dfd5f86feace', None, None, None), (None, None, '92dfa124-5ad1-4328-b6e5-27dcb4998361', None, None, None), ('fd519904-aad2-43de-b24a-1e6ec5974f38', None, None, None, None, None), ('fd519904-aad2-43de-b24a-1e6ec5974f38', None, None, None, None, None), ('d62a3994-61a0-412f-a387-203085fd25a4', '10.2.2.100', None, None, None, None), ('d62a3994-61a0-412f-a387-203085fd25a4', '10.2.2.200', None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:36.761225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ca0dc5d-776f-4cc0-85b6-b3fc29bca692 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action" status: 202 len: 0 microversion: 2.1 time: 4.375256 Oct 04 18:02:36.761877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1514/2898] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:32 2022] POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action => generated 0 bytes in 4377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:02:36.777592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2921265e-917a-48ec-9385-3b25f48aa8f0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'create', calling method: .version_select at 0x7fbdbca52b80>, body: {"pool": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:42.407232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:42.641280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:44.153874 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2921265e-917a-48ec-9385-3b25f48aa8f0 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 7.377046 Oct 04 18:02:44.159595 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1515/2899] 10.222.0.42 () {60 vars in 1170 bytes} [Tue Oct 4 18:02:36 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 7389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:44.162715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:44.200225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:44.203007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:44.203474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:44.237879 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] Creating event network-changed:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:02:44.252146 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7d109207-db8e-4227-a29f-71490eb6ea3c req-29797904-7c46-43b1-9aef-d8452c3710a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093054 Oct 04 18:02:44.253136 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1516/2900] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:44.714681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-646710338", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:44.781249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=33 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:44.842833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:46.506184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:46.524992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:46.526742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:46.527931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:46.529085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:46.543488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.544239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.544838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.550755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.551567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.552747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.639439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:46.648127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:46.677089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:46.689630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:46.895718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f365e71-de8c-4b09-9da6-795110f858ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.637677 Oct 04 18:02:46.896819 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1517/2901] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:46.912773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.5.239"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:46.916328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:46.946811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.947750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.948371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:46.950913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:46.953376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:46.954090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:47.054292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:02:47.054876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquired lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:02:48.700395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:48.700952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:48.702010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:48.703002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:48.703524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:48.719509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:48.733527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.739389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.740335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.742154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:48.743600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:48.745032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:48.807305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Getting quotas for project 9df5d1f7410c469d900ada1ba30419df. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:48.827883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Getting quotas for user 6c75c3c7449f4d95a28773bf57343f2d and project 9df5d1f7410c469d900ada1ba30419df. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:49.180965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:49.185161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='26d2a11a-46f6-48bb-a333-46c87d3a9f6b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='d5b46289-0822-4b7a-b81f-0c23bbb2b088',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e637eae-5a5e-4e36-aeeb-88037f688570',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:49.901629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e8700f5-fd02-4c0a-8177-4cb53c35eb61 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 14.874777 Oct 04 18:02:49.907133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1385/2902] 10.222.0.42 () {62 vars in 1189 bytes} [Tue Oct 4 18:02:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 14881 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:02:49.913341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:49.918693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:49.937597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.938466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.939722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:49.940804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:49.941537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:49.942261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:50.101055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.109337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f592c75f-626d-448c-8904-95a16940c2d7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1250 microversion: 2.1 time: 0.200092 Oct 04 18:02:50.119580 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1386/2903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:49 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1250 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:50.128589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:50.148759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:50.409729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.420587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.422128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:50.428523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3cc6d77-766d-40fd-8576-1e8e8fed0030 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1285 microversion: 2.42 time: 0.302492 Oct 04 18:02:50.429493 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1387/2904] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:50 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1285 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:50.800574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-222608190", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "560e0478-d47c-40d2-bc6f-a31863ba653a"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:50.884648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] validate_networks() for [('560e0478-d47c-40d2-bc6f-a31863ba653a', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:02:52.029085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Building network info cache for instance {{(pid=128849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:02:53.784855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:02:53.785543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:02:53.785877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:02:53.786295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:02:53.786702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:02:53.810157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.811016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.811632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.815423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:53.816147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:53.817481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:53.875807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Getting quotas for project 95ca9284739c4b009d70fdd5e9669bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:02:53.888971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Getting quotas for user 06cc4cee636f499689760ecd7625427b and project 95ca9284739c4b009d70fdd5e9669bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:02:53.931780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Going to run 2 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:02:53.942715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: c702c305-cbc3-4ce6-a7ff-a8761af385e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:54.023330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=c702c305-cbc3-4ce6-a7ff-a8761af385e6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:02:54.199388 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0c06444-6d10-42a3-95a0-b27a294fcfb8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.493059 Oct 04 18:02:54.206261 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1388/2905] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:02:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:02:54.244173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:54.244437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:54.289567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.291569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.292037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:54.292787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:54.293251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:54.293675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.479156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Updating instance_info_cache with network_info: [{"id": "11e29b11-7f68-4a34-82d9-34e562ac678f", "address": "fa:16:3e:e0:08:7f", "network": {"id": "1b23a667-4c94-4de3-83f9-7bb689992e52", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-462583711-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.5.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d2c133b854094d5d82082773a1e8f3f8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap11e29b11-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:02:55.519763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Releasing lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:02:55.527768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-852b8497-aaf6-4cf1-9c7f-de0caa65f037 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action" status: 202 len: 0 microversion: 2.1 time: 8.620235 Oct 04 18:02:55.528530 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1518/2906] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:46 2022] POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action => generated 0 bytes in 8631 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:02:55.560540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:55.561914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:55.598555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.601524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.602221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.604342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.607914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.608594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.820164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:55.858353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:55.861132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:55.865193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-393a32c0-fe7f-450a-8b69-82ae9d4eac0f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1593 microversion: 2.42 time: 0.335588 Oct 04 18:02:55.867385 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1519/2907] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:55 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1593 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:55.875170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:55.908691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:55.910328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:55.910995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:55.955833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] Creating event network-changed:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:02:55.968675 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-42b421f0-21cb-4de3-a52f-3df17f264816 req-add9954a-0623-4e54-b50a-830a4ffecf6a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097497 Oct 04 18:02:55.973346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1520/2908] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:55.992981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.019222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:56.020054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Searching by: {'deleted': False, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:02:56.089021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.090566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.091179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.092297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.092936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.093543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.189773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:02:56.396569 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d16e7d5-4c3d-43f6-8463-8c42941bc9e7 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.346048 Oct 04 18:02:56.419204 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1521/2909] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 18:02:55 2022] GET /compute/v2.1/servers => generated 675 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:02:56.438697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.5.239"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:02:56.669119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:02:56.737910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:56.755672 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c703a849-95c9-4ac0-a144-1cfc63bc9db9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 2.543383 Oct 04 18:02:56.757742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1389/2910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:54 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:56.767581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:56.771295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:56.788390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.789178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.790688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:56.792051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:56.794759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:56.796920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.208123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.216738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.217253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.217705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.218479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.218943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.219382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.786143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:57.805104 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85251d03-268b-43b7-a258-17081495384a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1215 microversion: 2.1 time: 1.037709 Oct 04 18:02:57.806436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1390/2911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:56 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1215 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:02:57.831971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:57.833101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:57.856176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.857012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.857711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:57.858663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:57.859334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:57.866622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.223603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 04 18:02:58.224040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquired lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 04 18:02:58.248449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.266257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.271057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:02:58.272517 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46598606-038f-42a1-b8ef-6410995ab868 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1593 microversion: 2.42 time: 0.464334 Oct 04 18:02:58.278639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1391/2912] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:02:57 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1593 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:02:58.289492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:02:58.290477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:02:58.313072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.319595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.320246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:02:58.321032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:02:58.321519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:02:58.322506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:00.735304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Building network info cache for instance {{(pid=128849) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 04 18:03:02.441074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Updating instance_info_cache with network_info: [{"id": "11e29b11-7f68-4a34-82d9-34e562ac678f", "address": "fa:16:3e:e0:08:7f", "network": {"id": "1b23a667-4c94-4de3-83f9-7bb689992e52", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-462583711-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d2c133b854094d5d82082773a1e8f3f8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap11e29b11-7f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:03:02.463134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Releasing lock "refresh_cache-2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" {{(pid=128849) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 04 18:03:02.468852 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae084be9-2514-4187-9809-cce8f2c8fae3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action" status: 202 len: 0 microversion: 2.1 time: 6.048030 Oct 04 18:03:02.469563 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1522/2913] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:02:56 2022] POST /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e/action => generated 0 bytes in 6050 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 04 18:03:02.496807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.497508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.508525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.521489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.524618 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-857d57cf-2e6a-45fe-9500-c4a57abf0038 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 4.244370 Oct 04 18:03:02.526273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1392/2914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:02:58 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 4247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.541544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.541544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.541544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.541544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.541544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.559097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:02.561412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:02.569565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.570330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.570973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.571926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.572539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.573402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.694351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:02.710626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2cee8c4b-d7c8-4cac-936a-79c93f686335 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1277 microversion: 2.1 time: 0.237844 Oct 04 18:03:02.714463 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1523/2915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:02.728322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:02.763732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:02.764223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:02.764668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:02.806521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] Creating event network-changed:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:03:02.824285 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-db1f0fb4-9ab7-4810-aa82-1ed73f03c415 req-b52cac21-cfa3-43c9-bc40-844da60902d1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106305 Oct 04 18:03:02.824902 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1524/2916] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:02.838468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2891eb8a-1430-423b-80a6-f66bd9a33b6a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '.version_select at 0x7fbdc1d79040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:03.862502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:03.911126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=14 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:05.207000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.226492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.231009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:05.233479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ad94122-87cf-4324-bfca-40df24835df7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1661 microversion: 2.42 time: 2.683736 Oct 04 18:03:05.237111 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1393/2917] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:02 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1661 bytes in 2691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:05.253447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12cd8b77-f723-460f-aa1e-39b5b73dabbd", "tag": "796272b8-f504-4c86-ab3f-995b78e9bfac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:05.279805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.282573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.284247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.313271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] Creating event network-changed:796272b8-f504-4c86-ab3f-995b78e9bfac for instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd on n-h1-831194-21 Oct 04 18:03:05.323848 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-30d021c8-d46a-4d2e-a0d5-b03ec3986d85 req-597c8fbc-8128-4487-9bef-d67209c5eb8d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081530 Oct 04 18:03:05.325702 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1394/2918] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:05.345646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:05.346529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:05.365024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.365536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.366028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:05.366763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:05.367228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:05.367659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.127661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:06.510382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2891eb8a-1430-423b-80a6-f66bd9a33b6a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "DELETE /compute/v2.1/os-floating-ips/861a74aa-dada-4b2e-9cf9-45dd3da5e6d1" status: 202 len: 0 microversion: 2.1 time: 3.677726 Oct 04 18:03:06.511892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1525/2919] 10.222.0.42 () {58 vars in 1263 bytes} [Tue Oct 4 18:03:02 2022] DELETE /compute/v2.1/os-floating-ips/861a74aa-dada-4b2e-9cf9-45dd3da5e6d1 => generated 0 bytes in 3686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:06.517189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.519231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.531878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.536440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.539031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.540650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.545075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.545815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.717536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.737658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f2e1dc5-9cfa-4bef-883e-2ae1b3d490ab tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1277 microversion: 2.1 time: 0.224423 Oct 04 18:03:06.744095 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1526/2920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:06.832965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:06.846656 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-102ef88e-4628-4caa-9ccb-99aef3684c2e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 1.509933 Oct 04 18:03:06.850142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1395/2921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:05 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:06.860146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:06.866799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:06.880839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.882064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.882875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.885747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:06.895901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Action: 'create', calling method: .version_select at 0x7fbdc1dd2790>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:06.904481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:06.904481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:06.941733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Getting quotas for project a1442763b0914519bf4765e8bef26ad4. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:06.959540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Getting quotas for user 0966a88314d84579aa581e7c725b9184 and project a1442763b0914519bf4765e8bef26ad4. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:07.065091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Getting quotas for project a1442763b0914519bf4765e8bef26ad4. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:07.086160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Getting quotas for user 0966a88314d84579aa581e7c725b9184 and project a1442763b0914519bf4765e8bef26ad4. Resources: {'server_groups'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:07.113199 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc6c0ee3-9e90-4b38-9fc8-e790ca5b71a8 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] 10.222.0.42 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.365676 Oct 04 18:03:07.115461 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1527/2922] 10.222.0.42 () {62 vars in 1214 bytes} [Tue Oct 4 18:03:06 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:03:07.122933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-305c855d-f579-4d89-81a2-27a30ed9b8c3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '.version_select at 0x7fbdc1c61f70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.080810 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-305c855d-f579-4d89-81a2-27a30ed9b8c3 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "DELETE /compute/v2.1/os-security-groups/07f1b1a0-7878-4c6a-8b96-cf7f8079909e" status: 202 len: 0 microversion: 2.1 time: 0.964021 Oct 04 18:03:08.083711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1528/2923] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 18:03:07 2022] DELETE /compute/v2.1/os-security-groups/07f1b1a0-7878-4c6a-8b96-cf7f8079909e => generated 0 bytes in 968 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:08.089061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecbf26f2-1cb2-462f-8c8e-d3681e63577d tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.121269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.132005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.133030 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecbf26f2-1cb2-462f-8c8e-d3681e63577d tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.048049 Oct 04 18:03:08.133470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.134685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54dcea0d-2f75-450e-9d26-8db5e88fe423 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1661 microversion: 2.42 time: 1.283324 Oct 04 18:03:08.136589 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1529/2924] 10.222.0.42 () {60 vars in 1193 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:03:08.151088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.154106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.168904 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1396/2925] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:06 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1661 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:08.170770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.176988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.177196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.177709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.177931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.179319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.179319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.185267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.195035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.195547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.195998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.196716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.197189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.197614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.327508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:08.338870 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0514c3d-860e-4e64-bb98-0c7a650d482b tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1277 microversion: 2.1 time: 0.194276 Oct 04 18:03:08.353855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1530/2926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:08.355470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.356035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.374138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.376507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.386671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.387809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.388503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.389280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.442706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:08.662849 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-abb01711-6d6c-4baa-8f72-29249965df39 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 204 len: 0 microversion: 2.1 time: 0.315532 Oct 04 18:03:08.665751 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1531/2927] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:08 2022] DELETE /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:08.683384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce97c93c-cc48-4453-b649-6ededc13e5e2 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.709796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce97c93c-cc48-4453-b649-6ededc13e5e2 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] 10.222.0.42 "GET /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71" status: 200 len: 235 microversion: 2.64 time: 0.038256 Oct 04 18:03:08.711790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1532/2928] 10.222.0.42 () {60 vars in 1304 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71 => generated 235 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:03:08.721401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:08.731866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:08.746289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.747310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.748109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:08.751078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:08.754137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:08.754812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.143499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.166416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d20e63c4-3397-4fc4-b72f-9488cc02b92f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 0.994801 Oct 04 18:03:09.166542 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1397/2929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:09.171715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71fcd3fc-3c64-40fe-a015-cc4b9ba877d3 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.251864 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71fcd3fc-3c64-40fe-a015-cc4b9ba877d3 tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71" status: 204 len: 0 microversion: 2.64 time: 0.078659 Oct 04 18:03:09.252600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1398/2930] 10.222.0.42 () {60 vars in 1307 bytes} [Tue Oct 4 18:03:09 2022] DELETE /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:03:09.275203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.275203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.310325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.311270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.311889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.312774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.316241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.317192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.414108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:09.451723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-564b236a-9ae5-4a61-8093-37f624dfad40 tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1506 microversion: 2.1 time: 0.737466 Oct 04 18:03:09.475121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1533/2931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:08 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:09.483704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84ccb7d4-e28b-4b3d-9e68-f4c2322ed01a tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.492679 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-84ccb7d4-e28b-4b3d-9e68-f4c2322ed01a tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] HTTP exception thrown: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84ccb7d4-e28b-4b3d-9e68-f4c2322ed01a tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Request method failure captured: Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71 HTTP/1.1 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVYnpHdDczKHScmPhibBINmjTCKDEn9CQoL9GPntXmaY580EZG88jeDD8WoA8xI22BQrRl8ztyooN8lAP-d3CziPrD6ZKNnFMNXivSTh9wBmVYWyLKZC3W11guBmRF2cyE7sFAYkDwIeF6QRFpCi3ncr9E88ufcqhAiaSbwYe490tY Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.64 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a1442763b0914519bf4765e8bef26ad4 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerGroup264TestJSON-1094162062 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a1442763b0914519bf4765e8bef26ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1442763b0914519bf4765e8bef26ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a1442763b0914519bf4765e8bef26ad4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a1442763b0914519bf4765e8bef26ad4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerGroup264TestJSON-1094162062 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a1442763b0914519bf4765e8bef26ad4 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1094162062 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerGroup264TestJSON-1094162062-project Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 0966a88314d84579aa581e7c725b9184 Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerGroup264TestJSON-1094162062-project Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '5e93c748-1aff-4463-82c2-bd5263ab4d71'} Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.494830 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84ccb7d4-e28b-4b3d-9e68-f4c2322ed01a tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] Returning 404 to user: Instance group 5e93c748-1aff-4463-82c2-bd5263ab4d71 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84ccb7d4-e28b-4b3d-9e68-f4c2322ed01a tempest-ServerGroup264TestJSON-1094162062 tempest-ServerGroup264TestJSON-1094162062-project] 10.222.0.42 "DELETE /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71" status: 404 len: 117 microversion: 2.64 time: 0.019961 Oct 04 18:03:09.500516 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1534/2932] 10.222.0.42 () {60 vars in 1307 bytes} [Tue Oct 4 18:03:09 2022] DELETE /compute/v2.1/os-server-groups/5e93c748-1aff-4463-82c2-bd5263ab4d71 => generated 117 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:03:09.522040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:09.524045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:09.558878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.559720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.565581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:09.566919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:09.567615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:09.571130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.061805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.081467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e724b136-3772-45de-8fae-a4ccb0d42237 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.581193 Oct 04 18:03:10.085024 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1535/2933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:10.198634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.203350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.256223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.257686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.258427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.259429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.260153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.260802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.533764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.544079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.553866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.560418 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ca27007-7f5c-4eca-a516-e1a695b8786c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1708 microversion: 2.42 time: 1.306782 Oct 04 18:03:10.565238 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1399/2934] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:09 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1708 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:10.580554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:10.586567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:10.608038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.614129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.614837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.618591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:10.619086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:10.619524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:10.829985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:10.857499 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f343aed-e24b-4623-a714-6df399f3badc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 0.668801 Oct 04 18:03:10.870303 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1536/2935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:10 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:11.123662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:11.124310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:11.146159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.146672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.147123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.147842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:11.148308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:11.148745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:11.181976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:12.193704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:12.228745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-90500162-a09a-4377-8770-f0af84c82a79 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 1.108882 Oct 04 18:03:12.236115 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1537/2936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:11 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:12.249992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:12.251922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:12.272642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.273915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.274386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:12.275229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:12.275740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:12.276207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.098219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.132800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.134332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.151405 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e462044-2b03-468c-84b1-b1661b16e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1708 microversion: 2.42 time: 0.898085 Oct 04 18:03:13.152064 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1538/2937] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:12 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1708 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:13.186859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.186859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.188158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:13.191425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.196405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.197539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.199016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.199672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.200455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.264018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2927d6dbb72d47a0aa8cddb3e0244a08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2c133b854094d5d82082773a1e8f3f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.275456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b6e0dcf-2bd4-49d1-9f66-36a82b78553a tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 200 len: 1506 microversion: 2.1 time: 2.708876 Oct 04 18:03:13.278098 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1400/2938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:10 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 1506 bytes in 2712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.290303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e", "name": "network-vif-deleted", "tag": "11e29b11-7f68-4a34-82d9-34e562ac678f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:13.329949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.334951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.335952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.382810 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] Creating event network-vif-deleted:11e29b11-7f68-4a34-82d9-34e562ac678f for instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e on n-h2-831194-21 Oct 04 18:03:13.398979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8fc28761-4c93-40ea-8c7d-d0d733738c04 req-4f6822a9-3f18-4947-8b6a-6a2430a1fe22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116393 Oct 04 18:03:13.407678 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1401/2939] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:13.433567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:13.452316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:13.477967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.479603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.480804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.482442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.484822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.487976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.791519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:13.810080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4171536b-69ae-4d87-b064-719b365785a6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 0.640338 Oct 04 18:03:13.811514 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1539/2940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:13.829481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cd8b77-f723-460f-aa1e-39b5b73dabbd", "name": "network-vif-plugged", "status": "completed", "tag": "796272b8-f504-4c86-ab3f-995b78e9bfac"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:13.852408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:13.861556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:13.862316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:13.888545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] Creating event network-vif-plugged:796272b8-f504-4c86-ab3f-995b78e9bfac for instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd on n-h1-831194-21 Oct 04 18:03:13.912382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-19061886-8fbc-4aeb-ac03-43a2f696d2a9 req-7026c420-ee74-4776-8475-be55aa9ebc3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092845 Oct 04 18:03:13.929508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1540/2941] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:14.186342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.187654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.199071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.200556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.201248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.203097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.204498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.205202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.526974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.547332 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12e55b10-467a-44ae-8436-ab9928c41025 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 1.134107 Oct 04 18:03:14.550352 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1402/2942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:13 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:14.570205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.574593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.590604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] [instance: 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.605313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.615356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:14.617564 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ceb836b8-87d7-4481-955a-a1a90c54331a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1708 microversion: 2.42 time: 0.436740 Oct 04 18:03:14.620078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.621367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.622341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.624389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1541/2943] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1708 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:03:14.625229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.626539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.627321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.646970 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] HTTP exception thrown: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Request method failure captured: Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e HTTP/1.1 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHT8w7Wi0-ZUBsDU9tVCrJ1itXC4H3ru3FiM9RDdLeHcka_9hbB1egEpiQoEirtzzVZ6Cwh5PsC9xI6zRCP7Q3JS7l-Sf2HCs0wjR-u8hKaE5nWZ3MRogkRsp9z4_dZ4ruYfdmn4HMU-Jn8lVKfDJe07O7qOxrAkihpCdpf9A2Z-Mpw Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d2c133b854094d5d82082773a1e8f3f8 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-931550414 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d2c133b854094d5d82082773a1e8f3f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2c133b854094d5d82082773a1e8f3f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d2c133b854094d5d82082773a1e8f3f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d2c133b854094d5d82082773a1e8f3f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-931550414 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d2c133b854094d5d82082773a1e8f3f8 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-931550414 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueTestJSONUnderV235-931550414-project Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 2927d6dbb72d47a0aa8cddb3e0244a08 Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-931550414-project Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e'} Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:03:14.649568 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. Oct 04 18:03:14.653819 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:03:14.656414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] Returning 404 to user: Instance 2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:14.658399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84f08e52-8c2b-4680-aa97-0831337c6f3d tempest-ServerRescueTestJSONUnderV235-931550414 tempest-ServerRescueTestJSONUnderV235-931550414-project] 10.222.0.42 "GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e" status: 404 len: 111 microversion: 2.1 time: 0.104180 Oct 04 18:03:14.659622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1403/2944] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/2ef1e8ca-1e9e-4b8d-b8ae-1db6dde4036e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:14.686990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c702c305-cbc3-4ce6-a7ff-a8761af385e6", "tag": "5d0f1d54-5e6c-4fb1-82e7-449cb810410b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:14.735555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.736973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.737741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.775944 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] Creating event network-changed:5d0f1d54-5e6c-4fb1-82e7-449cb810410b for instance c702c305-cbc3-4ce6-a7ff-a8761af385e6 on n-h1-831194-21 Oct 04 18:03:14.788761 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5081c6d3-4f71-47fa-84b7-889671ee569f req-ded804ea-1a2b-4e58-afce-79ab5fa6464a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109034 Oct 04 18:03:14.790811 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1542/2945] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:14.852581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:14.853994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:14.883175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.915086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.915544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.920023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:14.920602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:14.921252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:14.992996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=83 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:15.589043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:15.589901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:15.610867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.611447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.612470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:15.614673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:15.619638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:15.622448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.056543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.066288 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6858273-81fe-49a6-9609-e0560df3bec3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1292 microversion: 2.1 time: 1.234689 Oct 04 18:03:16.082637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1404/2946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:14 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1292 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.098711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:16.099644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:16.112410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.115299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.135197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.140274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:16.140936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:16.142147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:16.358099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.378900 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-223ce816-ecc9-4ad4-89a9-03ae70cb2573 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.793448 Oct 04 18:03:16.383430 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1543/2947] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:15 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:16.745718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.810013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.817578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:16.823086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7148398-7ffc-48ef-8d7b-1faf1709704c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1708 microversion: 2.42 time: 0.738968 Oct 04 18:03:16.827057 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1405/2948] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:16 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1708 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:16.966078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-554dcb42-bc79-40cf-b69d-c26d7bf5554f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Action: 'create', calling method: .version_select at 0x7fbdc1db84c0>, body: {"keypair": {"name": "tempest-keypair-2083653981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGqYdu2GNW6B5VwuZWSCmkvlsKAPnskwB4dwz7SlMYhu8LsTaZaWZFSIQRgMNO3MGFilyeHCEdfUGgTV7CPZ/iSwtxImB0bAlnpITbw0iJhpzSF5qVznDtfqtyZthItP2A=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:17.019975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-554dcb42-bc79-40cf-b69d-c26d7bf5554f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Getting quotas for project ec4086e1f5e04bb29219777357de8fc5. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:17.036922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-554dcb42-bc79-40cf-b69d-c26d7bf5554f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Getting quotas for user 67cbf643d7f245709abb102b830e904a and project ec4086e1f5e04bb29219777357de8fc5. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:17.077641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-554dcb42-bc79-40cf-b69d-c26d7bf5554f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.411627 Oct 04 18:03:17.079041 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1544/2949] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:03:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:17.107026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:17.111632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:17.130214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.130717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.131172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.131994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.132451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.133073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.410609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:17.411242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:17.423909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.424426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.424874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.425606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.426103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.426584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.961902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:17.973343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2773ef9-531e-4424-ba9a-560c4566bb34 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1472 microversion: 2.1 time: 0.871150 Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1406/2950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:17 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1472 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:17.990844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:17.991764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:17.991764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.397934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.437225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2aba0601-7f7c-4e5a-9e6c-284500652ebf tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 1.031657 Oct 04 18:03:18.439979 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1545/2951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:17 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:18.447271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7b0a8e-dbd6-43be-a77a-d750276b1e06", "tag": "adccef11-beb5-4561-888e-64e1b00b84bb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:18.488715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:18.489799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:18.490706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:18.509657 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] Creating event network-changed:adccef11-beb5-4561-888e-64e1b00b84bb for instance 4b7b0a8e-dbd6-43be-a77a-d750276b1e06 on n-h2-831194-21 Oct 04 18:03:18.519287 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-716d02db-b5ab-4bee-aeea-2740a677f62f req-982104c0-39dc-4df6-9e8b-72be9b65e13f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073288 Oct 04 18:03:18.521214 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1546/2952] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:18.540160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-47379808", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:18.689787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:18.745679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.757521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.759608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:18.761041 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f95efb8b-5f86-4945-97d8-6898ffa6a9cb tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1755 microversion: 2.42 time: 0.785369 Oct 04 18:03:18.776074 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1407/2953] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:17 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1755 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:19.472478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:19.473646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:19.480438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:19.496206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.497266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.498010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.501757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.506055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.506747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.924923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:19.946601 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-38235ee6-b171-4f46-80c3-5c2e4c555aca tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.478843 Oct 04 18:03:19.950651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1408/2954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:19 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:19.959601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:19.961466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:19.991301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.995490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.996236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:19.997213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:19.997934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:19.998565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.160428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:20.161466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:20.162145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:20.162764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:20.163339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:20.174248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.175017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.175656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.176579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:20.177202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:20.177804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:20.198956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:20.205857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:20.222172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:20.224993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:20.329226 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b330fbe1-d6eb-4415-8392-8bf2080f2c13 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.802058 Oct 04 18:03:20.339342 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1547/2955] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:20.350521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57a2456c-9a81-429f-a06c-0ce1eac57bce tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:20.351289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57a2456c-9a81-429f-a06c-0ce1eac57bce tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:20.395762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57a2456c-9a81-429f-a06c-0ce1eac57bce tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:20.554026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:20.574077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:20.576314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:20.579358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-664f6722-07e9-456e-b0ae-cdb319efec7a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1755 microversion: 2.42 time: 0.625820 Oct 04 18:03:20.581962 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1409/2956] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:19 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1755 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:20.974463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:20.975507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:21.001995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.010089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.011218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.013274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.014982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.015459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.372066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-57a2456c-9a81-429f-a06c-0ce1eac57bce tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Instance Mapping does not exist while attempting local delete cleanup. Oct 04 18:03:21.374836 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57a2456c-9a81-429f-a06c-0ce1eac57bce tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f" status: 204 len: 0 microversion: 2.1 time: 1.028616 Oct 04 18:03:21.379448 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1548/2957] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:20 2022] DELETE /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:21.394609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:21.395606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:21.416904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f HTTP/1.1 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'd1822c80-bf39-4c67-9396-1b19fe963b2f'} Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:03:21.419606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:03:21.423938 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:03:21.423938 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:03:21.423938 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:03:21.423938 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:03:21.423938 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:03:21.431179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:03:21.432383 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-486318ce-5171-40e6-ab23-edeef2b35192 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f" status: 404 len: 111 microversion: 2.1 time: 0.051512 Oct 04 18:03:21.433147 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1549/2958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:03:21.614448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:21.615603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:21.629190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.634032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.646598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:21.649228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:21.650523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:21.653221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:22.302421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.323268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.325213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.338978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f082e0a0-a5da-4a58-b9f1-16614cb9c050 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1802 microversion: 2.42 time: 0.730090 Oct 04 18:03:22.342219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1550/2959] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:21 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1802 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:03:22.348141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-53790578", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:22.466443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:22.839444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:22.849921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30394fc1-3f4c-47c2-9510-407c62eb5cee tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 1.881051 Oct 04 18:03:22.852052 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1410/2960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:20 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:23.368882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:23.371000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:23.379382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.380228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.381880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:23.383420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:23.384068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:23.384659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:24.554448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:24.583050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:24.590826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:24.596336 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce75f989-e6d6-4af0-89f1-b510b740b0ce tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1802 microversion: 2.42 time: 1.232782 Oct 04 18:03:24.599466 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1411/2961] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:23 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1802 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:24.610849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:24.613776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:24.626953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.628117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.629721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:24.631872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:24.632622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:24.633645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.041317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:25.041858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:25.042269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:25.042690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:25.043112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:25.060812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.061356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.061704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.062526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:25.063536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:25.063970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:25.122981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:25.141396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:25.182072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:25.184552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:25.360421 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a290d6b2-d0a4-456a-b901-eb7c87e1d351 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.016026 Oct 04 18:03:25.402927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1551/2962] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 3058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:25.410053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1344274751", "imageRef": "7e7c1a37-b269-48bc-a402-a40a52d10749", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0d88c061-29c1-47de-9d5f-85596214962d"}], "security_groups": [{"name": "tempest-securitygroup--76743644"}], "key_name": "tempest-keypair-2083653981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:25.498149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:25.517860 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-794139cc-cc51-4a57-a83f-7e72772627e0 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.914556 Oct 04 18:03:25.533930 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1412/2963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:24 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:25.987888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-310376714", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:26.264294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:26.489984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] validate_networks() for [('0d88c061-29c1-47de-9d5f-85596214962d', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:27.443609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:27.444261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:27.444849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:27.445374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:27.445953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:27.459098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.464366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.464972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.465906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.466931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.471091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.503846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Getting quotas for project ec4086e1f5e04bb29219777357de8fc5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:27.527542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Getting quotas for user 67cbf643d7f245709abb102b830e904a and project ec4086e1f5e04bb29219777357de8fc5. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:27.573707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:27.576415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7e7c1a37-b269-48bc-a402-a40a52d10749',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:27.647520 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf04ce73-0f2c-4e54-8ab2-c25dd077b2aa tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.242449 Oct 04 18:03:27.648564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1552/2964] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 2245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:27.654510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.660129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.672157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.672717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.673149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.673899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.674365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.674793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.787502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:27.809545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26b948ab-dd70-441f-a2bf-c985f54ce6be tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1271 microversion: 2.1 time: 0.159453 Oct 04 18:03:27.811117 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1553/2965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:27 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1271 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:27.831804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:27.834718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:27.854562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.855487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.856805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:27.858231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:27.858717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:27.859157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.022117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:28.022571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:28.023004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:28.023453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:28.024057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:28.051338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.054074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.054530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.056475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.056955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.057390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.106333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:28.113886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:28.133747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:28.137705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:28.208046 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a448830-7bd1-4349-a9ab-89cb1e8ca595 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.685768 Oct 04 18:03:28.209357 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1413/2966] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:03:28.215597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c702c305-cbc3-4ce6-a7ff-a8761af385e6", "name": "network-vif-plugged", "status": "completed", "tag": "5d0f1d54-5e6c-4fb1-82e7-449cb810410b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:28.230624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.231470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.232252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.249016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] Creating event network-vif-plugged:5d0f1d54-5e6c-4fb1-82e7-449cb810410b for instance c702c305-cbc3-4ce6-a7ff-a8761af385e6 on n-h1-831194-21 Oct 04 18:03:28.274055 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2c8ffae9-cb00-4f3d-8a7e-baac7c70a8a8 req-b664ff1f-87c7-4a5f-acdf-71df033b72ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063308 Oct 04 18:03:28.275099 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1414/2967] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:28.294288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.295218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.319171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.320497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.323143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.324296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.326468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.330743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.346178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.384073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.385885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.388355 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79841de9-d662-4c91-bc0d-65b566ba8e8c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 0.576065 Oct 04 18:03:28.412985 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1554/2968] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:27 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:28.431125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9542bc0-0ae1-4258-8e23-eef116444acd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.431766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9542bc0-0ae1-4258-8e23-eef116444acd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.585494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9542bc0-0ae1-4258-8e23-eef116444acd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.597680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9542bc0-0ae1-4258-8e23-eef116444acd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1246 microversion: 2.1 time: 0.181043 Oct 04 18:03:28.606186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1555/2969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1246 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:28.623658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65582657-3169-4a79-aec8-fd94e5a8966b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.627404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65582657-3169-4a79-aec8-fd94e5a8966b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.633805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:28.794223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65582657-3169-4a79-aec8-fd94e5a8966b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.805057 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65582657-3169-4a79-aec8-fd94e5a8966b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1212 microversion: 2.1 time: 0.195741 Oct 04 18:03:28.805057 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1556/2970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1212 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:28.836370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:28.837336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:28.844924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.845704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.846511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.847412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:28.848081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:28.848675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:28.938447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:28.947672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e13b0e61-02b0-41fa-af06-e989fb573a4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1277 microversion: 2.1 time: 0.116225 Oct 04 18:03:28.962449 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1557/2971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:29.292392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.310595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bc9a1f2d-32c2-481d-b7ec-e89ad3ec371e tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 1.030583 Oct 04 18:03:29.321338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1415/2972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:28 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:29.419322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.420394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:29.430357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.434264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.435480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.439479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.444032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.444939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.637949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.638637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:29.661450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.662086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.662430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.663157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.668524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.669067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.722775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.739551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.741636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:29.744325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec712fe8-4e40-4143-846b-5365d064b424 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 0.329354 Oct 04 18:03:29.745953 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1558/2973] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:29.842114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:29.845267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:29.862098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.862981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.863639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.864616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:29.865361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:29.866363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:29.985628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:30.001104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:30.004035 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-369a6eff-9582-47f8-af77-4e60d5dd6569 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1298 microversion: 2.1 time: 0.374108 Oct 04 18:03:30.005124 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1416/2974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:30.025238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:30.025978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.032604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5af650ee-e28a-41ba-9216-0d5851db9248 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1208 microversion: 2.1 time: 0.199163 Oct 04 18:03:30.034839 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1559/2975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:29 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1208 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:30.038408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.039131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.039754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.040629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.041255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.041883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.294413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7b0a8e-dbd6-43be-a77a-d750276b1e06", "name": "network-vif-plugged", "status": "completed", "tag": "adccef11-beb5-4561-888e-64e1b00b84bb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:30.307255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.308162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.308839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.322905 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] Creating event network-vif-plugged:adccef11-beb5-4561-888e-64e1b00b84bb for instance 4b7b0a8e-dbd6-43be-a77a-d750276b1e06 on n-h2-831194-21 Oct 04 18:03:30.329889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-95e2fa51-575d-4580-b427-108d6ddfcf8c req-c598268a-eb12-4325-afc5-a877be2ceaaa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039485 Oct 04 18:03:30.331079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1560/2976] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:03:30.339005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:30.339908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.347924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.348715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.349351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.350462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.351217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.351955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.488564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:30.503614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-597b98bb-1cb1-47d1-b336-2f1aeef305f2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1277 microversion: 2.1 time: 0.496347 Oct 04 18:03:30.507163 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1417/2977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:30 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1277 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:30.605653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:30.627279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-519f126a-019e-4d62-aff8-4b3d0639daf1 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.292671 Oct 04 18:03:30.628507 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1561/2978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:30 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:30.779962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:30.783366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:30.795974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.798574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.799739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.802630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.803265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.803752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.841908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-38656769", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:30.931490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:30.931851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:30.932803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:30.933397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:30.934354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:30.958726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.961291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.963384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.964482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:30.973997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:30.975019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:30.998537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Getting quotas for project 36d1e69063524cc588fe00f91347176f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:31.010757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Getting quotas for user 57cb5088d30c4608b63648d5d33311ac and project 36d1e69063524cc588fe00f91347176f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:31.054615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:31.057339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:31.140409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-300b54d0-aa07-43de-9b35-04e986374f20 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.547363 Oct 04 18:03:31.141540 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1418/2979] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:03:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 04 18:03:31.151776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.152822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.162171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.163876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.164916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.165955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.166639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.167356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.256220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.269852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.272446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.275798 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9160013e-d3e3-40d3-a67b-9f3b93f31db9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 0.506227 Oct 04 18:03:31.276806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1562/2980] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:30 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:31.294139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.295161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.303713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.304862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.305639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.307123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.308281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.309206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.461538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.465623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:31.475500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-381a5f28-838d-499f-85cf-b9228411dd82 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1282 microversion: 2.1 time: 0.197049 Oct 04 18:03:31.480324 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1563/2981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1282 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:31.503724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.504673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.528830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.549345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-032bcd72-4023-417f-ae44-1994eb8658c2 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1304 microversion: 2.1 time: 0.402336 Oct 04 18:03:31.549988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1419/2982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1304 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:31.586424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.587102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.604590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.605582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.606996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.608079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.608766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.609411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.636464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.648400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.651316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:31.652992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b8041ee-30f9-4e93-809d-07e2c6d4200e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1276 microversion: 2.57 time: 0.171360 Oct 04 18:03:31.653773 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1564/2983] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:31.660966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:31.662117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:31.677604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.678165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.678622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:31.679351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:31.679814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:31.680251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.060838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.072043 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d7bde73-6cd0-4b23-81df-c8ababa1163c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.415815 Oct 04 18:03:32.072600 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1565/2984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:32.311848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.313305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.325079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.325573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.329628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.330490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.333437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.333937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.340423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.363727 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e9e6b63-d190-41ff-ad6a-c12107947b87 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1277 microversion: 2.1 time: 0.801230 Oct 04 18:03:32.365594 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1420/2985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:31 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1277 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:32.511991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.512688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.527700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.534548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.535231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.537784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.542149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.544890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.585309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.598902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.601102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.602747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bbbb5d29-f8cf-438f-9581-1d2c60fa78c9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 0.295996 Oct 04 18:03:32.622431 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1566/2986] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:32.636691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.637334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.644409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.644928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.646043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.647108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.647923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.648732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.749656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.768039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.768274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06ca3eeb-de31-4915-937d-0a861fa3ab22 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1304 microversion: 2.1 time: 0.140451 Oct 04 18:03:32.769323 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1567/2987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:32.775933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:32.776612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:32.784559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.785470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.786189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.787104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:32.787572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:32.788195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:32.806800 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1262e63-9181-4fa8-927e-d96be43e2cfc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1270 microversion: 2.1 time: 0.296808 Oct 04 18:03:32.823377 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1421/2988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1270 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:03:32.896767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.920049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.922282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:32.924721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0c4b68d-6e91-4426-a502-c029e6146d97 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1328 microversion: 2.57 time: 0.153528 Oct 04 18:03:32.941113 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1568/2989] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:32 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1328 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:33.098787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:33.099419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:33.115275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.116188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.116978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.117910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.118394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.119004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.190054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "c76c890b-2bc2-43f9-bb54-90bda2d549c7"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:33.220365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.220865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.221314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.250667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] Creating event network-changed:c76c890b-2bc2-43f9-bb54-90bda2d549c7 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:33.256348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6c1421d5-6009-4d93-a07f-36443bac8e7c req-3675ca83-accc-47be-ad65-ad94716a5453 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071017 Oct 04 18:03:33.257546 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1569/2990] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:03:33.394826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:33.395818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:33.411244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.412065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.412676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.413590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.414242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.419268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.738493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:33.749504 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d4fd4e1-3e2b-4543-9d53-d5e9991db266 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.359822 Oct 04 18:03:33.753887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1570/2991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:33 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:33.759373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:33.764942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:33.777740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.778551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.779164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.780179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:33.791250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:33.792022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:33.930838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:33.956656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:33.961295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b373a85-c394-4283-9536-d6648e814929 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1319 microversion: 2.1 time: 0.868123 Oct 04 18:03:33.977865 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1422/2992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:33 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1319 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:33.977865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:33.977865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.000281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.002287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.003432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.005784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.007463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.008246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.170916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.187447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.189889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.194942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.219839 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-362405f2-949c-4fab-916a-a005600937ff tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 0.464362 Oct 04 18:03:34.221582 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-749235ac-d5fa-42d2-94b0-065aa0400502 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1304 microversion: 2.1 time: 0.249823 Oct 04 18:03:34.223412 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1423/2993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:33 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:34.228815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.229845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.237293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.238095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.239035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.241218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.242044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.242722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.246855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1571/2994] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:33 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:34.255754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.256430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.277232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.278548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.282004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.283170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.284562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.286194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.507441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.522629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.526235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.530048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83c32565-1426-4da3-942d-705f80d80166 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1334 microversion: 2.57 time: 0.280965 Oct 04 18:03:34.533883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1572/2995] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1334 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:34.604344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:34.614176 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-925699e1-9ced-4e44-8a86-2d2a174aaf5d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1270 microversion: 2.1 time: 0.389326 Oct 04 18:03:34.618228 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1424/2996] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1270 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:34.779152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.781249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:34.798006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.799491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.800295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.802871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:34.806462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:34.807242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:34.994836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:34.995478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.010686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.019012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.019842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.020771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.024732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.028914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.142071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.157751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-488627c5-3a84-4421-b85c-45864002210d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.383687 Oct 04 18:03:35.158301 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1573/2997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.251118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.252321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.268683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.271789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.272272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.273025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.276103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.276882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.635005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:35.645760 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8670f370-823b-4695-bf32-57cbf706be51 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1304 microversion: 2.1 time: 0.399525 Oct 04 18:03:35.649885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1574/2998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1304 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:35.658265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:35.662648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:35.683630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.684922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.685505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:35.686775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:35.687480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:35.688108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.072101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.098111 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f50fa516-b191-481e-b9ee-c2bb5dcd0beb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 200 len: 1507 microversion: 2.1 time: 1.095268 Oct 04 18:03:36.122353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1425/2999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:34 2022] GET /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 1507 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:36.140570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.141431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:36.176840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.177359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.177887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.182335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.183081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.183557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.786989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.803679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.809565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:36.814354 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-998eca64-aed0-4496-8b05-6ec0e0e3579e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1355 microversion: 2.57 time: 0.690125 Oct 04 18:03:36.820517 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1426/3000] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:36 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1355 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:36.830978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:36.833636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:36.855055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.863442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.864150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:36.865046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:36.865638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:36.866235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.072663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:37.085273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:37.115499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:37.141879 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b21192cc-37f2-4cb4-8eac-0a8b588d6515 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1837 microversion: 2.42 time: 1.485895 Oct 04 18:03:37.142718 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1575/3001] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:35 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1837 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:37.161741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:37.162510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: c702c305-cbc3-4ce6-a7ff-a8761af385e6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:37.179234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:37.194356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61f7b2ca-22a9-4067-94f3-1dbccda1d218 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1270 microversion: 2.1 time: 0.370914 Oct 04 18:03:37.195953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.196444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.196843 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1427/3002] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:36 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1270 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:37.196975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.197604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.207750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:37.208639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:37.210241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.210795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.224507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.230504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.231231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.232217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:37.236254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:37.238932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:37.481970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:39.276461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:39.291794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dde0260f-2d7f-4107-ad92-611ae69f3d8a tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/c702c305-cbc3-4ce6-a7ff-a8761af385e6" status: 200 len: 1507 microversion: 2.1 time: 2.142070 Oct 04 18:03:39.302410 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1576/3003] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:37 2022] GET /compute/v2.1/servers/c702c305-cbc3-4ce6-a7ff-a8761af385e6 => generated 1507 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:39.319999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:39.322421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:39.355840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.359249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.360590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.368187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.371767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.372322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.645269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:39.660982 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be722af4-24f5-4d5d-8271-5e816208000f tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1304 microversion: 2.1 time: 0.352959 Oct 04 18:03:39.663756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1577/3004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:39 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1304 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:39.681146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:39.693607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:39.736059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.737636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.739939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.740944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.745184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.745727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.785451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:39.818516 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e78f0df3-8ac8-4eb5-a39a-97a2577679ac tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 2.612136 Oct 04 18:03:39.821737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1428/3005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:37 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 2624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:39.835040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:39.839793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:39.886524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.887292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.887936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.888893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:39.889530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:39.890153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:39.940138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:39.940966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:39.941702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:39.942368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:39.943041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:40.059885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.084513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.086555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.087282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.089419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.095314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.098487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.178160 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ef93879-d4fb-4d5b-97b9-eb01d3a5a18f tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "POST /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced/action" status: 202 len: 1136 microversion: 2.57 time: 0.509680 Oct 04 18:03:40.186172 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1578/3006] 10.222.0.42 () {62 vars in 1320 bytes} [Tue Oct 4 18:03:39 2022] POST /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced/action => generated 1136 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 04 18:03:40.197700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:40.200763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.218486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.219356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.221089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.226582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.227868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.228602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.815199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.837734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.846118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:40.847440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f471c5e8-90ae-4b39-9a1b-0cdc63d70259 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1858 microversion: 2.42 time: 1.023662 Oct 04 18:03:40.866616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1429/3007] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:39 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1858 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:40.884067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:40.885923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: c702c305-cbc3-4ce6-a7ff-a8761af385e6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:40.903325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.908743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.911116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.912225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:40.912903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:40.913505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:40.990015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:40.999602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: c702c305-cbc3-4ce6-a7ff-a8761af385e6] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:41.043844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:41.531082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.547958 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4cd90654-2fe3-4486-894b-b81e71d61ffe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 1.356177 Oct 04 18:03:41.561859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1579/3008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:40 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:41.570176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.571421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.592577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.594839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.596982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.598885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.601300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.602012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.619650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:41.659170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=38 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:41.734277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61efac13-a912-417a-af31-aca91d1f49ce tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c702c305-cbc3-4ce6-a7ff-a8761af385e6" status: 204 len: 0 microversion: 2.1 time: 0.865915 Oct 04 18:03:41.737703 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1430/3009] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:40 2022] DELETE /compute/v2.1/servers/c702c305-cbc3-4ce6-a7ff-a8761af385e6 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:41.748849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.750448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.763783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.764616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.765276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.768093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.768885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.769532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:41.937127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.962900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.966160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:41.971781 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83754fd1-a157-4265-8199-d31f4b62fbe5 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.420074 Oct 04 18:03:41.972414 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1580/3010] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:41.979408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:41.983806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:41.996838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:41.997767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:41.998809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.000062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.001378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.002325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.346149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.362024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-edddcd6c-ed1a-40d7-b8e8-59a6c47ca731 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.622247 Oct 04 18:03:42.363777 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1431/3011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:42.370412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43970361-0367-4b47-89fd-5fd73d14c177", "tag": "35960e20-d8f7-4001-a593-636e12bd0e15"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:42.384704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.385658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.386885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.402711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] Creating event network-changed:35960e20-d8f7-4001-a593-636e12bd0e15 for instance 43970361-0367-4b47-89fd-5fd73d14c177 on n-h1-831194-21 Oct 04 18:03:42.410382 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d7c3ab7e-7dc0-4a96-ab64-46a976872233 req-159447fa-5eec-45dd-9212-f75eaa67d20e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044969 Oct 04 18:03:42.411693 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1432/3012] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:42.429726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:42.448268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.452007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.459045 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-76fdfbf0-fec0-46cb-8f38-c5ae12c15a75 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.481883 Oct 04 18:03:42.463230 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1581/3013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:41 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:42.474007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.475904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.476639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.477352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.478830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.481060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.482713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.483788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.495474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.495989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.500809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.501948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.502284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.502738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.531909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: 4b7b0a8e-dbd6-43be-a77a-d750276b1e06] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:42.681973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46372866-fd48-477a-bec9-fa2331c281ba tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06" status: 204 len: 0 microversion: 2.1 time: 0.268380 Oct 04 18:03:42.682695 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1433/3014] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:42 2022] DELETE /compute/v2.1/servers/4b7b0a8e-dbd6-43be-a77a-d750276b1e06 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:42.691812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:42.691812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:42.697939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.698643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.699055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:42.700123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:42.700264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:42.700732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.052279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.064997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.067207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.068969 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b768ec3b-5241-48b0-9ee0-e4034ad41654 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1858 microversion: 2.42 time: 0.603134 Oct 04 18:03:43.086459 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1582/3015] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:42 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1858 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:43.094688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-382343934", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "560e0478-d47c-40d2-bc6f-a31863ba653a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:43.165186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] validate_networks() for [('560e0478-d47c-40d2-bc6f-a31863ba653a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:43.746233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.761020 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e0c2a8a-b337-4118-bc1e-e49a2bf5077a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 1.075617 Oct 04 18:03:43.762667 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1434/3016] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:42 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:43.769351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:43.771889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:43.784429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.785460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.785591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.786642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:43.787219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:43.790971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:43.978578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.991700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.996053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:43.997574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f9a53f59-a296-446a-b619-7169aa08751e tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.233090 Oct 04 18:03:43.998173 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1435/3017] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:43 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:44.010931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:44.011859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:44.027927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.028454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.030360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.031876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.032363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.032998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.658350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:44.660844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:44.675907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea504439-53b9-446c-8e8c-c9d3c0879390 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.669609 Oct 04 18:03:44.676937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1436/3018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:43 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:44.683846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:44.684965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:44.694776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.695557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.696393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.696987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.697558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.698127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.739980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:44.740523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:44.741099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:44.741978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:44.742630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:44.771510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.772390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.777965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.779134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:44.779880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:44.780566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:44.810241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Getting quotas for project 95ca9284739c4b009d70fdd5e9669bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:44.825034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Getting quotas for user 06cc4cee636f499689760ecd7625427b and project 95ca9284739c4b009d70fdd5e9669bfa. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:44.855636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Going to run 2 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:44.868593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:44.919829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=d2d33090-3df5-4f8d-85f8-07c813b324b7,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:44.999738 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d08198e-0298-4f51-9bbc-5e7366f9a1c3 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.911664 Oct 04 18:03:45.001369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1583/3019] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:03:43 2022] POST /compute/v2.1/servers => generated 32 bytes in 1914 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 04 18:03:45.011035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:45.026099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.027929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.028617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.116989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] Creating event network-changed:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h2-831194-21 Oct 04 18:03:45.129918 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1b353925-fcea-4bfb-824a-990925c791ec req-b8ee58f6-77ad-4b4e-836d-981ac4a2f8ae service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126332 Oct 04 18:03:45.132831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1584/3020] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:45.143476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:45.144443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:45.155768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.158908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.160370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.163366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.177440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.179367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.358243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.371712 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78cf3a2d-c906-4610-ac08-36796153aab1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.692896 Oct 04 18:03:45.372343 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1437/3021] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:44 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:45.385932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "4cac5198-8159-48df-b2c3-dfd5f86feace"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:45.406800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:45.409121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.412151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.414417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.428596 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] Creating event network-changed:4cac5198-8159-48df-b2c3-dfd5f86feace for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:45.435765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-06c55e1c-88aa-4e0e-867f-fea95e6f6eac req-2446937e-8887-44e2-b5dd-2df8b09fcf19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061853 Oct 04 18:03:45.437111 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1438/3022] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:45.443465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:45.452485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:45.460543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.462635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.463289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.468148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.469397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.470176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.762497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.782243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.795324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.801224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a2ef37b-6802-422b-a28e-0e7507c21462 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.667048 Oct 04 18:03:45.801841 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1585/3023] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:45 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:45.826700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:45.842771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:45.846779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Searching by: {'deleted': False, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:03:45.885511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.887591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.894262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.895834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:45.896634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:45.897384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:45.938986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:03:45.993097 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9adee552-71a3-402a-95eb-abfe89d30471 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.189181 Oct 04 18:03:46.002525 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1586/3024] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 18:03:45 2022] GET /compute/v2.1/servers => generated 1333 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:46.002525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.002525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:46.008059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.008708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.009267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.010142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.010719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.011266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.225219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.239720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.246248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.247930 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d67e19f8-522b-4b75-8ce0-98e59e689a36 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.252772 Oct 04 18:03:46.261856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1587/3025] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:45 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:46.277410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.278082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:46.297945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.298554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.299111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.316771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.317281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.317769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.548506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.559345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa4719b0-15bd-4808-aacb-6219a2bff2cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 1.120450 Oct 04 18:03:46.560067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1439/3026] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:45 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:46.567067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.568321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:46.586686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.587431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.588072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.591238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:46.595437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:46.597400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:46.952805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:46.963407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d14d781-b9ef-4b61-8953-4f2a11403866 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1221 microversion: 2.1 time: 0.402150 Oct 04 18:03:46.988173 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1440/3027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:46 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1221 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:46.994126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:46.995371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.014058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.014915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.017008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.018059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.018989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.019583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.540217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:47.574518 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13d3dd1d-829d-459b-8c38-be29bb36902b tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 1.311995 Oct 04 18:03:47.575728 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1588/3028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:46 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:47.584677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:47.585734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:47.595465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.596504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.597283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:47.598315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:47.599169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:47.599751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.175738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.193286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.198267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.204037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7704d8c2-d5d4-43a4-bc6e-e80906d68a7d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.626372 Oct 04 18:03:48.214324 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1589/3029] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:47 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:48.215495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.221873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.242846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.246517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.250951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.252168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.252844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.253470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.434243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.458979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f606db7e-18b9-4ac3-b082-c22198c2a928 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 1.469584 Oct 04 18:03:48.460298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1441/3030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:46 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:48.480625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7b0a8e-dbd6-43be-a77a-d750276b1e06", "name": "network-vif-deleted", "tag": "adccef11-beb5-4561-888e-64e1b00b84bb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:48.517521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.518162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.519740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.547549 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] Creating event network-vif-deleted:adccef11-beb5-4561-888e-64e1b00b84bb for instance 4b7b0a8e-dbd6-43be-a77a-d750276b1e06 on n-h2-831194-21 Oct 04 18:03:48.553444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6cc23d47-d7ce-4174-a036-73dc09f5e879 req-2fd75ba5-caee-4a8f-815c-8a22d74723c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087220 Oct 04 18:03:48.554774 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1442/3031] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:48.561243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c702c305-cbc3-4ce6-a7ff-a8761af385e6", "name": "network-vif-deleted", "tag": "5d0f1d54-5e6c-4fb1-82e7-449cb810410b"}, {"name": "network-changed", "server_uuid": "9e1af660-5886-471d-90bc-571e7c5fb429", "tag": "4167cd20-b41e-4893-9599-c5d4e1072593"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:48.580236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.591684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.592031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.592924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.593641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.600129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.604689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc89b74f-1edc-4431-aee6-685a62fd29d2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.393142 Oct 04 18:03:48.620289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1590/3032] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:48.635836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.645952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.651312 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Creating event network-vif-deleted:5d0f1d54-5e6c-4fb1-82e7-449cb810410b for instance c702c305-cbc3-4ce6-a7ff-a8761af385e6 on n-h1-831194-21 Oct 04 18:03:48.651840 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] Creating event network-changed:4167cd20-b41e-4893-9599-c5d4e1072593 for instance 9e1af660-5886-471d-90bc-571e7c5fb429 on n-h2-831194-21 Oct 04 18:03:48.662172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.662789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.664741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.667755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.668263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.668812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.674475 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-53c86e4b-bcc0-4483-a923-dd570a53ede7 req-ef770e37-c85d-4012-925f-5d04d7480dcf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114838 Oct 04 18:03:48.684561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1443/3033] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:48.708186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:48.712387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:48.738454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.739282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.740156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.741409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:48.742300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:48.743160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:48.979445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:48.989997 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24152a48-7eef-4737-b717-b85adc09d359 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1275 microversion: 2.1 time: 0.303213 Oct 04 18:03:49.008114 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1444/3034] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1275 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.017190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.017913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.025314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.026041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.026471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.027473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.028194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.028870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.665760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:49.676794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-509dd4f1-80a4-496e-8b9b-7abd3dbeb8ad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 1.054958 Oct 04 18:03:49.684273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1591/3035] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:48 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.694779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.704792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.731842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.732612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.733282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.735799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.736754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.737327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.792206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:49.812968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c65c4364-cab1-447c-bcca-0cffabf90395 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.805102 Oct 04 18:03:49.813575 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1445/3036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:49.818641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:49.819231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:49.832153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.833196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.841752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:49.843182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:49.844208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:49.844952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.354416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.370341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3cd04942-2e3e-46d7-9e35-dc5e674c71bd tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.554966 Oct 04 18:03:50.372393 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1446/3037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:50.380950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.382189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:50.390822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.392716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.394201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.395351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.396138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.397064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.552990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.568809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.571584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:50.573818 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd117d81-a80d-4d35-978e-a176e51d99fc tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.199476 Oct 04 18:03:50.575530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1447/3038] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:50.584878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43970361-0367-4b47-89fd-5fd73d14c177", "name": "network-vif-plugged", "status": "completed", "tag": "35960e20-d8f7-4001-a593-636e12bd0e15"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:50.598408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.599601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.600578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.617617 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] Creating event network-vif-plugged:35960e20-d8f7-4001-a593-636e12bd0e15 for instance 43970361-0367-4b47-89fd-5fd73d14c177 on n-h1-831194-21 Oct 04 18:03:50.623236 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1c4c8dc4-0f62-4c32-8836-f96e9c4a1ac3 req-6c1dedb9-4755-4f61-8d64-c74902b8092f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045576 Oct 04 18:03:50.624338 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1448/3039] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:50.630839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:50.631650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:50.646333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.223981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.241620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.244839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.250835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1aa5b9f-2885-42a4-bfda-ac75200ed98b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 1.563927 Oct 04 18:03:51.253748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1592/3040] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:49 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:51.260412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.262192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.265126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:51.274336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.275675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.276459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.277420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.278404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.279944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.346208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.356872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1aa410d2-eb11-4167-8b10-cb0bb5c8f4f2 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.730381 Oct 04 18:03:51.358130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1449/3041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:50 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.366521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "92dfa124-5ad1-4328-b6e5-27dcb4998361"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:51.382971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.383828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.384506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.403018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] Creating event network-changed:92dfa124-5ad1-4328-b6e5-27dcb4998361 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:51.409605 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e01e3e41-b8f3-41e9-85f0-268564e24581 req-5658ad13-1c22-4b48-9aee-86f9ad0c7b33 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049735 Oct 04 18:03:51.411194 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1450/3042] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:51.418203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.420114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.429421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.430495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.431135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.432087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.432818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.433462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.841003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.868992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-781ce56d-405d-42a1-acc2-72614a7856bb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 0.613003 Oct 04 18:03:51.879414 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1593/3043] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.883038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:51.883410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.884210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.900529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec7b1d7b-d032-4603-839e-2790e6b82c49 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.487388 Oct 04 18:03:51.900927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.901143 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1451/3044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:51.912227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:51.912916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:51.918316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.918896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.919673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.923060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.926635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.933302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.933817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.934301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:51.935058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:51.935769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:51.936557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.557353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.573432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.575364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.587451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-51ce7bcf-6e58-4126-a493-2c7fcacc2508 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.679412 Oct 04 18:03:52.588371 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1452/3045] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:52.594072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:52.595679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:52.621913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.622793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.623584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.630991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.633234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.633927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.660160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:52.689002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7bad2c3-ae6c-429f-a8bc-99e14ca97236 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1319 microversion: 2.1 time: 0.807520 Oct 04 18:03:52.692295 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1594/3046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:51 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1319 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:52.714593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:52.715604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:52.754288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.757970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.758628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:52.759604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:52.760095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:52.760534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.311047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.332977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.336918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.339551 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-762210a7-52e7-4927-96b6-25204163c996 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.749906 Oct 04 18:03:53.354358 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1453/3047] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:52 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:53.373110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "2cbf1a8a-abbc-4246-b544-2a63d42f5947"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:53.385302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.386278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.387360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.409558 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] Creating event network-changed:2cbf1a8a-abbc-4246-b544-2a63d42f5947 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:53.419298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:53.439484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-99a0b69d-ef3f-4027-aad2-b2c02f5f6329 req-a609c082-46fb-4a39-bb84-92fc373b2818 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078426 Oct 04 18:03:53.443316 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1454/3048] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:53.447012 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d2d7000-2b55-4f8b-b3fc-0a7353dbeebb tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.748646 Oct 04 18:03:53.449616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1595/3049] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:52 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:53.472652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "name": "network-vif-plugged", "status": "completed", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:53.476497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:53.478920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:53.497820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.501416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.511305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.515119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.516421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.518210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.519220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.520324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.522488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.580757 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] Creating event network-vif-plugged:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h2-831194-21 Oct 04 18:03:53.599966 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f29665fb-7c71-4824-aacd-99ae74a924da req-d7838fb0-ebc2-4c06-8ef3-cb93b1e19522 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154026 Oct 04 18:03:53.601766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1455/3050] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:53.611695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:53.613762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:53.622259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.623234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.624457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:53.627459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:53.630410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:53.631570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.154705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.167917 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a80ed3e5-3801-4c05-8382-8d6a1ad16646 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.562782 Oct 04 18:03:54.182608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1456/3051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:53 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:54.276480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.292473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1677154121", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "268836e6-cfe0-46c0-9db2-f3b4ad7c3635"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:54.308942 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3cd7d026-ef25-41d5-992c-05daba0b29e9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1312 microversion: 2.1 time: 0.857572 Oct 04 18:03:54.314158 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1596/3052] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:53 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1312 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:54.321803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:54.323299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:54.349143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.349960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.350932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.351915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.352652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.353671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.421082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] validate_networks() for [('268836e6-cfe0-46c0-9db2-f3b4ad7c3635', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:03:54.557284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.561212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:54.570923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.573740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:54.575490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adb0e77d-b7ee-40ee-a0d3-43c178a5892b tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.258755 Oct 04 18:03:54.576798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1597/3053] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:54 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:54.587724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:54.588942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:54.596061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.596878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.597905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.598872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:54.599538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:54.601135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:54.847149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:55.599327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:55.622073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adb8a81e-573a-4844-9350-7b20d987b60e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1500 microversion: 2.1 time: 1.040833 Oct 04 18:03:55.639543 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1598/3054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:54 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1500 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:55.654357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:55.655051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:55.664078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.665587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.666335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.667999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.668927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.669543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.789898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:03:55.790471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:03:55.791226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:03:55.791824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:03:55.792636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:03:55.814764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.817172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.818725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.821390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:55.821596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:55.823911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:55.888858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Getting quotas for project ae0856d27b884af487a0a7ea2e2beb1e. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:03:55.902362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Getting quotas for user 965ab9933f354839879167f78b5dcf29 and project ae0856d27b884af487a0a7ea2e2beb1e. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:03:55.913823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:55.931428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:03:55.938010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:03:56.072248 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f84abc68-001a-42ee-9bd5-470316b630b4 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.881475 Oct 04 18:03:56.082875 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1457/3055] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:03:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1891 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:03:56.088899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:56.090688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:56.117241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.117739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.123381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.124739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.126790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.128038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.403388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:56.427661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:56.430743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:56.432743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-76a0319a-934a-4665-930c-55b030c3204a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.789536 Oct 04 18:03:56.442636 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1599/3056] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:55 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:56.455657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0030322-1f4f-4e77-be74-15958267a148", "tag": "4ca8ccbc-b874-40d4-8446-525b7c519ee1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:56.467542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.468039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.468734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.483351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] Creating event network-changed:4ca8ccbc-b874-40d4-8446-525b7c519ee1 for instance b0030322-1f4f-4e77-be74-15958267a148 on n-h2-831194-21 Oct 04 18:03:56.494106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1815093d-2e8d-4e50-b738-39f037997a81 req-0baeaba5-c0ab-4c82-94f6-2d5e734104e5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047876 Oct 04 18:03:56.495601 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1600/3057] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:56.509083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:56.510496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:56.528259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.529491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.530419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.531903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.533464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.534325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.688354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:56.691106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:03:56.699412 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e832d9cf-f54b-46f7-b5fc-c9e17fcd84ad tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.623346 Oct 04 18:03:56.710682 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1458/3058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:56 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:56.727121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:56.728210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:56.738410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.739132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.739767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:56.740701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:56.754691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:56.755160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.099378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.111494 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab6a8f2d-57e0-4ff1-abb5-0100692726eb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1461 microversion: 2.1 time: 0.399197 Oct 04 18:03:57.112795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1459/3059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:56 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1461 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.132693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.134139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.145338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.145857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.146298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.147035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.147755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.153167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.170512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.182320 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5971a1a9-000a-44e5-92b2-2dd8a4142224 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.684184 Oct 04 18:03:57.182831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1601/3060] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:56 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.194121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.195068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.205656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.206194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.206638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.207380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.208233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.209598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.245494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.265337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.268534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.270518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf4808ad-7de0-4922-b99e-a7a760495937 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.156103 Oct 04 18:03:57.271183 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1460/3061] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:57.285868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1af660-5886-471d-90bc-571e7c5fb429", "name": "network-vif-plugged", "status": "completed", "tag": "4167cd20-b41e-4893-9599-c5d4e1072593"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:57.301692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.302229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.302662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.316718 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] Creating event network-vif-plugged:4167cd20-b41e-4893-9599-c5d4e1072593 for instance 9e1af660-5886-471d-90bc-571e7c5fb429 on n-h2-831194-21 Oct 04 18:03:57.324922 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-47115ec7-9913-43e8-9340-5855da1611cd req-f16bd273-ea6e-4a7e-927e-90aafe5b6b94 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051870 Oct 04 18:03:57.325782 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1461/3062] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:57.334195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.335125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.342346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.343033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.343823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.344739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.345368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.347227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.420446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.430760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.432221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.433399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-182a136a-0a03-407a-bd24-98fb4477155f tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1258 microversion: 2.26 time: 0.105683 Oct 04 18:03:57.434302 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1462/3063] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1258 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:57.439910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "87cc0608-a9ad-4830-ae2d-83cab81d2099"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:57.449772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.450555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.451194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.464452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] Creating event network-changed:87cc0608-a9ad-4830-ae2d-83cab81d2099 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:57.469399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e3fbc3bf-9b79-4866-b4a7-4886b1300797 req-665580c9-0d17-46f3-92fe-39602cf98113 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033535 Oct 04 18:03:57.470572 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1463/3064] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:57.601173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.602726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.608655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:57.610383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.611210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.611892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.613121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.613809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.615481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.623689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e53e61f7-1bdb-4320-ab3e-af8e105da26e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1500 microversion: 2.1 time: 0.439611 Oct 04 18:03:57.624887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1602/3065] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1500 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.647286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.648124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.657956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.659066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.659693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.660626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.661521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.662056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.909076 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30591827-a31b-482e-99d5-f480abdcd0d7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1614 microversion: 2.1 time: 0.437036 Oct 04 18:03:57.909691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1464/3066] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1614 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:57.921871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:57.926706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:57.938869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.939807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.940443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.941852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:57.942753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:57.943734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:57.981602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:03:58.141604 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5257be1-71c5-4057-b7bc-bcfca249a2f7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 204 len: 0 microversion: 2.1 time: 0.228841 Oct 04 18:03:58.151955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1465/3067] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:03:57 2022] DELETE /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:03:58.163614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.165272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.166051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.176872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.177660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.178500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.179233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.179730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.180344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.180476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.181891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.185800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52ac58ee-4536-4b0d-891f-2fdc81a7e622 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.556737 Oct 04 18:03:58.189069 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1603/3068] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:57 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:58.194073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:58.198890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.208035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.208547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.208995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.210448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.210995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.211439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.322878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8ed0f8ba9714428ea8ea710356a42cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb22f70dbad4d27a225050db6de2d97', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.323622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] flavor_id is None. Assuming migration. {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:03:58.324375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:03:58.522043 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fea90b0-c8ca-4ccf-8b7b-df1badff5a91 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39/action" status: 202 len: 0 microversion: 2.1 time: 0.331520 Oct 04 18:03:58.526276 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1604/3069] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:03:58 2022] POST /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39/action => generated 0 bytes in 336 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:03:58.532349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.533292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.540383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.540887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.541328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.542087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.542546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.542962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.573291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.606768 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e36e30a5-9c32-45f9-a6fd-51c88d7f8236 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.455430 Oct 04 18:03:58.607376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1466/3070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.639345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.642798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.652012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.653211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.653925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.655267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.655916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.656779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.824147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.838993 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd19e8b5-3707-4fd9-b6bb-d1020838d075 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.230170 Oct 04 18:03:58.839713 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1467/3071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:58.845534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.846237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.852852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.853476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.854094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.854912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.855461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.856409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.956022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.965738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.967590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:58.969359 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91f0cd1a-1e94-4462-b202-385468689a22 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1364 microversion: 2.57 time: 0.128431 Oct 04 18:03:58.970189 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1468/3072] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1364 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:58.986571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:58.988136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:58.995342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.995995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.997019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:58.997316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:58.997819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:58.998284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.068648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.080882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.080882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.082670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-73c15c1c-c856-49d7-b59d-028be30e8b59 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1314 microversion: 2.26 time: 0.111203 Oct 04 18:03:59.091697 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1469/3073] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1314 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:59.091697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.091697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.097646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.098111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.098595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.099472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.099971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.105093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.263858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.274466 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ea07b31-696b-44ea-bdf9-eab82b27cbdb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.190126 Oct 04 18:03:59.275487 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1470/3074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:59.282356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2d33090-3df5-4f8d-85f8-07c813b324b7", "tag": "9280031a-255e-4c6c-bcac-4bff37ca3c04"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:59.292467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.293042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.293521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.306525 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] Creating event network-changed:9280031a-255e-4c6c-bcac-4bff37ca3c04 for instance d2d33090-3df5-4f8d-85f8-07c813b324b7 on n-h1-831194-21 Oct 04 18:03:59.311924 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8b909b7f-97bd-428b-a5a9-86707670ca8f req-181d8b2c-904d-4543-b414-e505e0449433 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035055 Oct 04 18:03:59.314146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1471/3075] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:59.321281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.322141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.330952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.331572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.332167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.333010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.333479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.334016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.446905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.461079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49dba57c-ef91-453a-addf-259a03867c8f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1506 microversion: 2.1 time: 0.933194 Oct 04 18:03:59.481408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1605/3076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:58 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1506 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:03:59.544008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "a2f8dd19-ed34-4a31-90d2-26a82a09b9bb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:03:59.561191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.562572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.563865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.598921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] Creating event network-changed:a2f8dd19-ed34-4a31-90d2-26a82a09b9bb for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:03:59.607091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.607418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7c0597e4-3b57-4bd8-b323-4752a853b667 req-cb62da58-d487-4064-9fb0-3e86099fe3c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068094 Oct 04 18:03:59.608573 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1606/3077] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:03:59.626889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.630312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:03:59.633204 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e8960ee-19db-42c0-b8d9-71c8ec48bd7b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.317290 Oct 04 18:03:59.645933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.645933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.647435 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1472/3078] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:03:59.657098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.657098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.658581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.663005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.663511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.666296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.867006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:03:59.867912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:03:59.877542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.878278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.878906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:03:59.879813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:03:59.880467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:03:59.881107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.260094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.296316 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20169938-674e-4353-9652-4de722a19086 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.667347 Oct 04 18:04:00.331443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1607/3079] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:00.413053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.423133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.444677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.447656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.448302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.452347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.455947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.456493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.584154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.607317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b81a99bc-81c4-44aa-90be-58c0822151d6 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1370 microversion: 2.1 time: 0.748178 Oct 04 18:04:00.610742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1473/3080] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:03:59 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1370 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:00.620706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.623073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.639649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.642552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.643585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.645329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.646433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.647477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.765720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.791961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.798089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.801088 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-209c6066-0e23-4f4b-8115-ec592e15200a tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1382 microversion: 2.57 time: 0.466363 Oct 04 18:04:00.812654 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1608/3081] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1382 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:00.818384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.822409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:00.823067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:00.837918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.840867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.841098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:00.843138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.845858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.846231 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-104b0acd-d098-4907-8f1d-b2c45c0ecebd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1314 microversion: 2.26 time: 0.232448 Oct 04 18:04:00.848616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.849821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1474/3082] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:00.860529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.860529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.868657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0030322-1f4f-4e77-be74-15958267a148", "name": "network-vif-plugged", "status": "completed", "tag": "4ca8ccbc-b874-40d4-8446-525b7c519ee1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:00.948705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:00.950188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:00.957730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:00.989382 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] Creating event network-vif-plugged:4ca8ccbc-b874-40d4-8446-525b7c519ee1 for instance b0030322-1f4f-4e77-be74-15958267a148 on n-h2-831194-21 Oct 04 18:04:01.009736 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-45b55e6f-50e6-4ba1-bec9-db8c583385b7 req-7e89ee75-3c21-4ce8-88d9-2c1e71b3fc12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156939 Oct 04 18:04:01.010694 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1475/3083] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:01.020309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.025010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.039836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.040490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.042908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.044389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.047129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.048539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.107396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:01.355166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.372756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.374433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ad47a28-7505-4ee8-82b2-2ae53ecabed4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1506 microversion: 2.1 time: 0.361583 Oct 04 18:04:01.383060 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1476/3084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:01 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:01.386225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9445363d-3e20-404b-bdca-eb62655ab4cb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.572009 Oct 04 18:04:01.388733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1609/3085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:00 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:01.400508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.401984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.403526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.407114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.417104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.417643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.419376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.422056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.422903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.424839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.425099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.427407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.428892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.430445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:01.431370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:01.432181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:01.913358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.922077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.927350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.936830 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8d8eea0-207a-40cd-9bfc-fc42fe4a2373 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1317 microversion: 2.1 time: 0.543421 Oct 04 18:04:01.950234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:01.954451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0173842f-e449-443b-9ed7-c00ff423e7c6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.566651 Oct 04 18:04:01.956944 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1477/3087] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:01 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:01.970831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "59eb436f-b38a-4fd4-8470-fd6e976515df"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:01.973608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1610/3087] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:01 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:01.994277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:01.995020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:01.998794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:02.020620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.020620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.020620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.043880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.051062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.051694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.060327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] Creating event network-changed:59eb436f-b38a-4fd4-8470-fd6e976515df for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:02.067594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.071222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.074520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.082141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-53034e43-a5c2-4bfb-80df-7c3f4d0da8b0 req-fbcf00c6-15c7-4e75-91f3-bfb5960632ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119407 Oct 04 18:04:02.085490 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1478/3088] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:02.098792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.099521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.127178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.131156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.131702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.138572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.145654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.145654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.281685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.290614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.292886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.297106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b905ec0b-e581-40d6-8172-875e8b0f5775 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1370 microversion: 2.57 time: 0.207541 Oct 04 18:04:02.302040 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1479/3089] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:02.309309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.310164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.318577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.319535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.319535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.320225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.320683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.321116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.388303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.398197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.399663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.400844 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5183153-3b87-484e-879e-c272c561c340 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1332 microversion: 2.26 time: 0.096761 Oct 04 18:04:02.415819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1480/3090] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:02.415819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43970361-0367-4b47-89fd-5fd73d14c177", "name": "network-vif-deleted", "tag": "35960e20-d8f7-4001-a593-636e12bd0e15"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:02.444667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.445193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.445574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.479517 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] Creating event network-vif-deleted:35960e20-d8f7-4001-a593-636e12bd0e15 for instance 43970361-0367-4b47-89fd-5fd73d14c177 on n-h1-831194-21 Oct 04 18:04:02.486556 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-53afbf1c-89bb-49af-838a-c63600a5b692 req-1f80cb65-4c82-4243-bdc3-2354baa8ca86 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083146 Oct 04 18:04:02.487192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1481/3091] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:02.501982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.502745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.509816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.510341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.510958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.511686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.512143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.512575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.821215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.833466 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a509006c-813b-457a-99ea-8123a322d1dd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.339617 Oct 04 18:04:02.834532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1482/3092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:02.842976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.842976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.849299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.849805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.850486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.851203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.851668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.852210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.871362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:02.884094 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7aac83f-b1d1-4472-bd5d-adef862498cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1555 microversion: 2.1 time: 0.906330 Oct 04 18:04:02.899201 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1611/3093] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:01 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1555 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:02.911393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.912941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.914851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.916200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid 43970361-0367-4b47-89fd-5fd73d14c177 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:02.920248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:02.923300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:02.937333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.940387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.940387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:02.941226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:02.941699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:02.942173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.045253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.057208 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cab845f-de50-4665-aecb-ee1831dbf73b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1309 microversion: 2.1 time: 0.220775 Oct 04 18:04:03.072684 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1483/3094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:03.079472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.080163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.088757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.089261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.089707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.090462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.090922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.092111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.184069 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04d1432d-9e95-469d-bbc0-9870c8f54f73 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274566 Oct 04 18:04:03.185530 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1612/3095] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:04:02 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:03.193338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.194518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.208769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.210823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.211944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.216308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.216308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.216308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.429787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.441661 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1fbf8d4-8951-4768-8fc8-dea991c322b9 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1505 microversion: 2.1 time: 0.367543 Oct 04 18:04:03.446782 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1484/3096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:03.469753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d33090-3df5-4f8d-85f8-07c813b324b7", "name": "network-vif-plugged", "status": "completed", "tag": "9280031a-255e-4c6c-bcac-4bff37ca3c04"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:03.481244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.481583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.482076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.496368 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] Creating event network-vif-plugged:9280031a-255e-4c6c-bcac-4bff37ca3c04 for instance d2d33090-3df5-4f8d-85f8-07c813b324b7 on n-h1-831194-21 Oct 04 18:04:03.503470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a6963e8b-5660-40ee-92b6-62c3b41dc480 req-58560520-ed8e-4678-bfdf-af7ca2a9ad15 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058285 Oct 04 18:04:03.504097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1485/3097] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:03.510812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.511073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.518287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.518791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.519861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.520012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.520408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.520841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.615831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.636498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.640596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.642759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7bdf226b-5cfa-4eef-81e1-47af92de10ff tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1355 microversion: 2.57 time: 0.137182 Oct 04 18:04:03.643715 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1486/3098] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1355 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:03.648822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.649461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.656146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.657227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.657691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.658723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.659102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.659665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.711833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.735257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.738369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:03.746391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54da8a20-2b17-430c-a813-84d5b5a676f6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.559149 Oct 04 18:04:03.747522 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1613/3099] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:03.754666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:03.755726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:03.762438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.763281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.764519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.767732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:03.768673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:03.769352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:03.820112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:04.176803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.187205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.190376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.191921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d73692b-2038-4e98-9221-5985fa902b15 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.547134 Oct 04 18:04:04.207091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1487/3100] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:04.222384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.223243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.230483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.231205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.237031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.238031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.238506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.239127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.300520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:04.464938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cab1e561-477b-49c9-90f1-fa4723d7b4b3 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "DELETE /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 204 len: 0 microversion: 2.57 time: 0.255978 Oct 04 18:04:04.466434 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1488/3101] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:04:04 2022] DELETE /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:04.477284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.478965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.490171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.491228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.491865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.493129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.493766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.494381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.611285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.629164 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7424074-b793-4190-bf47-0a7a3416bc25 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1317 microversion: 2.1 time: 0.880020 Oct 04 18:04:04.629997 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1614/3102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:03 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1317 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:04.634704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.635317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.657015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.657529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.658002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.658731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.659183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.659626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.731316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.732245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.733041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.733913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid 43970361-0367-4b47-89fd-5fd73d14c177 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:04.824251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.835475 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebdf2d41-f25f-4532-95ce-56339819f8f8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.367549 Oct 04 18:04:04.836520 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1489/3103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:04.843492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:04.845130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:04.853800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.854676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.855406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.856618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:04.857468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:04.858165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:04.917409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:04.958283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32b8db92-dca0-49ea-ad59-32f28737d52f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 200 len: 1309 microversion: 2.1 time: 0.327031 Oct 04 18:04:04.958878 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1615/3104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 1309 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:04.997921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.001195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.019740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.020295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.020806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.021536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.023193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.023634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.024137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.052924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.055419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.060000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d71deecf-4cd4-4c4e-9576-8c6e9358aa11 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1361 microversion: 2.57 time: 0.221329 Oct 04 18:04:05.061398 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1490/3105] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:05.232426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.233280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.257017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.257302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.257763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.258757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.260610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.271247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.592716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.605948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.607533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.609753 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5340f0d8-4571-440d-9600-35eea73d2d42 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.383233 Oct 04 18:04:05.610436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1491/3106] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:05.653087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.653718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.660696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.661198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.661639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.662382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.662843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.663275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.856701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.901770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:05.910326 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-790afa2e-e918-4884-89ec-092bb0616f2c tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1506 microversion: 2.1 time: 0.261132 Oct 04 18:04:05.910919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1492/3107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:05.922704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1663ed-47a1-406a-9c56-b5df10753a53", "tag": "df1ef72e-510d-4066-8542-faae46881999"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:05.928981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.936969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.937460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.937930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.940992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:05.951615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] Creating event network-changed:df1ef72e-510d-4066-8542-faae46881999 for instance ec1663ed-47a1-406a-9c56-b5df10753a53 on n-h1-831194-21 Oct 04 18:04:05.956789 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-0acd88b2-1a10-4af9-aa8a-43a2ffe2c529 req-b8cc39ad-447b-440f-b3cc-7ac5409baaea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044669 Oct 04 18:04:05.958656 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1493/3108] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:05.965133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:05.965636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:05.975366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.975895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.976348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:05.977065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:05.977530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:05.978115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.127638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.136370 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4dc28fa-160a-45e8-989b-d9920c17654b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.176410 Oct 04 18:04:06.137008 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1494/3109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:05 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:06.142815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.143331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.149357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.149877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.150545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.151255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.151732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.152159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.179925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:06.262029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26563fc6-a21d-4ea0-a6b0-7065bd73e574 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 204 len: 0 microversion: 2.1 time: 0.123455 Oct 04 18:04:06.266385 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1495/3110] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:06 2022] DELETE /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:06.269454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.270249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.276238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.276805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.277207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.277953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.278456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.278926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.293910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 HTTP/1.1 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '43970361-0367-4b47-89fd-5fd73d14c177'} Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:06.295430 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-edb93dbf-e332-4173-827c-ee33bbf0534d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 404 len: 111 microversion: 2.1 time: 0.033600 Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1496/3111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.310801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.316234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.316734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.317174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.317929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.318582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.318958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.400534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.409555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.411058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.411429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.412946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4985792-aef6-4389-bfbe-7953fdb012e2 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1361 microversion: 2.57 time: 0.113185 Oct 04 18:04:06.413974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1497/3112] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1361 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:06.422574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.424307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.425765 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98a9ecd7-423b-44b7-b955-48e0ec6df1d6 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 1.440314 Oct 04 18:04:06.427052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1616/3113] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:04 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:06.428940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.429472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.432556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-387e3bf2-8fdc-4f78-8f5a-1a15541c863f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: .version_select at 0x7fbdc1e48f70>, body: {"keypair": {"name": "tempest-key-647752184", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrNGgecI+SzXr5kV06Kwuwux5EHjIhmuC4EtVI6P20PkVzEWYY4sgEuG3QMVziDwt7iOu2l7pfHbwx/aAdi8YtoWDdZrjyCoTuNqwgr44bN0okBM/5wURSM0yLVaCSeyQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:06.436731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.439128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.439615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.441494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.442150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.442766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.453316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-387e3bf2-8fdc-4f78-8f5a-1a15541c863f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:06.459626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-387e3bf2-8fdc-4f78-8f5a-1a15541c863f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:06.472733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:06.487807 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-387e3bf2-8fdc-4f78-8f5a-1a15541c863f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.059451 Oct 04 18:04:06.488698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1617/3114] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:04:06 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:06.499851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97e47175-ccca-4a8f-b347-5cf87f1efdd3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '.version_select at 0x7fbdc1e78040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.504019 n-d-831194-21 devstack@n-api.service[128849]: WARNING oslo_db.sqlalchemy.utils [None req-97e47175-ccca-4a8f-b347-5cf87f1efdd3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 04 18:04:06.510548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97e47175-ccca-4a8f-b347-5cf87f1efdd3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.015037 Oct 04 18:04:06.513580 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1618/3115] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:06.603932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b4556fb-d670-46b0-ad61-9aa7cc86506d tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 204 len: 0 microversion: 2.1 time: 0.184339 Oct 04 18:04:06.604970 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1498/3116] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:06 2022] DELETE /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:06.617373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.618413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.627004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.627717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.628198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.629135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.629615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.632162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.654495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:06.655526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:06.664499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.665331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.666016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.667957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:06.668701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:06.669377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:06.983340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:06.993073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-67ed4cb4-2c11-4ab2-96da-e1ba5fc5ee08 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1512 microversion: 2.1 time: 0.379766 Oct 04 18:04:07.006527 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1619/3117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1512 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:07.016894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1985307363", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-key-647752184", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.083414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:07.349483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.362620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.363623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.366973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8ed043f-8501-4f7d-a585-f7c937433aa0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.719611 Oct 04 18:04:07.370463 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1499/3118] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:06 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:07.376257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.381398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:07.393497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.394038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.394488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.398006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.401339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.407260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.614855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:07.615348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:07.615738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:07.616769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:07.617355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:07.627934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.628844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.630997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.631759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.632393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.632826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.651302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:07.656642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.658095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:07.671382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:07.671603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19c9ddee-6e95-4cfb-b30c-a2171d3cd11e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1470 microversion: 2.1 time: 0.299505 Oct 04 18:04:07.674213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:07.681657 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1500/3119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:07.693707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e1af660-5886-471d-90bc-571e7c5fb429", "tag": "4167cd20-b41e-4893-9599-c5d4e1072593"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:07.708813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.709733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.710500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.724632 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] Creating event network-changed:4167cd20-b41e-4893-9599-c5d4e1072593 for instance 9e1af660-5886-471d-90bc-571e7c5fb429 on n-h2-831194-21 Oct 04 18:04:07.729773 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af2072d2-2f19-4e31-89a6-31c5b80c6fe4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721972 Oct 04 18:04:07.737536 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1620/3120] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:07.743295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.744284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:07.744442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-45db4590-6fdc-45d8-bada-dbc9b4400f67 req-8bc11356-2be2-47c2-943c-52eb47c0e8d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060001 Oct 04 18:04:07.747707 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1501/3121] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:07.758949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.759928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.760634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.761768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.762501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.763151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.766420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.767245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:07.776188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.776701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.777336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.778341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:07.779551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:07.780152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:07.849029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.860473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.862054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57cb5088d30c4608b63648d5d33311ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36d1e69063524cc588fe00f91347176f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.863329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-933d62c8-70d7-40c7-a66b-dc6f8ebbe95c tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 200 len: 1361 microversion: 2.57 time: 0.124303 Oct 04 18:04:07.864260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1621/3122] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 1361 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:07.881752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce39983e-7bf8-4f78-bf34-6679e8aa951c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:07.883224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce39983e-7bf8-4f78-bf34-6679e8aa951c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:07.967501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce39983e-7bf8-4f78-bf34-6679e8aa951c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:07.978487 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce39983e-7bf8-4f78-bf34-6679e8aa951c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1228 microversion: 2.1 time: 0.112891 Oct 04 18:04:07.994591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1622/3123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1228 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:08.021407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.022301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.036327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.037484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.038222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.039689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.040407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.040943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.389498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.407675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.414774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.419481 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cce6f978-705a-4095-99fb-d2cd2f54195a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.666565 Oct 04 18:04:08.419986 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1502/3124] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:07 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:08.428488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.433224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.447850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.448755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.449426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.450437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.458645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.459787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.904859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:08.922489 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4055c8af-b37b-424c-b185-a22f09384632 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1512 microversion: 2.1 time: 0.906754 Oct 04 18:04:08.925118 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1623/3125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1512 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:08.932418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:08.933384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:08.944345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.944956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.945479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:08.946311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:08.949146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:08.949728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.395965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.413725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.417374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.419077 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d27dba5-60c6-4847-8167-930ddf8df8bd tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.996089 Oct 04 18:04:09.419899 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1503/3126] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:09.431301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.433568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] [instance: 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.446819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.448489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.450361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.451763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.453954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.454806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.472253 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] HTTP exception thrown: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Request method failure captured: Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced HTTP/1.1 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVyhIAl-mkTgWjy7CNkwHF5jZQZmo4gxoxGS6U026wFT1jBvkVVzIRGH-0wWrZIL5-ijqAd5Ncs5AXVcSVelmAFz7qfR4XmNmj4USyqV10Qtj0eNOvKp0cmJ-TiOy3lMRPnwnQpLdqlt-qVtyZi6YYxY-7gqBRrnkWArNtkc7gWHiM Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.57 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 36d1e69063524cc588fe00f91347176f Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerShowV257Test-1244818856 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/36d1e69063524cc588fe00f91347176f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/36d1e69063524cc588fe00f91347176f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/36d1e69063524cc588fe00f91347176f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_36d1e69063524cc588fe00f91347176f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerShowV257Test-1244818856 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 36d1e69063524cc588fe00f91347176f Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerShowV257Test-1244818856 Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerShowV257Test-1244818856-project Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 57cb5088d30c4608b63648d5d33311ac Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerShowV257Test-1244818856-project Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '935971b6-14fa-42f2-8ab9-1bbfe4dd5ced'} Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:09.474187 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:09.479518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] Returning 404 to user: Instance 935971b6-14fa-42f2-8ab9-1bbfe4dd5ced could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:09.484442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-938334b7-117c-4834-9229-6a708eec8b50 tempest-ServerShowV257Test-1244818856 tempest-ServerShowV257Test-1244818856-project] 10.222.0.42 "GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced" status: 404 len: 111 microversion: 2.57 time: 0.061908 Oct 04 18:04:09.485747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1504/3127] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/935971b6-14fa-42f2-8ab9-1bbfe4dd5ced => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:09.495629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.496707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.506397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.507273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.508069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.509029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.509724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.510479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.642175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.659883 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63457c43-78ac-41be-a4a8-57da6d12c218 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1280 microversion: 2.1 time: 0.171701 Oct 04 18:04:09.660653 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1505/3128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1280 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:09.677303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.678484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.693228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.694832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.695847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.697510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.698879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.700018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.854968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:09.872359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5424c98-b9b9-4900-878f-b0a1e05bfdb4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.944671 Oct 04 18:04:09.873616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1624/3129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:08 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:09.950307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:09.951982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:09.964610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.965145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.965599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:09.966368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:09.972432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:09.972934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.191308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.200552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5183f4dc-bbe2-442f-84c5-65868cba7856 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1470 microversion: 2.1 time: 0.255507 Oct 04 18:04:10.214213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1625/3130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1470 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:10.384488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2d33090-3df5-4f8d-85f8-07c813b324b7", "name": "network-vif-deleted", "tag": "9280031a-255e-4c6c-bcac-4bff37ca3c04"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:10.403582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.404929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.408339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.435085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] Creating event network-vif-deleted:9280031a-255e-4c6c-bcac-4bff37ca3c04 for instance d2d33090-3df5-4f8d-85f8-07c813b324b7 on n-h1-831194-21 Oct 04 18:04:10.442553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d5c582da-5a5c-4e2a-8fee-f8ade89b135d req-c84054ec-ad35-4ee4-94ec-83e9a4f9e3b1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062538 Oct 04 18:04:10.443544 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1626/3131] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:10.483621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.486604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:10.488847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:10.500047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.523308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.524069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.525578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.532205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.533146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.568582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.594329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.596947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.605505 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6168cab-01ac-47ad-b353-9e98e184832f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.943289 Oct 04 18:04:10.629579 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1506/3132] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:09 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:10.691040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.692391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:10.723420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.728972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.728972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.729517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.734029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.735146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.956543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.960106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.967972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1e7a5a5-f544-4e0b-8436-4cd903ba3edf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1286 microversion: 2.1 time: 0.286141 Oct 04 18:04:10.968726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.969606 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1507/3133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:10 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:10.973262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:10.974558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e0a0781-2eba-4247-9d2a-6cf44c9eda20 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.511756 Oct 04 18:04:10.981340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:10.982198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:10.986437 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1627/3134] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:10 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:10.993347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.994173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.994620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:10.995333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:10.995795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:10.996339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.230593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:11.231511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:11.240807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.241307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.242996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.243730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.244201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.244629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.307658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.308153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.308607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.309057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lazy-loading 'fault' on Instance uuid d2d33090-3df5-4f8d-85f8-07c813b324b7 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:11.395494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.418613 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ff49018-50bd-4fc5-b666-8a437714f6ac tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 200 len: 1307 microversion: 2.1 time: 0.192218 Oct 04 18:04:11.424234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1628/3135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:11 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 1307 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:11.534598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0030322-1f4f-4e77-be74-15958267a148", "name": "network-vif-deleted", "tag": "4ca8ccbc-b874-40d4-8446-525b7c519ee1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:11.565919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.568336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.569538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.590791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] Creating event network-vif-deleted:4ca8ccbc-b874-40d4-8446-525b7c519ee1 for instance b0030322-1f4f-4e77-be74-15958267a148 on n-h2-831194-21 Oct 04 18:04:11.600911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ba1127cc-7862-48ed-a4fd-78d7671b8551 req-06e172ce-d946-4bb2-a274-eb07d76a3efd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075717 Oct 04 18:04:11.602637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1629/3136] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:11.639102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:11.640334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:11.652991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.653640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.654206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.655055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:11.655843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:11.672995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:11.787709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:11.810747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2fbe9c2a-d816-4387-af25-27b90a95e431 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.834804 Oct 04 18:04:11.811427 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1508/3137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:10 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:11.998766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.000971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.010656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.011725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.012655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.013939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.014096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.016843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.017680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.032359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.033746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.034986 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89ba3508-7c96-4716-8ad0-3a646c7313f2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.401988 Oct 04 18:04:12.043063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:12.045990 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1630/3138] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:11 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:12.051329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.051961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.066885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.067663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.068278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.069189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.069810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.070561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.225501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.237082 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b758e5a-a5aa-4d52-ba7d-f22f716f5f39 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1286 microversion: 2.1 time: 0.244526 Oct 04 18:04:12.238982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1509/3139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:11 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:12.260564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.270664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.272479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.273664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b23e0802-29f7-4f2d-a9c1-4aa31b2de90d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.226346 Oct 04 18:04:12.288666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1631/3140] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:12.450231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.451228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: d2d33090-3df5-4f8d-85f8-07c813b324b7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.457655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.458403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.459037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.459904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.460524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.461110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.475764 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] HTTP exception thrown: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Request method failure captured: Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 HTTP/1.1 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVKGo6BGCsQ6MR4sQ8vVtKDIwG5wt_Qtzx9kProTIHkBVqNLbDug49Eu6LSUU6v92VReEnG7WvMrJqMtsh5hV7W3HinY8fQiFbHcjSokgyDIfO1RNaJvIYzXfAKeMQaCgjsv08S0ocjhxBEm3rAj4Eh7jRgh5MASOAM2wyXcj5kIKM Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 95ca9284739c4b009d70fdd5e9669bfa Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 95ca9284739c4b009d70fdd5e9669bfa Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-MultipleCreateTestJSON-1637312603-project Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 06cc4cee636f499689760ecd7625427b Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-MultipleCreateTestJSON-1637312603-project Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd2d33090-3df5-4f8d-85f8-07c813b324b7'} Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:12.477761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. Oct 04 18:04:12.482904 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:12.485744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Returning 404 to user: Instance d2d33090-3df5-4f8d-85f8-07c813b324b7 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:12.487401 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6add6b4-eaaf-41f7-933c-6b1ecd8f7e7f tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7" status: 404 len: 111 microversion: 2.1 time: 0.043075 Oct 04 18:04:12.488899 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1510/3141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/d2d33090-3df5-4f8d-85f8-07c813b324b7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:12.497371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.499683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.508891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.509683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.510556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.511871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.514459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.515848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.583174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.585369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.586723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.587824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lazy-loading 'fault' on Instance uuid b0030322-1f4f-4e77-be74-15958267a148 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:12.667976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4cee636f499689760ecd7625427b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95ca9284739c4b009d70fdd5e9669bfa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:12.679995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dcaa99c0-0d08-4ba1-b957-4b8e37642fc8 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 200 len: 1307 microversion: 2.1 time: 0.187039 Oct 04 18:04:12.695556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1632/3142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 1307 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:12.836222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:12.837020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:12.851412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.852137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.852852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:12.853855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:12.854554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:12.855215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.064919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.066197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.072981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.073908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.074514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.075405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.075861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.076447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.145172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.165398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-029be816-df4e-428a-99cb-56e7cda1041f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.333228 Oct 04 18:04:13.177853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1511/3143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:12 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:13.268831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.271746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.283056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.283931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.284685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.285674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.286887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.287446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.554080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.588176 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd0bff92-340b-4726-b565-5e751035402c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.323908 Oct 04 18:04:13.588538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.594351 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1512/3144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:13.606794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.607432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.610448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.613506 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-315ab86d-1cf4-4f5d-b818-d740f1c86b28 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.552502 Oct 04 18:04:13.616883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.621177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1633/3145] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:13.628350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.631099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.631717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.634700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.636545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.637814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.706778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:13.707569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] [instance: b0030322-1f4f-4e77-be74-15958267a148] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:13.713967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.714703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.715307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.716216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:13.717390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:13.718721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:13.738304 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] HTTP exception thrown: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Request method failure captured: Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 HTTP/1.1 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVKGo6BGCsQ6MR4sQ8vVtKDIwG5wt_Qtzx9kProTIHkBVqNLbDug49Eu6LSUU6v92VReEnG7WvMrJqMtsh5hV7W3HinY8fQiFbHcjSokgyDIfO1RNaJvIYzXfAKeMQaCgjsv08S0ocjhxBEm3rAj4Eh7jRgh5MASOAM2wyXcj5kIKM Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 95ca9284739c4b009d70fdd5e9669bfa Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_95ca9284739c4b009d70fdd5e9669bfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 95ca9284739c4b009d70fdd5e9669bfa Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1637312603 Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MultipleCreateTestJSON-1637312603-project Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 06cc4cee636f499689760ecd7625427b Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MultipleCreateTestJSON-1637312603-project Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b0030322-1f4f-4e77-be74-15958267a148'} Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:13.740408 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. Oct 04 18:04:13.745509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:13.747260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] Returning 404 to user: Instance b0030322-1f4f-4e77-be74-15958267a148 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:13.748627 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d2a76aa-8ebc-40dc-8379-106f635e6f43 tempest-MultipleCreateTestJSON-1637312603 tempest-MultipleCreateTestJSON-1637312603-project] 10.222.0.42 "GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148" status: 404 len: 111 microversion: 2.1 time: 0.046260 Oct 04 18:04:13.750647 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1634/3146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/b0030322-1f4f-4e77-be74-15958267a148 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:04:13.913273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.936119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.939222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:13.940951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebb05b0c-f3d3-4f16-b570-3e8826c37c4c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.344842 Oct 04 18:04:13.963814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1513/3147] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:13 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:13.994581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "502af315-9bad-4ae0-bb36-68615f5ba18a", "tag": "96c92400-ca50-42cd-9fe7-4be2e82e4012"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:14.018510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.019124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.022152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.043084 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] Creating event network-changed:96c92400-ca50-42cd-9fe7-4be2e82e4012 for instance 502af315-9bad-4ae0-bb36-68615f5ba18a on n-h1-831194-21 Oct 04 18:04:14.050816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-72ac301a-08ce-4c60-ac3e-10a1e7ca3eab req-c8765f34-9420-46d9-a523-66a2552567db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060566 Oct 04 18:04:14.052600 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1635/3148] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:14.197558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.198524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.209071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.209684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.210273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.211113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.211874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.213502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.565124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:14.573448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d3942fc-4aeb-46c4-9258-af946a26ee32 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.387766 Oct 04 18:04:14.585796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1514/3149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:14.614666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.615676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.622394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.622894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.623563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.624984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.625756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.626387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.649270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:14.652370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:14.653008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:14.660082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.660832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.661580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:14.662868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:14.663559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:14.664166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.009423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.024757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.026354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.027732 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dfa32237-077b-4d02-b343-fda18cbf437f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.380085 Oct 04 18:04:15.030171 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1515/3150] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:15.048647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:15.049666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:15.056606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.057438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.058232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.059147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.059900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.060493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.230391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.241038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.242885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.244964 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ccaf92f2-6826-43ee-b84c-108d50664005 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.212743 Oct 04 18:04:15.246397 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1516/3151] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:15 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:15.382189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.396980 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf93b6b1-9ee6-4b63-b6c0-5b7435f6ac8d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.787339 Oct 04 18:04:15.398316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1636/3152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:14 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:15.597532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:15.598647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:15.605570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.606191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.606697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.607469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:15.608132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:15.608793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:15.808747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:15.838442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58a5f356-2789-4716-a435-1e1c125a35c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.245049 Oct 04 18:04:15.840313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1517/3153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:15 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:16.065815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.066527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.083343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.084187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.085521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.086476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.087101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.087678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.098379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1663ed-47a1-406a-9c56-b5df10753a53", "name": "network-vif-plugged", "status": "completed", "tag": "df1ef72e-510d-4066-8542-faae46881999"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:16.107928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:16.120580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.121274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.122985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.158719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] Creating event network-vif-plugged:df1ef72e-510d-4066-8542-faae46881999 for instance ec1663ed-47a1-406a-9c56-b5df10753a53 on n-h1-831194-21 Oct 04 18:04:16.168706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-169cb672-bc2a-4fe7-b230-9d12c95ad72d req-d505db2e-388b-40ad-857e-b78303a2ab18 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075690 Oct 04 18:04:16.170241 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1518/3154] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:16.274927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.275916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.289966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.291434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.292468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.293528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.294842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.295551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.641180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.651895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.653370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.654577 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a3d098c-3b47-42e4-a95d-2d2a98d8c29e tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1362 microversion: 2.26 time: 0.384843 Oct 04 18:04:16.655142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1519/3155] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:16.663277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.663277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.667263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.667582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.668028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.668634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.669424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.670426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.670983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.688736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.690346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.691798 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7005bf00-dc4e-4c21-8d99-97f9cdb06610 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.631004 Oct 04 18:04:16.694427 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1637/3156] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:16.865538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:16.867172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:16.877212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.878773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.879399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.880305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:16.880928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:16.881527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:16.897909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:16.908900 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-09d2e232-0fd8-4e52-bf3c-1c6b818770ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.252615 Oct 04 18:04:16.909753 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1520/3157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.258500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.269626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-442985eb-5954-431c-b25f-de2c862e6798 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.407829 Oct 04 18:04:17.289025 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1638/3158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:16 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:17.680996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.681637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.695785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.696493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.697164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.698318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.698955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.699599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.723354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.724650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.728614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:17.738686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.741141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.742697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.744991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.745712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.748233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.926187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.938943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.940811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:17.942226 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd98b0b7-b397-4f96-8ed1-8c024add629d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1546 microversion: 2.26 time: 0.265272 Oct 04 18:04:17.943671 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1521/3159] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:17.949475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:17.950741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:17.960390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.961426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.962157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.963513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:17.964176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:17.964805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:17.973495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:18.160909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.170645 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8fa85e9c-f7d3-428a-a33a-e77f77fbff9f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.225486 Oct 04 18:04:18.182495 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1522/3160] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.196415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdc1db21f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.208808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.210145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.210760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.211665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.219134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.219962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.220363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.221470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.221787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.222359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.261051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.261051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.261413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.280107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.282211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.283161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.344971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:18.404266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c861e1f-14a9-4aeb-afeb-b0210e381892 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-657627277" status: 201 len: 0 microversion: 2.26 time: 0.220379 Oct 04 18:04:18.410008 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1523/3161] 10.222.0.42 () {62 vars in 1377 bytes} [Tue Oct 4 18:04:18 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-657627277 => generated 0 bytes in 227 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:04:18.416874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.417527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.427192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.428264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.428997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.429929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.430495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.431030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.501485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.511721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.513218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.514451 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-914e2d64-2374-40a7-bf4f-257b5eed625a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.795813 Oct 04 18:04:18.518133 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1639/3162] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:17 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:18.528362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-260aa2d0-7154-4c9e-a096-101cdb9c888a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd7a2940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.541023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260aa2d0-7154-4c9e-a096-101cdb9c888a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.542221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260aa2d0-7154-4c9e-a096-101cdb9c888a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.542897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260aa2d0-7154-4c9e-a096-101cdb9c888a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.567305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-260aa2d0-7154-4c9e-a096-101cdb9c888a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-657627277" status: 204 len: 0 microversion: 2.26 time: 0.045263 Oct 04 18:04:18.568652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1640/3163] 10.222.0.42 () {60 vars in 1358 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-657627277 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:18.581888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd023af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.591455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.592579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.593406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.594193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.602393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.603154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.603799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.604936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.605590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.606080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.608179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:18.622003 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1cea8118-c257-4ef3-a236-e6f6f7a6c220 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.208903 Oct 04 18:04:18.630529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1524/3164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.633228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.634077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.635111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.656858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:18.674656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c78b6eef-01a4-4ab9-8869-e03c6468680d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 204 len: 0 microversion: 2.26 time: 0.101421 Oct 04 18:04:18.680165 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1641/3165] 10.222.0.42 () {60 vars in 1295 bytes} [Tue Oct 4 18:04:18 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:18.684739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-65c66f9c-ff1c-4aba-be5b-523a010be409 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd7b61f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.696063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65c66f9c-ff1c-4aba-be5b-523a010be409 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.696870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65c66f9c-ff1c-4aba-be5b-523a010be409 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.697393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65c66f9c-ff1c-4aba-be5b-523a010be409 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.701580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:18.711842 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-65c66f9c-ff1c-4aba-be5b-523a010be409 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 12 microversion: 2.26 time: 0.031066 Oct 04 18:04:18.712466 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1525/3166] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 12 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.724948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd1b5c10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.737669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.738441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.738867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.739571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.747241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.748035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.749954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.751208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.751855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.752288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.783117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.783605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.784066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.794320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.794795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.795225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.819521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:18.838314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94084e8a-7359-4ccd-bf54-b30b02b98505 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1663417348" status: 201 len: 0 microversion: 2.26 time: 0.117833 Oct 04 18:04:18.839312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1642/3167] 10.222.0.42 () {62 vars in 1380 bytes} [Tue Oct 4 18:04:18 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1663417348 => generated 0 bytes in 119 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:04:18.851623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c53590ef-1a2b-4520-a75e-e331cd8c15c8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16eee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.864579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c53590ef-1a2b-4520-a75e-e331cd8c15c8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.865074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c53590ef-1a2b-4520-a75e-e331cd8c15c8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.865517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c53590ef-1a2b-4520-a75e-e331cd8c15c8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.876664 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c53590ef-1a2b-4520-a75e-e331cd8c15c8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 36 microversion: 2.26 time: 0.030518 Oct 04 18:04:18.877327 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1526/3168] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 18:04:18 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 36 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:18.888831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd39a3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:18.898711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.899611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.900069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.900573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:18.907537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.908038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.908490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.909212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.909992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.910402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.956604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:18.957550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:18.958133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:18.999330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:19.019973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-771fe25b-d9be-4d38-a687-5c50c232b3e9 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1663417348" status: 204 len: 0 microversion: 2.26 time: 0.135859 Oct 04 18:04:19.020619 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1643/3169] 10.222.0.42 () {60 vars in 1364 bytes} [Tue Oct 4 18:04:18 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1663417348 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:19.029515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-718761dd-dfa5-4bd7-9ee9-f69c22203ee0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16e4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.040435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-718761dd-dfa5-4bd7-9ee9-f69c22203ee0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.041426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-718761dd-dfa5-4bd7-9ee9-f69c22203ee0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.042123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-718761dd-dfa5-4bd7-9ee9-f69c22203ee0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.053249 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-718761dd-dfa5-4bd7-9ee9-f69c22203ee0 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 12 microversion: 2.26 time: 0.027852 Oct 04 18:04:19.059919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1527/3170] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:19.066621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd1b5a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.083750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.084821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.086020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.086718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.095155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.096087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.096700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.097607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.098325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.098929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.141977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.142824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.143445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.158308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:19.176707 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fa4aa10-4342-40dd-bbb2-772c14fd7216 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 204 len: 0 microversion: 2.26 time: 0.115508 Oct 04 18:04:19.178270 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1644/3171] 10.222.0.42 () {60 vars in 1295 bytes} [Tue Oct 4 18:04:19 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:19.187872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16ea60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.200734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.201367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.201944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.203239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.203822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.205012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.210787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.211386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.212088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.212709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.213714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.213869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.225980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.226908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.228860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.233328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.237043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.239338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.245124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.245726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.246291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.265625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.266645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.267427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.321272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:19.356976 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0fb60af5-745e-480c-918f-cd9b38a4a964 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1834854154" status: 201 len: 0 microversion: 2.26 time: 0.173004 Oct 04 18:04:19.362067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1528/3172] 10.222.0.42 () {62 vars in 1380 bytes} [Tue Oct 4 18:04:19 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1834854154 => generated 0 bytes in 179 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:04:19.386692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdc1d575e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.399951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.400727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.401241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.401803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.410005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.410692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.411212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.412010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.412542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.413419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.459499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.460107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.460631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.490463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.491144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.491663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.528984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:19.547022 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13d040a6-2418-42e8-8804-4e6c22a7ef34 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1077356580" status: 201 len: 0 microversion: 2.26 time: 0.178325 Oct 04 18:04:19.554216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1529/3173] 10.222.0.42 () {62 vars in 1380 bytes} [Tue Oct 4 18:04:19 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-1077356580 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 04 18:04:19.560827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.562323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.579546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.579971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.580425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.588089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.588835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.589191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.592457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.605571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25497ad0-eb88-4067-936c-af972c6ab707 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.408585 Oct 04 18:04:19.607526 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1645/3174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:19.629456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdc1e4cdc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.644150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.648236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.649973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.650743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.665230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.665723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.666193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.666898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.670098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.670809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.717069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.718352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.720792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.744390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:19.767076 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72b5072e-5f8b-47fc-b01c-59b42d6dba92 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 204 len: 0 microversion: 2.26 time: 0.157059 Oct 04 18:04:19.768608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1646/3175] 10.222.0.42 () {60 vars in 1295 bytes} [Tue Oct 4 18:04:19 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:19.775604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:19.776507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:19.783911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.784809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.785878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.786914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:19.787587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:19.788229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:19.951653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.973558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.977521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:19.979618 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47e7f9f8-60cc-472a-a27a-9b9ef9cc4d3d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.428420 Oct 04 18:04:19.982617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1530/3176] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:19.991567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72ff3cdc-c6ae-480f-89fb-2f1809ae31e8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16e040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.006185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72ff3cdc-c6ae-480f-89fb-2f1809ae31e8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.007446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72ff3cdc-c6ae-480f-89fb-2f1809ae31e8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.008585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72ff3cdc-c6ae-480f-89fb-2f1809ae31e8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.022427 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72ff3cdc-c6ae-480f-89fb-2f1809ae31e8 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 12 microversion: 2.26 time: 0.037996 Oct 04 18:04:20.029696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1531/3177] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 12 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.037368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16b0d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.051648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.052554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.053263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.054370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.069182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.070703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.071598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.072990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.073719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.075699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.112557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.113574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.114723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.133220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:20.152749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-956666c3-9caf-47ab-8371-c76c380bc595 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 204 len: 0 microversion: 2.26 time: 0.120619 Oct 04 18:04:20.154635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1532/3178] 10.222.0.42 () {60 vars in 1295 bytes} [Tue Oct 4 18:04:20 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:20.166893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd16e550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.178543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.179422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.180206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.180955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.189019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.189871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.190589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.191538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.192224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.193261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.239985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.240926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.241651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.256811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.261475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.263453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.365775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:20.408816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b176be57-92a0-4e08-82aa-05d362568e57 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-762044682" status: 201 len: 0 microversion: 2.26 time: 0.246176 Oct 04 18:04:20.414286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1533/3179] 10.222.0.42 () {62 vars in 1377 bytes} [Tue Oct 4 18:04:20 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-762044682 => generated 0 bytes in 254 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:04:20.420174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502af315-9bad-4ae0-bb36-68615f5ba18a", "name": "network-vif-plugged", "status": "completed", "tag": "96c92400-ca50-42cd-9fe7-4be2e82e4012"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:20.434659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:20.434909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.435273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.435713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.444587 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fabcbfd7-967d-497c-ad97-da95dac0faa6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.674355 Oct 04 18:04:20.447355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1647/3180] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:19 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.457353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdc1d9bc10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.463753 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] Creating event network-vif-plugged:96c92400-ca50-42cd-9fe7-4be2e82e4012 for instance 502af315-9bad-4ae0-bb36-68615f5ba18a on n-h1-831194-21 Oct 04 18:04:20.478934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8a8de929-c0c0-4b0e-afd0-320fb7bcda18 req-057152ba-9f72-4e7a-b169-6a62dd5d40b3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063152 Oct 04 18:04:20.479912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1534/3181] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:20.480740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.481523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.482280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.483007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.500862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.503346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.508286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.509394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.512974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.515702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.583564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.584434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.585064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.599489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.600639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.601243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.605423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=93,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:20.634649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.635383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.642085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:20.645739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.654547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.655023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.655861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.656445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.656762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.662449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a71d01f7-fd94-4a60-9523-6142d5c47b88 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-311858620" status: 201 len: 0 microversion: 2.26 time: 0.212400 Oct 04 18:04:20.663459 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1648/3182] 10.222.0.42 () {62 vars in 1377 bytes} [Tue Oct 4 18:04:20 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags/tempest-tag-311858620 => generated 0 bytes in 214 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 04 18:04:20.675977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Action: 'update_all', calling method: .version_select at 0x7fbdc1c61940>, body: {"tags": ["tempest-tag-69309379", "tempest-tag-457134978"]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:20.689266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.690375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.690991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.691644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.700698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.701594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.702880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.703899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.704522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.705361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.732443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.733216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.734639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.768260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:20.823571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65fab045-c7e0-4b3e-9008-49cfed41f066 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 59 microversion: 2.26 time: 0.146913 Oct 04 18:04:20.823571 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1649/3183] 10.222.0.42 () {62 vars in 1312 bytes} [Tue Oct 4 18:04:20 2022] PUT /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 59 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:20.835197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc574c0d-5298-48e4-9bd8-ac340ab9604c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbd39aaf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.865372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc574c0d-5298-48e4-9bd8-ac340ab9604c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.865882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc574c0d-5298-48e4-9bd8-ac340ab9604c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.866331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc574c0d-5298-48e4-9bd8-ac340ab9604c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.900417 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc574c0d-5298-48e4-9bd8-ac340ab9604c tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 200 len: 59 microversion: 2.26 time: 0.074712 Oct 04 18:04:20.901363 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1650/3184] 10.222.0.42 () {60 vars in 1292 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 59 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:20.912744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '.version_select at 0x7fbdbdd090d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:20.927422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.930481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.931027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.932489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:20.946622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.947195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.947712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.948497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.953063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.954464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:20.987324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:20.987816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:20.988263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.017089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lazy-loading 'flavor' on Instance uuid ec1663ed-47a1-406a-9c56-b5df10753a53 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:21.043260 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a2f98225-818a-490b-abee-620580f370aa tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags" status: 204 len: 0 microversion: 2.26 time: 0.134896 Oct 04 18:04:21.044374 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1651/3185] 10.222.0.42 () {60 vars in 1295 bytes} [Tue Oct 4 18:04:20 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53/tags => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:21.050788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.051418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.072553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.073199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.073652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.075995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.076482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.077121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.291055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.300208 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b01d77c1-0de0-44f6-ac84-47d407696549 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.674885 Oct 04 18:04:21.300829 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1535/3186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:20 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:21.325586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.326782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.337138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.338100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.338775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.339770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.340796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.341587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.414413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:21.509882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.521531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=4,nova_cell1:RELEASE=3,nova_cell1:DELETE=1,nova_cell1:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:21.528183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.534805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:21.541580 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6ebf793-917d-4439-bcff-3e112b033c08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.494089 Oct 04 18:04:21.543732 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1652/3187] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:21.556213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.557957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.570020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.571334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.572758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.573915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.579965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.581733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.593434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a007500-7d73-42a9-a536-b06cf5617d70 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 204 len: 0 microversion: 2.26 time: 0.290365 Oct 04 18:04:21.595553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1536/3188] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:04:21 2022] DELETE /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:04:21.606856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:21.607877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:21.617934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.618431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.619072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:21.620678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:21.621245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:21.621684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.055865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.066868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc6b4d09-f4ba-4ee7-9be2-712dcee0e3ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.519618 Oct 04 18:04:22.087052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1653/3189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:22.126938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.136049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.147841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.149122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c7412b1-6968-4cbd-92c3-0a7b6ee4d8e6 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1552 microversion: 2.26 time: 0.549272 Oct 04 18:04:22.149700 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1537/3190] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:21 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1552 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:22.328858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.329487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:22.340163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.340670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.346908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.347758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.348251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.348708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.594419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:22.595673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:22.608101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.609527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.610604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.611935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:22.612862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:22.613688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:22.713256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:22.723937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e2e3747-9ccb-45c7-90fe-470101d35d08 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1328 microversion: 2.1 time: 0.400613 Oct 04 18:04:22.724650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1654/3191] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1328 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:23.094427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.096064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.103389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.104079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.104670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.105981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.106683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.107268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.180844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.196258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.198494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.200209 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bc14da3-8c35-478b-9bba-2aeb9903e8e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.616629 Oct 04 18:04:23.201287 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1538/3192] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:22 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:23.206255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.207506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.219883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.220383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.220819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.221534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.222031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.222676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.408780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.429588 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb009955-fc81-4064-8e76-93964c213356 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.339060 Oct 04 18:04:23.431515 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1655/3193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:23.662029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.681649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.683206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:23.684575 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67d70de6-1d85-4d0e-9b3b-973723f5eeed tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1552 microversion: 2.26 time: 0.482093 Oct 04 18:04:23.697859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1539/3194] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1552 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:23.748303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:23.748996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:23.766377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.766889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.767335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:23.768253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:23.768707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:23.769141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.194809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.210891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8abc0286-eb6d-4798-8c02-aaf0929f46ee tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1509 microversion: 2.1 time: 0.466656 Oct 04 18:04:24.215087 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1656/3195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:23 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1509 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:24.228442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.229057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.242137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.242946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.248904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.257996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.258146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.259225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.259921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.259921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.260542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.261000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.262719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.262719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.262973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.270815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.739211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.755423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.757580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.759377 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-013a4945-be67-4021-a3df-53d479fcab08 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.534813 Oct 04 18:04:24.760291 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1540/3196] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:24.766471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:24.767762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:24.775216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.776785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.777391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.778863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:24.779559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:24.780356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:24.805431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:24.833511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc8d0342-bcd5-42e9-b0c8-18562ad6250d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1509 microversion: 2.1 time: 0.594083 Oct 04 18:04:24.836509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1657/3197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:25.060797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d220062-8b95-40fc-8d2d-77fe0a5fef50 tempest-ExtensionsTest-1240287174 tempest-ExtensionsTest-1240287174-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.063853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d220062-8b95-40fc-8d2d-77fe0a5fef50 tempest-ExtensionsTest-1240287174 tempest-ExtensionsTest-1240287174-project] 10.222.0.42 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.224871 Oct 04 18:04:25.065144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1658/3198] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:25.072135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.072910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.081134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.081939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.082559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.083478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.086049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.086882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.175778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.188006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.189941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.191451 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63ec1834-b775-4167-837a-e7c6ee36d00d tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1510 microversion: 2.26 time: 0.124414 Oct 04 18:04:25.192296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1659/3199] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1510 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:25.214569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.215802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.223327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.223829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.224317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.225034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.225495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.225970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.256154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:04:25.342888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e7871cd-b6bb-4340-819a-a347b56da265 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 204 len: 0 microversion: 2.1 time: 0.148797 Oct 04 18:04:25.343832 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1660/3200] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:04:25 2022] DELETE /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:25.359667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3635dda-4e4f-4237-b569-34c016f49c4f tempest-ExtensionsTest-1240287174 tempest-ExtensionsTest-1240287174-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.363525 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e3635dda-4e4f-4237-b569-34c016f49c4f tempest-ExtensionsTest-1240287174 tempest-ExtensionsTest-1240287174-project] 10.222.0.42 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.017477 Oct 04 18:04:25.364930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1661/3201] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:04:25.372128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.373083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.389415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.391121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.402719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.403842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.407092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.407569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.647119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.666507 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a19cf21-8d91-4917-94e8-eedf82b35da2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.904495 Oct 04 18:04:25.667988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1541/3202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:24 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:25.678457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1663ed-47a1-406a-9c56-b5df10753a53", "name": "network-vif-deleted", "tag": "df1ef72e-510d-4066-8542-faae46881999"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:25.697699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.698541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.700144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.741703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] Creating event network-vif-deleted:df1ef72e-510d-4066-8542-faae46881999 for instance ec1663ed-47a1-406a-9c56-b5df10753a53 on n-h1-831194-21 Oct 04 18:04:25.759358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b13963d8-0aa3-452e-a7be-0d854f56302c req-20b1f437-cde6-4a9a-a36b-e181705c6a71 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089402 Oct 04 18:04:25.760004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1542/3203] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:25.777875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:25.786420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:25.787137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:25.797104 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5573c33-bdba-4579-a91f-f7e6c72fd506 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1515 microversion: 2.1 time: 0.428557 Oct 04 18:04:25.808086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.808596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.809045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.809776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:25.815890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:25.817968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:25.823749 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1662/3204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:26.232698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.233334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.239955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.240825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.241261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.242275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.242937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.243887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.258460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.269214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:26.279279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.281308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.282832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bcf37e8f-bca7-412d-8734-7ba282f61c5f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.500428 Oct 04 18:04:26.283191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1543/3205] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:25 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:26.381372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.393622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.395384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '965ab9933f354839879167f78b5dcf29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae0856d27b884af487a0a7ea2e2beb1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:26.397444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-194f0b53-31c0-4c28-9bd3-5edd354a577a tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 200 len: 1510 microversion: 2.26 time: 0.171853 Oct 04 18:04:26.409984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1663/3206] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:26.691718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:26.692999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:26.706481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.707480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.708360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:26.709498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:26.710428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:26.711039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.034206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-983705240", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:27.102604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] validate_networks() for [('4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:27.239121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.254250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fefa4ad-34ef-49a6-933c-ce48fb00a17b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.562605 Oct 04 18:04:27.255592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1544/3207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:26 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.261526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.273480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.280961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.284017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.288553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.289608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.290288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.298566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.914276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:27.919339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:27.922041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:27.923102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:27.924029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:27.925079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:27.939683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fae77193-6af8-4b63-a48e-fef9287a9d55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1515 microversion: 2.1 time: 0.682728 Oct 04 18:04:27.941526 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1545/3208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1515 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:27.946654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:27.948177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:27.955157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.956094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.956802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.958193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.959420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.960431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.981191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:27.984182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.985752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.986500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.987003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:27.987474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:27.987918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:27.997291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Getting quotas for project 15d29c28abc34938be5033a142af8e29. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:28.008543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Getting quotas for user 61e80d42b030426285611aaa3a9afcaf and project 15d29c28abc34938be5033a142af8e29. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:28.031835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:28.035296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:28.136553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48687541-0524-4142-8dc6-888ea0eaa3ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.380252 Oct 04 18:04:28.137539 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1664/3209] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:28.144440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.145910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] [instance: ec1663ed-47a1-406a-9c56-b5df10753a53] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.154773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.155976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.156931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.158034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.158833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.159587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.190494 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] HTTP exception thrown: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Request method failure captured: Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 HTTP/1.1 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWIEsdMM_ncMfbf7z1xmIx6llqrDVSLz3G0FOVM1FWEgkUauCNLiCozKUSCwaW8O-InyTLxamfU4nWFgQFZryFwPyxb-VSE9Dm-Lbz5kYK3d5TCKez3P-8q3_z1acGZ9kCNc1AaG4J0H2eKJ73hWC_XSoL1b0Zco4Fxjuyiz3DOCsY Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.26 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ae0856d27b884af487a0a7ea2e2beb1e Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerTagsTestJSON-721592774 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ae0856d27b884af487a0a7ea2e2beb1e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae0856d27b884af487a0a7ea2e2beb1e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ae0856d27b884af487a0a7ea2e2beb1e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ae0856d27b884af487a0a7ea2e2beb1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerTagsTestJSON-721592774 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ae0856d27b884af487a0a7ea2e2beb1e Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerTagsTestJSON-721592774 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerTagsTestJSON-721592774-project Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 965ab9933f354839879167f78b5dcf29 Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerTagsTestJSON-721592774-project Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'ec1663ed-47a1-406a-9c56-b5df10753a53'} Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:28.194957 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] Returning 404 to user: Instance ec1663ed-47a1-406a-9c56-b5df10753a53 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:28.200141 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4b9bc1d-b5ee-4924-b2c2-df2944d97393 tempest-ServerTagsTestJSON-721592774 tempest-ServerTagsTestJSON-721592774-project] 10.222.0.42 "GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53" status: 404 len: 111 microversion: 2.26 time: 0.057804 Oct 04 18:04:28.201662 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1665/3210] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/ec1663ed-47a1-406a-9c56-b5df10753a53 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:04:28.209940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaea6068-501a-4503-9a8d-8b650e9410b4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.210933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aaea6068-501a-4503-9a8d-8b650e9410b4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.333622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aaea6068-501a-4503-9a8d-8b650e9410b4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.355027 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aaea6068-501a-4503-9a8d-8b650e9410b4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1216 microversion: 2.1 time: 0.150973 Oct 04 18:04:28.355635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1666/3211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:28.386403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.391877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.429041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.429706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.430383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.431740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.432289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.432811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.720179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.763118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.766354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:28.768872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.826053 Oct 04 18:04:28.775696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1546/3212] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:27 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:28.777052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.778073 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001436 Oct 04 18:04:28.783654 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1547/3213] 10.222.0.42 () {56 vars in 886 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:04:28.802612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.804240 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002653 Oct 04 18:04:28.805758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1548/3214] 10.222.0.42 () {54 vars in 1035 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2/ => generated 379 bytes in 6 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 04 18:04:28.814564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.816571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77bc7792-d36d-4f69-a7ef-c61d9c96c393 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002296 Oct 04 18:04:28.819376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1549/3215] 10.222.0.42 () {54 vars in 1041 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/ => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:28.838075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "502af315-9bad-4ae0-bb36-68615f5ba18a", "name": "network-vif-deleted", "tag": "96c92400-ca50-42cd-9fe7-4be2e82e4012"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:28.867811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.868345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.868795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.923407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Creating event network-vif-deleted:96c92400-ca50-42cd-9fe7-4be2e82e4012 for instance 502af315-9bad-4ae0-bb36-68615f5ba18a on n-h1-831194-21 Oct 04 18:04:28.931335 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104702 Oct 04 18:04:28.937224 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1550/3216] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:28.939237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.940462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-962ad077-a0ba-4b32-ae50-46f14ef75fad req-89f9a791-797b-41fb-8651-963e8281633b service nova] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001777 Oct 04 18:04:28.943072 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1551/3217] 10.222.0.42 () {56 vars in 886 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:04:28.966722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:28.968611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:28.984302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.984903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.985811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:28.987245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:28.993942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:28.994497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.072885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.074005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.077638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.078646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid 502af315-9bad-4ae0-bb36-68615f5ba18a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:04:29.192903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:29.206581 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da1826fc-3e94-4eda-98f9-b76c4fbed039 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 200 len: 1318 microversion: 2.1 time: 0.245205 Oct 04 18:04:29.218924 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1552/3218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:29.385965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:29.386850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:29.398908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.402978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.404924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.408984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.411368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.413159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.438517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:29.449273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a49863fb-6081-4f5f-bd3f-bb18f792d08f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 1.091632 Oct 04 18:04:29.473221 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1667/3219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:28 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:29.605126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:29.630390 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-95c79120-7b6f-45d9-b99a-f8ffa00aca99 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1220 microversion: 2.1 time: 0.250604 Oct 04 18:04:29.632834 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1553/3220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:29 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1220 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:29.810493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:29.813261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:29.836069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.837079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.840028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:29.844019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:29.845768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:29.849960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.232272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.232912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.244530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.245044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.249643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.253970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.254480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.254928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.292437 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a HTTP/1.1 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '502af315-9bad-4ae0-bb36-68615f5ba18a'} Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:04:30.296456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-509a44f4-9f20-43be-abbf-659cd5fc0e52 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 404 len: 111 microversion: 2.1 time: 0.070015 Oct 04 18:04:30.304300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1554/3221] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:04:30.308316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8bdfecdd-2b30-4c7a-bb3c-e6b95c01c4a8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '.version_select at 0x7fbdbd9d9700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.331805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8bdfecdd-2b30-4c7a-bb3c-e6b95c01c4a8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-key-647752184" status: 202 len: 0 microversion: 2.1 time: 0.028789 Oct 04 18:04:30.332729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1555/3222] 10.222.0.42 () {58 vars in 1206 bytes} [Tue Oct 4 18:04:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-647752184 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:04:30.481430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:30.482630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:30.497262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.498361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.527912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.531513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:30.532485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:30.539167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:30.552780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.579531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.580859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:30.582150 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-212cb5e8-6ea3-4d24-ae7e-7e6bb508d649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.778539 Oct 04 18:04:30.598376 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1668/3223] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:29 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:30.611208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-718711960", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:30.697858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:30.998228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.007159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9797d759-3e98-4fe8-b029-5bcb34f05bf3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1475 microversion: 2.1 time: 0.531167 Oct 04 18:04:31.008388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1556/3224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:30 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1475 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.014619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.016014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.022276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.023215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.023849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.024580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.025130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.025571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.115061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:31.127441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26dc7c7b-6bca-4cfa-980f-fb0362b996bc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1274 microversion: 2.1 time: 0.116430 Oct 04 18:04:31.128284 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1557/3225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:31.617027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:31.617861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:31.632242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.632783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.634856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:31.635565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:31.636043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:31.638130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.099726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.118580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.120508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:32.122305 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ce391fc-54c7-4c85-b7c7-ee693c92f313 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.509647 Oct 04 18:04:32.123528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1558/3226] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:31 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:32.130399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:32.131490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:32.157407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.164919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.165782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.166813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.167471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.168482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.370224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:32.370765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:32.372340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:32.372881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:32.373430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:32.411132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.411977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.414333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.417155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.420290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.421485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.479260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:32.497903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:32.523637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:32.528270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:32.657631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9eccc65f-a337-44a4-8a58-d0632850e55e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.057992 Oct 04 18:04:32.674353 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1669/3227] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:32.683792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:32.684717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:32.722131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.737773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.740791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:32.741786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:32.744733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:32.746178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.473500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.486180 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9adb9602-25c3-4993-9e45-4be5213a1914 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1474 microversion: 2.1 time: 1.360215 Oct 04 18:04:33.487163 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1559/3228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:32 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1474 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.501654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.502875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.518783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.520387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.522392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.533928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.533928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.533928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.538775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:33.724177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.742199 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e578436-ce3b-4772-9156-e5a1e4bc72cb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1212 microversion: 2.1 time: 0.253020 Oct 04 18:04:33.755175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1560/3229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1212 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:33.784906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:33.786111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:33.808124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.809165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.810516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.812331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:33.813258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:33.813949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:33.831140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:33.844039 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8645cb7c-6880-4d69-95a7-615c9feaa55f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 1.167839 Oct 04 18:04:33.865382 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1670/3230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:32 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:34.232688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:34.247981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:34.259049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:34.260780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fac237d4-f77e-4fcb-ba8c-92da73a53cc5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.504146 Oct 04 18:04:34.261551 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1561/3231] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:33 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:34.468456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "name": "network-vif-unplugged", "status": "completed", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:34.496793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.497285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.506089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.522661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.524577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.533272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Creating event network-vif-unplugged:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h1-831194-21 Oct 04 18:04:34.533484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:34.562893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:04:34.566087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.566778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.567177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.567924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.571155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.572248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.601641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5748789f-3504-447a-af8b-da766cd160df req-e73244d5-db2d-40f9-8fb6-8c00f1568eed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142694 Oct 04 18:04:34.602599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1671/3232] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:34.777690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:34.778450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:34.789368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.789895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.790343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:34.791064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:34.791523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:34.791951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.114502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.133092 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3147642-0a2e-4a27-ab83-2171a6d5bf74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1278 microversion: 2.1 time: 0.352512 Oct 04 18:04:35.134022 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1672/3233] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1278 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:35.145795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.150864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.171709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.172466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.176750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.179213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.179928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.180598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.183912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.203477 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6167fa6b-76e4-49f9-a1bf-e9b581e12fe1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1474 microversion: 2.1 time: 0.683784 Oct 04 18:04:35.207157 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1562/3234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:34 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1474 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:35.293658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:35.295148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:35.304616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.305550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.306453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.307411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:35.308175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:35.308828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:35.723387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:35.764014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75a65aab-c880-4e26-a556-f6d2ff2f72b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.624151 Oct 04 18:04:35.789944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1673/3235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.159185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.159932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.169987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.170579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.171260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.172017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.179572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.180280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.356008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.374374 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d8225ee-3e3b-46b7-a0d0-4f61b1822142 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1266 microversion: 2.1 time: 0.219816 Oct 04 18:04:36.375691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1674/3236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:36.380630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.382395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.399121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.399962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.400596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.401493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.402393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.403657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.813793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.833697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.839071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.840330 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7c62315-7667-4949-91a2-cbbb8fa1adc2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 1.552024 Oct 04 18:04:36.854255 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1563/3237] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:35 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:36.854377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:36.858965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:36.860092 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc4f8bf5-f4f0-400a-bd5e-f408661de686 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1474 microversion: 2.1 time: 0.483123 Oct 04 18:04:36.860320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:36.860897 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1675/3238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1474 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:36.877397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.877850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.878313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.879041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.879508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.879951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.900591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}, {"name": "network-changed", "server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:36.934368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:36.934870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:36.935311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:36.972672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Creating event network-changed:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h1-831194-21 Oct 04 18:04:36.978391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Creating event network-changed:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h1-831194-21 Oct 04 18:04:37.005290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:04:37.031684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4f7b1c6c-2cbb-4599-b029-c01f5bfc3968 req-2a359374-147b-4622-a777-1950ae9bfafb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.146653 Oct 04 18:04:37.039095 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1676/3239] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:37.419720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.422324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.433291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.435646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.437237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.439679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.442315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.443139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.941405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:37.958013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77e0a75c-ec7b-4b6c-8382-a152940c6b23 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 1.110663 Oct 04 18:04:37.959712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1564/3240] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:36 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:37.968873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:37.970936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:37.978855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.979916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.981349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:37.982442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:37.983768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:37.984776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.159162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.174257 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55500712-d28f-4b7c-9920-d620696c4c94 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.765144 Oct 04 18:04:38.177281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1677/3241] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.183389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.184268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:38.193094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.193895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.194548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.196205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:38.198134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:38.198809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:38.665309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.677402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.679412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.681014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7cc84a3-a00c-4311-9164-d8161b4511e2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.719797 Oct 04 18:04:38.694368 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1565/3242] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:37 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:38.709565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:38.721534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a4d8af31-481d-4055-b386-25196f741c5f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1474 microversion: 2.1 time: 0.542730 Oct 04 18:04:38.734254 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1678/3243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1474 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:38.986902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:38.989782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.003630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.004142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.004587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.010273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.012836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.013330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.064772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "87cc0608-a9ad-4830-ae2d-83cab81d2099"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:39.089891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.096988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.098573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.128847 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] Creating event network-vif-plugged:87cc0608-a9ad-4830-ae2d-83cab81d2099 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:39.144779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8d25729f-3352-40a6-832a-bc4bcb4b0ebf req-4873e829-4545-4eaa-99f8-ad9ae0a9dec6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088306 Oct 04 18:04:39.146423 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1679/3244] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:04:39.206502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.207557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.224917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.227000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.228069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.230517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.231514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.232405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.688050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.698167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:39.703071 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15206bf0-ce8e-4693-968e-09b9ed35528e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.502596 Oct 04 18:04:39.704225 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1680/3245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:39.721046 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30204f28-a1f2-425b-8cc8-c96bb9aeaf36 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.742874 Oct 04 18:04:39.722707 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1566/3246] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:38 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:39.740540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.743807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.751701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.752802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.753463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.754677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.755079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:39.755620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.755739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:39.756379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.782243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.786257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.787093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:39.788067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:39.789649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:39.798349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.286224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.303621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.306343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.308282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-336d7c0e-68ef-4860-ba0c-b16308fda687 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.586967 Oct 04 18:04:40.309367 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1681/3247] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:04:40.319838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:40.328859 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14155a87-5c28-4960-9bc4-8b929bd89009 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1474 microversion: 2.1 time: 0.583849 Oct 04 18:04:40.329391 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1567/3248] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:39 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1474 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:40.730531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.731410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.746527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:40.748364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:40.753237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.753237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.755560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.755790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.756089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.759111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.779523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.780778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.781505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:40.782467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:40.785058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:40.787662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.081820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.092603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a6108bf-b97f-4e66-8214-5b94c188d194 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.351598 Oct 04 18:04:41.093913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1568/3249] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:41.133224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbed2183-c767-4bf6-8c8f-f23f9aa443f3", "tag": "6838ed5a-560f-47d5-ada5-c1d6aa30f309"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:41.152186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.152936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.153924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.179158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] Creating event network-changed:6838ed5a-560f-47d5-ada5-c1d6aa30f309 for instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 on n-h1-831194-21 Oct 04 18:04:41.189352 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-68ae7d3f-e29e-45ac-9c5c-858933e90d65 req-e475fc66-58ea-4c07-a1f9-ae445958fee3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055542 Oct 04 18:04:41.190879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1569/3250] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:41.198388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "2cbf1a8a-abbc-4246-b544-2a63d42f5947"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:41.214395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.215219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.215857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.247440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] Creating event network-vif-plugged:2cbf1a8a-abbc-4246-b544-2a63d42f5947 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:41.257775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-df59c893-7420-47c0-9544-303be659cce9 req-4c3591a9-e921-4d97-b38f-d3a16d716172 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063872 Oct 04 18:04:41.261053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.266464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1570/3251] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:41.277201 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3ca5ad5-43e6-45f0-accd-76b841057f5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.553834 Oct 04 18:04:41.279492 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1682/3252] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:40 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:41.336106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.336972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.355991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:41.357085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:41.358184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.361919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.362794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.364807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.365615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.366911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.371162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.371658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.372094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.377742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:41.378262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:41.378713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:41.799978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.817446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.820124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:41.823198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8168b921-de88-4cab-80b9-fc852509b891 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.492566 Oct 04 18:04:41.824301 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1571/3253] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:42.136566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.137807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.149856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.160230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.161015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.161683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.162675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.172021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60216cb4-f90b-4a81-bf0e-4855fea9be31 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1472 microversion: 2.1 time: 0.820054 Oct 04 18:04:42.172995 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1683/3254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:41 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1472 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:42.173648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.174467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.305720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.306734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.318027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.318998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.320886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.322421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.331273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.332114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.403502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:42.450629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:42.513295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=14 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:42.587759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:42.612703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c85c011-3796-4d76-a84c-2df05451e209 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.479772 Oct 04 18:04:42.618538 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1572/3255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:42.855534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:42.859677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:42.877427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.880345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.881765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:42.883961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:42.887582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:42.889037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.227036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.241763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ce33c1c-8946-4215-a850-ccd3f75b5658 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.941019 Oct 04 18:04:43.242479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1684/3256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.268547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.273936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.295896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.298379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.301241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.302175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.302842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.305481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.819295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.836226 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0de7960c-068e-4c2a-ac66-59c487074975 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1469 microversion: 2.1 time: 0.588588 Oct 04 18:04:43.837263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1685/3257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:43.850860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "name": "network-vif-plugged", "status": "completed", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "a2f8dd19-ed34-4a31-90d2-26a82a09b9bb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:43.875951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.876895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.881431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.904172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Creating event network-vif-plugged:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h1-831194-21 Oct 04 18:04:43.909449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] Creating event network-vif-plugged:a2f8dd19-ed34-4a31-90d2-26a82a09b9bb for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:43.934918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.944325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c9b1481b-7c3f-4302-be1b-574a06983a54 req-1fbd0e0e-8523-4a0f-b287-281f73448e8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104127 Oct 04 18:04:43.947204 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1686/3258] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:43.959374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.965399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:43.968197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:43.971509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:43.978948 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f94b9d62-da45-4047-b88f-1bbaf317488e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 1.126596 Oct 04 18:04:43.981408 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1573/3259] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:42 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:43.986386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.988516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.991122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:43.992632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:43.996947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:43.996947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.000295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:44.002763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.012604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.013535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.019164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.022393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.023236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.023959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.302112 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd7ebf0a-db37-4a73-8c0d-b9cff64a6806 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39/action" status: 204 len: 0 microversion: 2.1 time: 0.312612 Oct 04 18:04:44.305305 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1574/3260] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:04:43 2022] POST /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39/action => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:04:44.315911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.319519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.344641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.345754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.346620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.348428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.349176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.350064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.706236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.722538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3bd143df-3faf-4540-96f6-eefe8f784a8c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.415752 Oct 04 18:04:44.723617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1575/3261] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:44.728483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:44.734612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:44.747464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.752087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.752904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.762236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:44.763185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:44.763927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:44.863010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:44.878722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fa61b76-eaf2-4613-bee1-2823ddcf772d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.923753 Oct 04 18:04:44.889990 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1687/3262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:43 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.024148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.024896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.038564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.054282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.054752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.055210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.059211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7f3c65cd-ffdc-48cd-aa4a-ca9438bb9ce5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1469 microversion: 2.1 time: 0.332816 Oct 04 18:04:45.059839 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1576/3263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:44 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1469 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:45.063296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.064384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.065348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.318127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2b11ce12-6d68-4510-a718-0f52a129ede1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:45.320752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.359633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.360186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.360707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.361479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.368528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.370150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.385372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:45.533966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.547451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.549313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:45.551313 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ae03152-115c-4629-a39c-38a19bf223da tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 0.539871 Oct 04 18:04:45.553038 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1688/3264] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:45.748809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.749451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.766014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.766552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.767507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.769786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.770483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.773275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.856701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9eecc5dc-7e51-457b-a70b-e417358b82c0 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "POST /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542639 Oct 04 18:04:45.859978 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1577/3265] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:04:45 2022] POST /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments => generated 194 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:45.907484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:45.908947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:45.917309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.918156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.918814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:45.920664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:45.929709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:45.930852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.412729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.423224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0a4e32c-bcd0-420a-91cd-ed9a541c8cd9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.679009 Oct 04 18:04:46.431526 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1689/3266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.447785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "c76c890b-2bc2-43f9-bb54-90bda2d549c7"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "59eb436f-b38a-4fd4-8470-fd6e976515df"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "4cac5198-8159-48df-b2c3-dfd5f86feace"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-plugged", "status": "completed", "tag": "92dfa124-5ad1-4328-b6e5-27dcb4998361"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:46.489743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.490282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.490730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.509249 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Creating event network-vif-plugged:c76c890b-2bc2-43f9-bb54-90bda2d549c7 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:46.509778 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Creating event network-vif-plugged:59eb436f-b38a-4fd4-8470-fd6e976515df for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:46.510464 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Creating event network-vif-plugged:4cac5198-8159-48df-b2c3-dfd5f86feace for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:46.510850 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] Creating event network-vif-plugged:92dfa124-5ad1-4328-b6e5-27dcb4998361 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:46.533759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e283a5ac-3262-48d6-a3e7-766f3d010396 req-9be78ae0-ec4f-4dce-adc6-e1a2964d8a3f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.100619 Oct 04 18:04:46.534395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1690/3267] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:46.542544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.550922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.573268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.574080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.574520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.575282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.576123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.577782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.751604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:46.765860 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a350d1ba-e7da-48a2-aaf0-6f570d5375b6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1316 microversion: 2.1 time: 0.864599 Oct 04 18:04:46.778687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1578/3268] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:45 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1316 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:46.784553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:46.785483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:46.795458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.796594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.797259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:46.798786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:46.801401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:46.802149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.070590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.087525 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b64cc8f-abc3-40e9-b66d-13709d0fb910 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1469 microversion: 2.1 time: 0.549136 Oct 04 18:04:47.088131 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1691/3269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1469 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.478715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.479391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.493349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.493894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.494360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.495106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.496779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.498387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.838506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.868342 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd6b570a-a085-4307-9c74-8d27c1ae8f14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.394392 Oct 04 18:04:47.869353 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1692/3270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:47.893193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:47.894648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:47.908198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.911556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.912495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.913604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:47.914268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:47.915812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:47.935160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.946732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.953911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:47.961995 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b4a9836-382c-4a77-a70f-2cd53dfa5d42 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1879 microversion: 2.42 time: 1.181248 Oct 04 18:04:47.964708 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1579/3271] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:46 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1879 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:48.118912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:48.119946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:48.131688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.132472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.135424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.136502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.137366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.142568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:48.238501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.257305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e842ce5b-eb9c-487d-ad91-4e1d6acb04f3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.385603 Oct 04 18:04:48.257867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1693/3272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:47 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:48.535636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-606223267", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:48.626141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] validate_networks() for [('4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:48.880463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:48.888726 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a985be7-fbeb-4d9b-a126-ba35a29952d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1469 microversion: 2.1 time: 0.773607 Oct 04 18:04:48.913360 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1580/3273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:48 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1469 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:04:48.922587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "name": "network-vif-plugged", "status": "completed", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:48.958618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:48.959681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:48.959681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.020493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] Creating event network-vif-plugged:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h1-831194-21 Oct 04 18:04:49.033299 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-de13d28e-a92c-4267-b5e4-d6befb6edc48 req-8becc4c7-e643-4c38-bb65-360b5a6caffa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118496 Oct 04 18:04:49.033961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1581/3274] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:49.049736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.050478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.082121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.082627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.083119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.083868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.084335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.084769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.629236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:49.629867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:49.630425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:49.630840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:49.631260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:49.651919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.652424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.652864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.653592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.654083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.655147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.716004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Getting quotas for project 15d29c28abc34938be5033a142af8e29. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:49.732851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Getting quotas for user 61e80d42b030426285611aaa3a9afcaf and project 15d29c28abc34938be5033a142af8e29. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:49.777097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:49.780238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:49.834067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:49.921199 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-548ddb9a-884d-4515-a5e2-fb17c38c341c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400700 Oct 04 18:04:49.939643 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1694/3275] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:04:49.945991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:49.947244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:49.955141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.955886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.956527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:49.957445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:49.958105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:49.958704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.175890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.184435 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-afe00443-fcec-4dd2-b746-38c4817167ab tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 1.141899 Oct 04 18:04:50.185028 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1582/3276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.196940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.197745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.238311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.239218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.241242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.242265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:50.242956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:50.243591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:50.680182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.692535 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6d43153-607e-460c-9071-623dc7996433 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1461 microversion: 2.1 time: 0.503066 Oct 04 18:04:50.693303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1583/3277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1461 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:50.699542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1332f20-e590-4904-aeaa-886435b31e93 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:50.708621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1332f20-e590-4904-aeaa-886435b31e93 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:50.951224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1332f20-e590-4904-aeaa-886435b31e93 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:50.980879 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1332f20-e590-4904-aeaa-886435b31e93 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1216 microversion: 2.1 time: 0.284643 Oct 04 18:04:50.984419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1584/3278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1216 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.011756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.012966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.041857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.042758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.043509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.054914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.055829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.056794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.259244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.280010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.282245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:51.288636 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebf37362-042f-4064-8bf8-0d8cb2a3ce9a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2836 microversion: 2.42 time: 1.347716 Oct 04 18:04:51.289635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1695/3279] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:04:49 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2836 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:51.307748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbed2183-c767-4bf6-8c8f-f23f9aa443f3", "name": "network-vif-plugged", "status": "completed", "tag": "6838ed5a-560f-47d5-ada5-c1d6aa30f309"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:51.329288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.330112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.330671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.367245 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] Creating event network-vif-plugged:6838ed5a-560f-47d5-ada5-c1d6aa30f309 for instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 on n-h1-831194-21 Oct 04 18:04:51.383302 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-caca2768-72c9-4f54-a94a-f6f9d9fc7399 req-439175a4-36c0-44ff-b598-e60df376707d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091128 Oct 04 18:04:51.384421 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1696/3280] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:51.398755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.399864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.441734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.442295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.442704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.455538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.456143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.456607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.593475 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94c96c53-36ff-4cc7-b95e-7e8b9f4454a6 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1614 microversion: 2.1 time: 0.604222 Oct 04 18:04:51.601476 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1585/3281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:50 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1614 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:51.648714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:51.657857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:51.685312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.691017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.693166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:51.703205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:51.708588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:51.710898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.100671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.110842 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3714698f-ba6d-40ea-b99c-13b59c887b59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 0.718540 Oct 04 18:04:52.115634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1697/3282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.131788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-453a5f68-d005-499a-b3cb-f10ff6c08e26 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '.version_select at 0x7fbdbdc2d940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.137381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-453a5f68-d005-499a-b3cb-f10ff6c08e26 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.137908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-453a5f68-d005-499a-b3cb-f10ff6c08e26 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.138367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-453a5f68-d005-499a-b3cb-f10ff6c08e26 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.161387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-453a5f68-d005-499a-b3cb-f10ff6c08e26 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.042139 Oct 04 18:04:52.174058 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1698/3283] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:52.198237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:52.198876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:52.225622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.225849 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-608da873-b1d4-4528-9708-98e7ff70787c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.596851 Oct 04 18:04:52.227040 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1586/3284] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 18:04:51 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7/os-interface => generated 1830 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:04:52.227647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.228125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.228881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:52.229355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:52.229783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:52.486340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-112096318", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:52.594383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:52.630617 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b19f347-1211-47e3-99dd-a11f607ecf9c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1268 microversion: 2.1 time: 0.440228 Oct 04 18:04:52.647756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1699/3285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:52 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1268 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:52.661049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:53.145798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.148630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.162330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.164825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.165690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.166767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.167512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.168554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.517704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:53.518803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:53.519520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:53.520169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:53.521784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:53.533082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.533940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.534663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.535696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.536701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.537551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.574408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:53.586936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:53.608538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:53.612047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:53.711934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc778a5f-45f0-43dd-875c-5cc69a1e7fe6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.231947 Oct 04 18:04:53.720103 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1587/3286] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:04:53.738434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:53.739070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:53.755120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.755613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.756073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:53.756778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:53.757266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:53.757685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:54.034777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.046692 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-563c9e69-dd39-4b41-be98-d5c56716504c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1274 microversion: 2.1 time: 0.325047 Oct 04 18:04:54.048175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1588/3287] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.055789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a70843ef-23f8-49f1-9d7b-84fe7c15aed3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:54.056719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a70843ef-23f8-49f1-9d7b-84fe7c15aed3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:54.124653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.147945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8850ea7c-b220-43fb-b1f3-be15a391a37b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1308 microversion: 2.1 time: 1.006963 Oct 04 18:04:54.150132 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1700/3288] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:53 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1308 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:54.197276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a70843ef-23f8-49f1-9d7b-84fe7c15aed3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:54.225983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a70843ef-23f8-49f1-9d7b-84fe7c15aed3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1212 microversion: 2.1 time: 0.173787 Oct 04 18:04:54.240439 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1589/3289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:54 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1212 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:55.079664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.080297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.103054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.103561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.104012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.119300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.119886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.120352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.194040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:55.194040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:55.255673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.268630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.273936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:55.275403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:55.283675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:55.284832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.313141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.332470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a2e4e34a-1d03-40e8-b616-2c1d238fb830 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1489 microversion: 2.1 time: 1.154783 Oct 04 18:04:56.334457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1590/3290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1489 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.348981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:56.355612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:56.371057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.371786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.372153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.372775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:56.373332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:56.385033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:56.589803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.621028 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c5f6c8a-447c-47f4-b1a1-46eda2395305 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1270 microversion: 2.1 time: 0.282383 Oct 04 18:04:56.624837 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1591/3291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:56 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1270 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.633948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-718711960", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:56.674830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:56.690565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10d89399-b4fd-4a82-a65d-df5a75f6a061 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 1.617328 Oct 04 18:04:56.691486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1701/3292] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:55 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:56.759539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:04:57.179066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "tag": "c76c890b-2bc2-43f9-bb54-90bda2d549c7"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:57.211933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.211933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.211933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.243621 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] Creating event network-changed:c76c890b-2bc2-43f9-bb54-90bda2d549c7 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:04:57.261999 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3a501709-0659-48a8-8adc-edaba8223fd1 req-66d12679-2ea2-42a6-b759-76658ec0fc5e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090413 Oct 04 18:04:57.267507 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1702/3293] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:04:57.661438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:57.662356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:57.684681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.690015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.692578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:57.694428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:57.697032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:57.700143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.845197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:04:58.845752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:04:58.855901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:04:58.863105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:04:58.864868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:04:58.890239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.891068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.892830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.898848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:58.902215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:58.902910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:58.967173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:04:58.996613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:04:59.056895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:04:59.060243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:04:59.120354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.150038 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88272f2a-65de-40b2-9e7a-bb3bd4651f8c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 1.486779 Oct 04 18:04:59.162732 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1703/3294] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:57 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.185094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.186356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.207336 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b1f83b7-b5ea-4a19-9711-8aeac7764753 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.580680 Oct 04 18:04:59.216213 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1592/3295] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:04:59.222036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.222561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.223025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.223771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.226166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c859046-0b57-4041-8793-b448fb9084e9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:04:59.227263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c859046-0b57-4041-8793-b448fb9084e9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:04:59.232708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.234737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:04:59.534605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c859046-0b57-4041-8793-b448fb9084e9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:04:59.543440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c859046-0b57-4041-8793-b448fb9084e9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1208 microversion: 2.1 time: 0.325239 Oct 04 18:04:59.549860 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1593/3296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1208 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:04:59.686962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:59.747070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:04:59.946849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e027e87e-91c7-43d2-b904-d227fa91c486", "tag": "9565a0be-5490-483f-b717-918c2c9635c8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:04:59.978236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:04:59.978739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:04:59.979188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.014935 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] Creating event network-changed:9565a0be-5490-483f-b717-918c2c9635c8 for instance e027e87e-91c7-43d2-b904-d227fa91c486 on n-h2-831194-21 Oct 04 18:05:00.033506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-28fb794b-22d4-4978-9d75-cbf35098ebdd req-2b33e399-86d5-4eed-b797-9f26019002c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.482199 Oct 04 18:05:00.035734 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1594/3297] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:00.188139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.189107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.191976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:00.210410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.210940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.211404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.212327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.213311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.214255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.554213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.597117 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6ba806e-a2f2-4a45-a1d6-add7f93fd93e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 1.428767 Oct 04 18:05:00.604422 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1704/3298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:04:59 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:00.645356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:00.646015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:00.666165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.668699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.673043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.674890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:00.677546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:00.678298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:00.692408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:00.801321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.815451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b544ac13-153c-411f-9899-27011ceefafe tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.627802 Oct 04 18:05:00.828057 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1595/3299] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:00.910536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:00.958183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e25ecdb5-ba2d-40dd-a2d4-1cba269e6130 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1212 microversion: 2.1 time: 0.333480 Oct 04 18:05:00.976564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1705/3300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:00 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1212 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:01.646093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.646782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.660960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.661547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.662085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.662885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.663357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.663789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.845680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:01.847185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:01.867610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.870027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.873937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:01.875363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:01.878749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:01.881204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.070277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.093416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf708aab-3728-4ece-bd12-d8994064914b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.459676 Oct 04 18:05:02.117208 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1596/3301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:02.133129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:02.133963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:02.144139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.145616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.146338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.147854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:02.148590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:02.149283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:02.246147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:02.257586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c154f7ee-a43d-4ae9-ad5a-b59413f5eb6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1266 microversion: 2.1 time: 0.138050 Oct 04 18:05:02.258216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1597/3302] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:02 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1266 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:03.124519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.125193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.136416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.136921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.137432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.139510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.140144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.140694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.166103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:03.204392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.212415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8099092-1f36-4d06-9d3c-127b3ebb9ef4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 1.371244 Oct 04 18:05:03.228724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1706/3303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:01 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:03.282953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.283630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.296651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.297153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.298947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.299702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.300182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.302580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.460364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.487131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-67c0650d-7dc5-42d8-926c-1a1317269244 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1266 microversion: 2.1 time: 0.209119 Oct 04 18:05:03.487900 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1707/3304] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:03.584621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.587062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.596690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.597538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.598423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.599442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.600087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.600697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.653767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59c9cc38-e6c7-4305-86e0-5f0d686a45cd tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073773 Oct 04 18:05:03.655232 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1708/3305] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:03.672419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:03.674685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:03.686255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.687070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.687718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.688691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.689352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.698446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:03.749803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:03.762088 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d257d0d-87ca-4a94-8d6f-1cb502e08bb1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.641551 Oct 04 18:05:03.765806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1598/3306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:03 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:03.948263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8ca415-2151-4ac4-a246-9fe38706fce2", "tag": "cfd5e7ae-0dce-4f3b-857e-757cac25b3e1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:03.979320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:03.981227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:03.988430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.026444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lazy-loading 'services' on Instance uuid 9e1af660-5886-471d-90bc-571e7c5fb429 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:04.039944 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] Creating event network-changed:cfd5e7ae-0dce-4f3b-857e-757cac25b3e1 for instance fb8ca415-2151-4ac4-a246-9fe38706fce2 on n-h2-831194-21 Oct 04 18:05:04.058511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fcfc7ed7-0f9f-4666-b4da-979db62233cb req-142da4c6-2f15-4ec5-87e6-10cf86ff20df service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111047 Oct 04 18:05:04.061017 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1599/3307] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:04.238211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.239388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.269288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.269794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.270576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.281716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.282573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.283341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.371175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-506e5d75-ea53-4e73-a368-80ddf44b17ce tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments/2b11ce12-6d68-4510-a718-0f52a129ede1" status: 202 len: 0 microversion: 2.1 time: 0.708188 Oct 04 18:05:04.372510 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1709/3308] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:05:03 2022] DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments/2b11ce12-6d68-4510-a718-0f52a129ede1 => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:05:04.519026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.520287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.532937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.533732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.534678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.536109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:04.536842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:04.537892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:04.929969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.942594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:04.955706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c7b8aed-fef7-4b90-8282-9cbb65f86b58 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.722959 Oct 04 18:05:04.977867 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1600/3309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:04.993881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:04.994736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e2ff97c8-5f3c-474f-a88f-ab06aa0b2bb6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1266 microversion: 2.1 time: 0.478996 Oct 04 18:05:04.997197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:04.998645 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1710/3310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1266 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:05.028565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.030077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.035088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.037672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:05.038536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:05.039317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:05.681395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:05.695099 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-88b4919c-abbb-44be-bf57-f7c0c65f163a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.728243 Oct 04 18:05:05.706132 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1601/3311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:04 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:06.026389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.028718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.030023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.030252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.042793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.043399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.043867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.046926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.048546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.058698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.080159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.090915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.094584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.098939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.111298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.118353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.573065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:06.589666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae9e8493-eee4-41f1-809a-5a5b83150d14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.571268 Oct 04 18:05:06.592553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1602/3312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:06.730977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:06.734147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:06.753766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.759022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.761812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:06.765004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:06.766279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:06.801589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.192635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.207945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2dd182b3-d0ac-4bde-ac83-0491193daf41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 1.211092 Oct 04 18:05:07.212059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1711/3313] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:05 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.551060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:07.569448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5af7b71a-3ac9-46c5-993f-7f9cd18830f1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.843816 Oct 04 18:05:07.574531 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1603/3314] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:06 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:07.613506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:07.614331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:07.628799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.631611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.634142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:07.635017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:07.638129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:07.639584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.237432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.238951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.251984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.254851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.258349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.260855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.267334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.272456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.608037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.615886 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a0f731b-a4bd-4471-b942-b2d82e8fa368 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.384387 Oct 04 18:05:08.618833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1604/3315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:08.645703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:08.648563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:08.661019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.661526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.662006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.662733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:08.663197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:08.667931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:08.933922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:08.990635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:08.999705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77c5afdf-05f7-4087-8a6b-d779b507b1c7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 1.390131 Oct 04 18:05:09.004218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1712/3316] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:07 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.417076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:09.459154 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d18c52ec-d0ac-41e0-a408-1e61681ebd1b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.838857 Oct 04 18:05:09.489256 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1605/3317] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:08 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:09.646729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:09.647714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:09.687884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.691367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.693420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:09.695501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:09.700380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:09.703578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.027995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.029097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.047206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=18 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:10.053697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.054508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.058192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.062419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.062954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.063442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.643253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:10.652188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cbb4ed04-95b0-466b-983e-0b97824ec488 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 1.010850 Oct 04 18:05:10.654825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1713/3318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:09 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:10.659992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "829cc4ee-0d6a-4535-9eb9-f966e9f8d743", "tag": "2d0f53db-5811-4c35-ac47-b0dbaa74475d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:10.707542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.712370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.712950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.751273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] Creating event network-changed:2d0f53db-5811-4c35-ac47-b0dbaa74475d for instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 on n-h1-831194-21 Oct 04 18:05:10.766868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-629129f3-497f-4dfc-8f4b-6830dd41ccad req-4643eb38-fd43-4b72-831a-4e23f01f9d1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110631 Oct 04 18:05:10.767495 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1714/3319] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:10.772858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:10.773580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:10.800523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.801343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.802001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:10.802905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:10.803532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:10.806038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.363198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.373616 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da748e06-c3bd-40dd-b861-a70011bc79cc tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 1.350227 Oct 04 18:05:11.385653 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1606/3320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.636843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:11.645236 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17e26d17-ea98-473a-aff4-2dc584f42000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.876505 Oct 04 18:05:11.671187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1715/3321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:10 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:11.683225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:11.684482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:11.698751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.700333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.703049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:11.706310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:11.707098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:11.707611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.231376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e027e87e-91c7-43d2-b904-d227fa91c486", "name": "network-vif-plugged", "status": "completed", "tag": "9565a0be-5490-483f-b717-918c2c9635c8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:12.247312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.248599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.253308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.270420 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] Creating event network-vif-plugged:9565a0be-5490-483f-b717-918c2c9635c8 for instance e027e87e-91c7-43d2-b904-d227fa91c486 on n-h2-831194-21 Oct 04 18:05:12.275884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-03d6d7ad-4819-496e-a0f2-5506cf2302ba req-59fb5628-0723-418c-8ad2-4c0f9afbd1f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.437352 Oct 04 18:05:12.277173 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1716/3322] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:12.305664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.316069 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f24574e-81f4-49d5-b6b5-56d10f7f56fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.639009 Oct 04 18:05:12.319253 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1607/3323] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:11 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:12.409806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.410949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.421752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.426205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.427083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.428603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.429503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.430306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.677594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:12.678924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:12.694238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.695243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.696320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.697252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:12.697937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:12.698535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:12.839022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:12.860923 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23bc0d4e-ff76-4afa-8369-93799421faa3 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.455161 Oct 04 18:05:12.862443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1717/3324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:13.080282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:13.133468 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90d8e756-0b49-4996-bf33-ccf6e73b812c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1316 microversion: 2.1 time: 0.456017 Oct 04 18:05:13.135573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1608/3325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:12 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:13.343536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.344202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.353654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.354477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.355139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.356349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.357075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.357690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.530170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.533200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.547879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.548455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.548985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.549762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.550827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.550827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.593046 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5ccffa2-3ad4-4294-8b9d-cb4de2302578 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076852 Oct 04 18:05:13.612900 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1609/3326] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments => generated 25 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:05:13.668611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.675779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.682744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.683446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.683913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.684818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.686849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.687628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.727373 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a822942-5404-4626-81ee-abea27503fdb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063385 Oct 04 18:05:13.728150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1610/3327] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:05:13.831744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:13.832270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:13.842728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.843264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.843721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.845236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:13.845959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:13.847061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:13.885014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:14.078777 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c94cd860-7472-45cc-b4e6-32959ad3cb44 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 204 len: 0 microversion: 2.1 time: 0.252289 Oct 04 18:05:14.085221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1611/3328] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:13 2022] DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:05:14.103684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.104394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.116076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.117125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.117687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.118384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.118575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.119106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.119249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.148498 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c528d1e2-4d21-44d4-a88b-7853d9eed00b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.810583 Oct 04 18:05:14.161505 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1718/3329] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:13 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.167089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.174410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.187291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.188083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.188697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.189676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.190421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.193725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.456578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.468309 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34191a0a-f295-4326-b1dd-31343a34baa7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.380970 Oct 04 18:05:14.469967 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1612/3330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.478020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.479199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.486592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.487845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.488417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.489699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.490461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.491250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.814617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.827388 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-145240a4-f6d2-4baa-b2b3-39cb6c8183ca tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1506 microversion: 2.1 time: 0.356110 Oct 04 18:05:14.828861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1613/3331] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1506 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:14.856540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:14.857679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:14.864839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.865676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.866388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.867343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:14.868108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:14.868760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:14.874265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:14.927564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:14.954739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:14.972933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f35d9bf7-72b0-493b-9212-e3cb089f1a10 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1680 microversion: 2.1 time: 0.810062 Oct 04 18:05:14.974924 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1719/3332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:14 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1680 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.122283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40ae5fc0-8127-49ca-9942-808a9361ab31 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 204 len: 0 microversion: 2.1 time: 0.268398 Oct 04 18:05:15.124721 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1614/3333] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:14 2022] DELETE /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:15.134145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.135998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.152563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.155591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.156324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.158639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.161976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.162716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.184359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.185198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.196402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.196905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.197532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.201339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.203747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.204199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.587687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:15.601203 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e0f4d2b-5b5b-44b9-a704-5e60c50644bc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.421073 Oct 04 18:05:15.610573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1615/3334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:15.615763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8ca415-2151-4ac4-a246-9fe38706fce2", "name": "network-vif-plugged", "status": "completed", "tag": "cfd5e7ae-0dce-4f3b-857e-757cac25b3e1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:15.655051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.655051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.655329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.683072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] Creating event network-vif-plugged:cfd5e7ae-0dce-4f3b-857e-757cac25b3e1 for instance fb8ca415-2151-4ac4-a246-9fe38706fce2 on n-h2-831194-21 Oct 04 18:05:15.703775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-0be95de5-01b6-4c6b-8826-441495ee9b71 req-ea46518d-8b2e-4fde-9660-de2b9a381b43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091663 Oct 04 18:05:15.704687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1616/3335] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:15.710650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:15.711422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:15.728342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.728904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.729342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:15.730091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:15.730553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:15.730986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.020828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.032831 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97b6d929-db08-4f28-bc01-ee0a065f01ba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1512 microversion: 2.1 time: 0.903104 Oct 04 18:05:16.035718 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1720/3336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1512 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.042188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.043027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.054114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.056779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.057522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.058662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.059362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.060623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.096232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.126577 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef5568b0-7641-47d8-b2bd-15051d64e443 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.409664 Oct 04 18:05:16.138222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1617/3337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:15 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.281985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.300395 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-758013ab-a295-4465-b652-e1d76959f0e1 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1680 microversion: 2.1 time: 0.263074 Oct 04 18:05:16.311572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1721/3338] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1680 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:16.634844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:16.635782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:16.645229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.646079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.646875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.647874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:16.648853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:16.649535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:16.922994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:16.932556 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d9189b9-6e35-42a1-bac8-2c5a73f656e4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 0.301932 Oct 04 18:05:16.943171 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1618/3339] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:16 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.065105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.066182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.081133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.082078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.083580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.086360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.087105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.089384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.124934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:17.162016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.165259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.179340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.181598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.183040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.184814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.186990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.188503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.438579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.454266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9e6710d-4fac-4bc5-93bd-e12d0ff2eb59 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.300267 Oct 04 18:05:17.455154 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1619/3340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:17.465504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.470877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.486610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.487159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.487607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.490665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.491152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:17.491611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:17.642747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.657583 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dcf638af-6f3f-4018-985b-0db8d0f3991f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1512 microversion: 2.1 time: 0.593582 Oct 04 18:05:17.670623 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1722/3341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1512 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:17.973912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:17.975625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:17.993162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:17.998827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:17.999739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.005641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.007320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.007831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.008299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.012742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ccce7f8f-b4d4-40da-958b-30d1d088e728 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1680 microversion: 2.1 time: 0.550073 Oct 04 18:05:18.025863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1620/3342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1680 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:18.482640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:18.484609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:18.497359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.501524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.504511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:18.507250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:18.510456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:18.511209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.014739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.031133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e81b18f4-7d6f-4c38-a85f-648e606b7af7 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 0.554327 Oct 04 18:05:19.031738 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1621/3343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:18 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:19.033178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.038321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.038955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.056631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee4bf39f-74e7-4e88-8f16-f163f896997f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1312 microversion: 2.1 time: 1.087826 Oct 04 18:05:19.057795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1723/3344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:17 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1312 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.070135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.098595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829cc4ee-0d6a-4535-9eb9-f966e9f8d743", "name": "network-vif-plugged", "status": "completed", "tag": "2d0f53db-5811-4c35-ac47-b0dbaa74475d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:19.146546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.147045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.148653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.167081 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] Creating event network-vif-plugged:2d0f53db-5811-4c35-ac47-b0dbaa74475d for instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 on n-h1-831194-21 Oct 04 18:05:19.182725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5c839669-daf6-4002-9f9d-51357a1af7ac req-fa589aa0-e86b-4282-8ca2-01c43aea3976 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107207 Oct 04 18:05:19.183869 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1724/3345] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:19.191307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:19.192693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:19.209509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.210657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.211611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.214696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:19.216145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:19.219835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:19.574737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:19.599486 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-07ccb225-ca3d-44a1-978b-318e28d662ad tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1512 microversion: 2.1 time: 0.566433 Oct 04 18:05:19.600030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1622/3346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1512 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.009420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.025534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0daf947-e56b-4418-9a29-1f17e37667c4 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1680 microversion: 2.1 time: 0.839283 Oct 04 18:05:20.026369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1725/3347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:19 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1680 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.056422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.062251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.070000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.070801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.071412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.072334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.073540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.087244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.087780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.088951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.098791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=61 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:20.106213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.109484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.112566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.113596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.114539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.123253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.863147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:20.882190 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b552d03-81c4-4578-badb-ddd9f546974f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1462 microversion: 2.1 time: 0.799106 Oct 04 18:05:20.884678 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1726/3348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1462 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:20.896142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:20.897048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:20.910305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.912392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.913719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:20.915009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:20.915919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:20.917327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.037134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.051125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5547c27e-aca4-4cef-b1ab-38501caed45b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 200 len: 1301 microversion: 2.1 time: 0.164617 Oct 04 18:05:21.064129 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1727/3349] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 1301 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.086792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e027e87e-91c7-43d2-b904-d227fa91c486", "name": "network-vif-deleted", "tag": "9565a0be-5490-483f-b717-918c2c9635c8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:21.102931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.106145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.107661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.142687 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] Creating event network-vif-deleted:9565a0be-5490-483f-b717-918c2c9635c8 for instance e027e87e-91c7-43d2-b904-d227fa91c486 on n-h2-831194-21 Oct 04 18:05:21.153049 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7ffafccc-d6e7-48dc-96dd-fec59e5e0479 req-c7087966-92ef-4db5-aeb0-063957fffb97 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082303 Oct 04 18:05:21.159176 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1728/3350] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:21.167815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:21.172071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.181365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.182493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.184153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.185234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.186826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.187512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.368786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.384586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:05:21.399833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:21.400457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:21.401119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:21.402458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:21.403132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:21.580225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-278f8a44-fd22-4414-9993-21ee42d2309f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2/action" status: 202 len: 0 microversion: 2.1 time: 0.417960 Oct 04 18:05:21.581455 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1729/3351] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:21 2022] POST /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:21.595223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.596381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.626078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.627091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.627597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.628391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.628921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.629502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.754130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:21.772321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26e7491d-b0dc-4025-95e0-10e5d20376eb tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1614 microversion: 2.1 time: 0.188744 Oct 04 18:05:21.775227 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1730/3352] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1614 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:21.796052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:21.797236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:21.808604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.813127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.813640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:21.814429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:21.814903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:21.815336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.031930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.047587 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c010f3a-ecb8-414c-b887-79c5cbcd5932 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1308 microversion: 2.1 time: 1.994969 Oct 04 18:05:22.050146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1623/3353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:20 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1308 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.263245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.277662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed5c8c36-68c0-43ac-9d76-16f6c6ee4ab7 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1471 microversion: 2.1 time: 0.501098 Oct 04 18:05:22.279977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1731/3354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:21 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.290799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.291894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.318258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.318678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.319124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.320191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.321345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.322334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.352562 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 HTTP/1.1 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e027e87e-91c7-43d2-b904-d227fa91c486'} Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:22.356561 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:05:22.363851 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:22.367290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:22.368675 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e7cbff86-0748-491f-b04d-cf8168906753 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 404 len: 111 microversion: 2.1 time: 0.087039 Oct 04 18:05:22.369772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1732/3355] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:22.385723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.387279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.403380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.405030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.405747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.407472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.408168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.409003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.466399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1139686895", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "7c222b56-074e-4080-837a-9685d3a71661"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:22.567835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] validate_networks() for [('7c222b56-074e-4080-837a-9685d3a71661', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:22.760827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:22.792815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8f35e5a-fdf8-4fee-9b81-b45497ae7453 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.411142 Oct 04 18:05:22.796368 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1733/3356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:22.808440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e1af660-5886-471d-90bc-571e7c5fb429", "name": "network-vif-deleted", "tag": "4167cd20-b41e-4893-9599-c5d4e1072593"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:22.823727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.824413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.825093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.838723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] Creating event network-vif-deleted:4167cd20-b41e-4893-9599-c5d4e1072593 for instance 9e1af660-5886-471d-90bc-571e7c5fb429 on n-h2-831194-21 Oct 04 18:05:22.848430 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-045c30f4-c5a2-4f2b-a3df-085133ccd4a1 req-0d73baab-9956-41d4-9a40-e86b18d0218b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044935 Oct 04 18:05:22.850661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1734/3357] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:22.870846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:22.871893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:22.894991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.897143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.900116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:22.901853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:22.903219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:22.905445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.090704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67cbf643d7f245709abb102b830e904a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4086e1f5e04bb29219777357de8fc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.106277 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d996eac8-40ba-4a0f-9f08-c6f44ba031c8 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 200 len: 1327 microversion: 2.1 time: 0.252982 Oct 04 18:05:23.107204 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1735/3358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:22 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 1327 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:23.143118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.143754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.162097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.168696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.170168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.173001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.173499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.173967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.611436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:23.621989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ba85663-fc9f-48cd-abd1-c7a27c779eda tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1489 microversion: 2.1 time: 0.489688 Oct 04 18:05:23.622591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1736/3359] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1489 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:23.638395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2dc77a4-d7e5-4d4b-a593-c1edea3a4e69 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2dc77a4-d7e5-4d4b-a593-c1edea3a4e69 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 163 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": 12345, "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 12345 Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:23.659740 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 04 18:05:23.665316 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:23.677151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2dc77a4-d7e5-4d4b-a593-c1edea3a4e69 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:23.678165 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2dc77a4-d7e5-4d4b-a593-c1edea3a4e69 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.054406 Oct 04 18:05:23.678744 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1737/3360] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:23 2022] POST /compute/v2.1/servers => generated 127 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:23.707193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:23.707823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:23.737877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.738372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.738812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:23.739522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:23.747089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:23.750031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.050151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:24.050671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:24.051046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:24.051659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:24.052486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:24.080715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.081537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.082347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.083408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.090230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.091958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.174815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Getting quotas for project f4b87c1e060845b59eda48bc58f1da94. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:24.196170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Getting quotas for user 48d52e6289af445ab097b66a5601a3b9 and project f4b87c1e060845b59eda48bc58f1da94. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:24.237204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:24.240421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:24.307159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.325100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7f49d861-8264-4241-86b3-e9f19227ecfa tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1471 microversion: 2.1 time: 0.644254 Oct 04 18:05:24.325639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1738/3361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:23 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1471 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.337467 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff3bdd42-061a-47b0-8a97-adee8ace6975 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.285998 Oct 04 18:05:24.338607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.341780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.342449 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1624/3362] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 2292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:24.369973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.370835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.378964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.379750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.380393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.381387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.381743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.382344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.382506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.382872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.383536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.383685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.384048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.384473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.743529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:24.759964 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8576de23-0a7b-4aea-a19f-258a64007a56 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.400759 Oct 04 18:05:24.765121 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1625/3363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:24.770448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.775205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:24.803839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.804529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.805400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.807799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:24.815595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:24.816210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:24.861915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] HTTP exception thrown: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Request method failure captured: Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 HTTP/1.1 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHUhAVhKPCJMdMXXR_SqpCJlw3Zolrlll10oa7oNm3Dh9H0-0qavUzQdaW7-uHkrhCsAMP2Uad9OxCErIh4Q4m9kYa98tNIDmng2lgbOo97QP3hQEk4YY9eWmu5kLA6xqAx4qO8DmcMMyuOKncOisiFsW3DmRcNTWDKnjJZHEqFOU34 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 67cbf643d7f245709abb102b830e904a Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '9e1af660-5886-471d-90bc-571e7c5fb429'} Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:24.869744 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:24.874729 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:24.891025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Returning 404 to user: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:24.893184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cb22987-f3b9-4a9d-8d4e-512934b86878 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 404 len: 111 microversion: 2.1 time: 0.126678 Oct 04 18:05:24.896300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1626/3364] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:24.901793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be02d462-5055-4d58-9d03-d33d0106cd3f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:24.903055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be02d462-5055-4d58-9d03-d33d0106cd3f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.009977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.022446 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2957dd18-f8dd-4a87-b707-d15cd9ed6470 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1489 microversion: 2.1 time: 0.687434 Oct 04 18:05:25.038338 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1739/3365] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1489 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.063505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.064257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.086417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.086914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.087350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.088158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.088499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.088922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.100442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be02d462-5055-4d58-9d03-d33d0106cd3f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.117710 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be02d462-5055-4d58-9d03-d33d0106cd3f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1228 microversion: 2.1 time: 0.220015 Oct 04 18:05:25.131123 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1627/3366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:24 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1228 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.140510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f463d9f-b047-4f47-82c1-05619b1f4115 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '.version_select at 0x7fbdbd7ed700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.163704 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f463d9f-b047-4f47-82c1-05619b1f4115 tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083653981" status: 202 len: 0 microversion: 2.1 time: 0.031157 Oct 04 18:05:25.164770 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1628/3367] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2083653981 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:05:25.180336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.187791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.203176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.203812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.204932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.207284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.209863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.210522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.507456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.529885 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9403184-92dd-416b-b9c6-041b087c4250 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.489865 Oct 04 18:05:25.530741 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1740/3368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.562219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.567343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.581614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.584990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.585687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.587339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.589617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.591236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.598474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.608650 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6fd33d46-9e6d-49ca-8ba9-b6029f233365 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1489 microversion: 2.1 time: 0.442394 Oct 04 18:05:25.609242 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1629/3369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1489 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:25.639415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:25.640019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:25.645628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.666089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.677165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:25.689113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.689696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.691745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:25.692181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:25.694314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:25.789666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:25.869212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:25.886892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-394ffea4-d935-48c9-bbdd-d33f67f6c15a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1471 microversion: 2.1 time: 0.354806 Oct 04 18:05:25.904259 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1741/3370] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:25 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1471 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.036102 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d36e07e-bd95-44a3-a793-3f93b0d35554 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 204 len: 0 microversion: 2.1 time: 0.400794 Oct 04 18:05:26.038167 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1630/3371] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:25 2022] DELETE /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:26.047782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.048412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.071466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.078004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.078499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.083586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.087149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.090209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.145654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.146409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.167947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.168564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.169617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.178145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.181181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.181656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.229446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:26.451554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.465615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d209a9d-6add-4884-8381-45860f8b1095 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1280 microversion: 2.1 time: 0.324266 Oct 04 18:05:26.470223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:26.479791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21852350-b7d9-4f83-a89c-85776a07954e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1495 microversion: 2.1 time: 0.437294 Oct 04 18:05:26.486545 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1742/3372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1495 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.487050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1631/3373] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:26.913439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:26.914336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:26.923623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.925950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.927466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:26.928774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:26.942928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:26.942928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.495856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.497994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.524434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.525167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.525699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.526614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.527222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.529634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.801176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.813916 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94696efb-17bf-455b-b90f-6378d044c371 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1286 microversion: 2.1 time: 0.323120 Oct 04 18:05:27.837716 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1632/3374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1286 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:27.847979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:27.848630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:27.862540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.863046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.863492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.864216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:27.864794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:27.865129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:27.972870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:27.986386 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82336cd8-3013-4692-8fb2-7e0c895fe625 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1471 microversion: 2.1 time: 1.074666 Oct 04 18:05:27.997065 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1743/3375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:26 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1471 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.321947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:28.332916 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d65f7bb7-a93e-43b3-87e0-39e4042b5599 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1495 microversion: 2.1 time: 0.493907 Oct 04 18:05:28.345289 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1633/3376] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:27 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1495 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:28.866482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:28.870412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:28.913450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.916593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.922362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:28.927402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:28.929129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:28.931050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.003038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15736360-e650-4504-9f48-6e4430f8d19a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1968628589", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fbac97bf-313c-481d-8fe6-0c032bae052b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:29.156463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-15736360-e650-4504-9f48-6e4430f8d19a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15736360-e650-4504-9f48-6e4430f8d19a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 358 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1968628589", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "fbac97bf-313c-481d-8fe6-0c032bae052b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: exception: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1968628589', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'fbac97bf-313c-481d-8fe6-0c032bae052b'}], 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:29.167327 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15736360-e650-4504-9f48-6e4430f8d19a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Block Device fbac97bf-313c-481d-8fe6-0c032bae052b is not bootable. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:29.173522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15736360-e650-4504-9f48-6e4430f8d19a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.171615 Oct 04 18:05:29.176630 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1634/3377] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:28 2022] POST /compute/v2.1/servers => generated 110 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:05:29.185975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.189271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.209191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.209486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.210876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.212252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.213615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.214893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.532973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.548273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80f8e00d-5648-4591-b726-08ee52fd0ab5 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1286 microversion: 2.1 time: 0.704643 Oct 04 18:05:29.576734 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1744/3378] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:28 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1286 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.581167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:29.583419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.584094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.594098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.594757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.595225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.595959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.596625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.597383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.597805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c58d864-2bca-4372-bed9-40c0a593499f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.419519 Oct 04 18:05:29.599330 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1635/3379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:29.622225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:29.624767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:29.645635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.647692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.649917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:29.651560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:29.652918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:29.655866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.105161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.114995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-71f2eb99-d7c2-421d-918d-d4b89f7a2482 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.536271 Oct 04 18:05:30.120457 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1745/3380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:30.153727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.154705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.168013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.169471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.170142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.173585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.174411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.175064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.227117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:30.241084 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bd602b3-f1ff-4770-ac60-c72e64da5611 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1495 microversion: 2.1 time: 0.636601 Oct 04 18:05:30.244400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1636/3381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:29 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1495 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:30.583499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:30.584589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:30.603084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.607111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.608289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:30.610476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:30.614330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:30.615203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.154334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.167201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81c9e069-3ae0-4dd2-8c10-50046f9813b8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.589785 Oct 04 18:05:31.193134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1637/3382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:31.214010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.214705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.234948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.235525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.235892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.236612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.237078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.237517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.435178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.451708 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae5c73e3-48e5-4d55-83ea-d141f2433e26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.302176 Oct 04 18:05:31.457550 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1746/3383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:30 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:31.628057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.636667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-117491fd-5aaf-4e3b-bd1d-70b1781062cd tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.442080 Oct 04 18:05:31.643948 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1638/3384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:31.649603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:31.659971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:31.671496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.673146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.674652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.675404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.686418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.687230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.778721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "829cc4ee-0d6a-4535-9eb9-f966e9f8d743", "name": "network-vif-deleted", "tag": "2d0f53db-5811-4c35-ac47-b0dbaa74475d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:31.791521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.794092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.795986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.796840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:31.799275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:31.799766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:31.800204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:31.825657 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] Creating event network-vif-deleted:2d0f53db-5811-4c35-ac47-b0dbaa74475d for instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 on n-h1-831194-21 Oct 04 18:05:31.833101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-12bf98af-181e-4760-9e84-c39c58d58a1a req-4ae6a487-b615-4cd4-b85a-7c7ce9aed3f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.372041 Oct 04 18:05:31.834384 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1747/3385] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:31.906668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:31.917869 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8c14ad8-6793-48fd-9b12-c05787392882 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 200 len: 1298 microversion: 2.1 time: 0.272278 Oct 04 18:05:31.920426 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1639/3386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:31 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 1298 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.200509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.201520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.216461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.231677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.232387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.233663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.234371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.235137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.678121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.678121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.703750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.704254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.704709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.705423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.705932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.706359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.762338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:32.775456 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7dab57c7-d34f-4bea-9bc0-4c46abbb0c9b tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.580972 Oct 04 18:05:32.776028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1748/3387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:32.945881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:32.946870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:32.960948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.961454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.967054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:32.968111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:32.970143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:32.979004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.013609 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 HTTP/1.1 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '829cc4ee-0d6a-4535-9eb9-f966e9f8d743'} Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:33.015634 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:05:33.021221 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:33.023186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:33.029063 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e8922d5-5239-4b42-9e8d-bc549644ee51 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 404 len: 111 microversion: 2.1 time: 0.088158 Oct 04 18:05:33.031120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1749/3388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:33.040845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.041439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.048536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.049054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.049492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.050234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.050760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.051281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.117998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:33.173305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.188556 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67be4df7-5e8b-4016-b742-36fae39b5fc5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.515058 Oct 04 18:05:33.190652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1640/3389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:32 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:33.282707 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f43db3b-ee9d-4018-81f8-ba53ab65e91b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 204 len: 0 microversion: 2.1 time: 0.245095 Oct 04 18:05:33.289786 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1750/3390] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:33 2022] DELETE /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:33.301498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.302854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.314265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.317877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.318741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.321319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.322916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.323785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.641639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:33.652513 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-45d9ea1f-af55-4050-a60b-4830078f5b41 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1495 microversion: 2.1 time: 0.356201 Oct 04 18:05:33.654408 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1641/3391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1495 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:33.804394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:33.805749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:33.814394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.816798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.819010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.820031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.821532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.822942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.859033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6886cd-5c22-48d9-8138-cceaecce7d7d", "tag": "d00a9668-77a1-4e1d-ac21-d67b2dd21838"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:33.880391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:33.881176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:33.882170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:33.903031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] Creating event network-changed:d00a9668-77a1-4e1d-ac21-d67b2dd21838 for instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d on n-h2-831194-21 Oct 04 18:05:33.909918 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-14bceb12-9d30-44ee-b826-30daee59cbf2 req-1eb9a23b-de7b-4697-95f2-4a2862f8efc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058632 Oct 04 18:05:33.910897 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1642/3392] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:05:34.152461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.163945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f944e429-087e-47f6-9842-27e0e9b72855 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.363693 Oct 04 18:05:34.164942 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1751/3393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:33 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.220800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.222242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.230719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:34.237366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.239466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.240239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.242592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.243082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.244745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.568016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d716d15-17a7-419b-b0b2-961c2131f4db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1165690490", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e1023401-e1c5-4082-870f-0d68a62149b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c4f9cbe5-6b71-4237-9bfd-c603ce74160a", "destination_type": "invalid"}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d716d15-17a7-419b-b0b2-961c2131f4db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 495 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1165690490", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "e1023401-e1c5-4082-870f-0d68a62149b1", "destination_type": "local"}, {"source_type": "volume", "uuid": "c4f9cbe5-6b71-4237-9bfd-c603ce74160a", "destination_type": "invalid"}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1165690490', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'c4f9cbe5-6b71-4237-9bfd-c603ce74160a', 'destination_type': 'invalid'}], 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'invalid' Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:34.572813 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 04 18:05:34.578915 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:34.581649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d716d15-17a7-419b-b0b2-961c2131f4db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:34.582548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d716d15-17a7-419b-b0b2-961c2131f4db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019238 Oct 04 18:05:34.583572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1752/3394] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:34 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:34.609275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.614067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.633904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.636684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.638575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.639915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.640705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.641735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.671143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:34.683714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c292c814-5f49-4d4b-b315-12fdc431ec41 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.469492 Oct 04 18:05:34.699883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1643/3395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:34.710981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:34.711807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:34.719576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.720080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.720532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:34.721374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:34.721912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:34.722535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.029887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.045964 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8f0c361-8e24-44a8-ac78-88e4d8af98e5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.441209 Oct 04 18:05:35.047540 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1753/3396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.079664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.082215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.096342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.099297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.101187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.103423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.104270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.105010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.105662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:35.183028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.201630 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3529bd42-0aee-4dcf-bb3f-e11ac2b8fb61 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1495 microversion: 2.1 time: 0.494605 Oct 04 18:05:35.202635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1644/3397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:34 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1495 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:35.221284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.222347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.254920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.255617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.256683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.266956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.268188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.269653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.527237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:35.537056 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f986553-c3bc-43a4-bf86-40babbd9ee26 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.462226 Oct 04 18:05:35.539899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1754/3398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:35.545312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.550554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.570039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.570039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.570300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.571200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.571827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.572427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.602835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] HTTP exception thrown: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Request method failure captured: Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 HTTP/1.1 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHUhAVhKPCJMdMXXR_SqpCJlw3Zolrlll10oa7oNm3Dh9H0-0qavUzQdaW7-uHkrhCsAMP2Uad9OxCErIh4Q4m9kYa98tNIDmng2lgbOo97QP3hQEk4YY9eWmu5kLA6xqAx4qO8DmcMMyuOKncOisiFsW3DmRcNTWDKnjJZHEqFOU34 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 67cbf643d7f245709abb102b830e904a Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9e1af660-5886-471d-90bc-571e7c5fb429'} Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:35.604639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.609435 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.623164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Returning 404 to user: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:35.624453 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45466e43-5338-441f-9259-0e0f768938cc tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 404 len: 111 microversion: 2.1 time: 0.083412 Oct 04 18:05:35.625592 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1755/3399] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:35 2022] DELETE /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:35.634087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.635590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] [instance: 9e1af660-5886-471d-90bc-571e7c5fb429] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.645268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.651042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.651740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.652705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.663126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.663596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.687166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] HTTP exception thrown: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Request method failure captured: Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 HTTP/1.1 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHUhAVhKPCJMdMXXR_SqpCJlw3Zolrlll10oa7oNm3Dh9H0-0qavUzQdaW7-uHkrhCsAMP2Uad9OxCErIh4Q4m9kYa98tNIDmng2lgbOo97QP3hQEk4YY9eWmu5kLA6xqAx4qO8DmcMMyuOKncOisiFsW3DmRcNTWDKnjJZHEqFOU34 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ec4086e1f5e04bb29219777357de8fc5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ec4086e1f5e04bb29219777357de8fc5 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1892775384 Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 67cbf643d7f245709abb102b830e904a Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1892775384-project Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9e1af660-5886-471d-90bc-571e7c5fb429'} Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.688726 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] Returning 404 to user: Instance 9e1af660-5886-471d-90bc-571e7c5fb429 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:35.698445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b0ad461-f346-4bb7-ae06-22c6fced059c tempest-AttachSCSIVolumeTestJSON-1892775384 tempest-AttachSCSIVolumeTestJSON-1892775384-project] 10.222.0.42 "GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429" status: 404 len: 111 microversion: 2.1 time: 0.060191 Oct 04 18:05:35.706572 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1756/3400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/9e1af660-5886-471d-90bc-571e7c5fb429 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:35.711941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-736c81c5-afdf-4a0f-9768-216e6afca94f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736827922", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-736c81c5-afdf-4a0f-9768-216e6afca94f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 491 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-736827922", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-736827922', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.725918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-736c81c5-afdf-4a0f-9768-216e6afca94f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-736c81c5-afdf-4a0f-9768-216e6afca94f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.020124 Oct 04 18:05:35.733868 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1757/3401] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:05:35.736640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:35.737567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:35.757467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.758009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.758457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:35.759212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:35.759645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:35.760079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.071699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.111979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ece38231-d05a-46e3-9e9a-043fac993c06 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.904503 Oct 04 18:05:36.116581 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1645/3402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.130291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.130923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.145919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.156302 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-050e506a-a0bb-46a8-8fbe-57d5adacb0f2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.427063 Oct 04 18:05:36.159399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1758/3403] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:35 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:36.177011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.179721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.180811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.182010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.184285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.186030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.190407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbed2183-c767-4bf6-8c8f-f23f9aa443f3", "name": "network-vif-deleted", "tag": "6838ed5a-560f-47d5-ada5-c1d6aa30f309"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:36.211066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.211855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.212672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.227324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] Creating event network-vif-deleted:6838ed5a-560f-47d5-ada5-c1d6aa30f309 for instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 on n-h1-831194-21 Oct 04 18:05:36.233234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-9caa8c76-a9a7-4d67-b56d-7eb97a54dc13 req-ed3c53a2-bb71-4a7b-abb1-eb4b9e35a385 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071877 Oct 04 18:05:36.234559 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1759/3404] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:36.239983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:36.241289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:36.251118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.251912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.252590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.253528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.254553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.255220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.303742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:36.304502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:36.305120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:36.305758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid bbed2183-c767-4bf6-8c8f-f23f9aa443f3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:36.518623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:36.531031 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aaf2baba-f04c-4665-b615-eebc3ba2be44 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 200 len: 1298 microversion: 2.1 time: 0.294991 Oct 04 18:05:36.531842 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1760/3405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 1298 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.145358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.146528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.154528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.155353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.155970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.174153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.174153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.174153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.204200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:37.323648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.348864 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57d34923-25ae-4506-8d35-538ef9d675a5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.228798 Oct 04 18:05:37.351132 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1646/3406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:36 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.363408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.364815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.382584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.383918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.384993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.387830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.389050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.390466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.456132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.467042 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7cfeab28-dfce-40f8-ad9d-9b4121217056 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.327190 Oct 04 18:05:37.467740 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1761/3407] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.473007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.474021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.482391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.483243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.483739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.484451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.484964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.486305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.707760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.725413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3678a862-e1eb-4e0b-a932-811db8e992c1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.256015 Oct 04 18:05:37.726291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1762/3408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:37.731986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.739351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.767006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.768547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.774704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.776168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.776961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.781041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.805333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 HTTP/1.1 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bbed2183-c767-4bf6-8c8f-f23f9aa443f3'} Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:37.807044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:37.813648 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd60ed54-80fc-4ce7-954d-674508a80183 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 404 len: 111 microversion: 2.1 time: 0.081028 Oct 04 18:05:37.820245 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1763/3409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:37.911161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8f68166-b5e9-4fd4-9565-f8b7c1fd9241 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8f68166-b5e9-4fd4-9565-f8b7c1fd9241 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 416 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.915044 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:05:37.919964 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:37.924222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8f68166-b5e9-4fd4-9565-f8b7c1fd9241 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:37.925316 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8f68166-b5e9-4fd4-9565-f8b7c1fd9241 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.018811 Oct 04 18:05:37.926418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1764/3410] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:37 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:05:37.933927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:37.935344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:37.943069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.943712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.944403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.945122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:37.945582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:37.946342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:37.976479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:37.990992 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98bac6d6-f28a-4a40-b8ca-7cefc49c00fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.637934 Oct 04 18:05:38.001885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1647/3411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.133691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1676846598", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:38.196954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.208258 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1ec1a58-18bd-4bf5-8294-dc373293a7d9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.277949 Oct 04 18:05:38.221863 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1765/3412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:37 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:38.237283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:38.241292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.242299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.249914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.250764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.251845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.252761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.253290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.253719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.504890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.514112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42e0c306-f4ec-485b-9fe5-b97d94175466 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.277164 Oct 04 18:05:38.515348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1766/3413] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:38.520716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.521571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.531278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.532136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.532852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.533845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.534527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.535184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.830888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:38.842569 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2efc410-f0b1-422f-805d-09b013938358 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.323284 Oct 04 18:05:38.855911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1767/3414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:38.870813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b422275-d7c3-49dd-8068-f30761b8c45c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807287590", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": -1, "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:38.897133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8b422275-d7c3-49dd-8068-f30761b8c45c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Flavor -1 could not be found. Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b422275-d7c3-49dd-8068-f30761b8c45c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 205 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-807287590", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": -1, "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: exception: Flavor -1 could not be found. Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-807287590', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': -1, 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.926328 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 04 18:05:38.931542 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:38.936659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b422275-d7c3-49dd-8068-f30761b8c45c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:38.938362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b422275-d7c3-49dd-8068-f30761b8c45c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.094007 Oct 04 18:05:38.939509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1768/3415] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:38 2022] POST /compute/v2.1/servers => generated 73 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:05:38.961306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:38.964680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:38.974677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.975460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.976265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:38.978057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:38.978702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:38.980139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.572467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:05:39.574125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:05:39.576123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:05:39.577116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:05:39.578911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:05:39.595474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.596987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.597717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.598947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.599773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.600518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.622260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:39.630739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:39.631606 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-759f3b40-8380-4969-920d-dbde0fb737ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.676071 Oct 04 18:05:39.632766 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1769/3416] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:38 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:39.649346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:39.650943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:39.651306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.665974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.667236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.667991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.670078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.670824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.671493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.680795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:05:39.683785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:05:39.804949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4933b266-5c75-4ea3-a119-e1f4a7144e9a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.677621 Oct 04 18:05:39.808239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1648/3417] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:05:39.818288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:39.820575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:39.855297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.858008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.858603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:39.862626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:39.863610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:39.866350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.198287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.220392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fad4abf7-6b9b-4ce0-a3c5-5c845a554172 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.585173 Oct 04 18:05:40.227912 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1770/3418] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.241742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.242414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.284282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.287050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.290299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.292792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.295722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.297063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.335787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.349245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3bfed365-bce2-47fe-b058-e5a3923e88c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.538357 Oct 04 18:05:40.350891 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1649/3419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:39 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.364664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cbfd9c05-8747-424d-b9ee-dcc11ad373db tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.366575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cbfd9c05-8747-424d-b9ee-dcc11ad373db tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.579405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbfd9c05-8747-424d-b9ee-dcc11ad373db tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:40.591269 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cbfd9c05-8747-424d-b9ee-dcc11ad373db tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1209 microversion: 2.1 time: 0.237476 Oct 04 18:05:40.592086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1650/3420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:40.604744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:40.605601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:40.624716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.625224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.625675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.626811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:40.631623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:40.632001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:40.642936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:41.050859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.075344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.083035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.088424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-397914a1-402d-4ecc-bcc2-113d55ec4cd5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2954 microversion: 2.42 time: 0.859012 Oct 04 18:05:41.089596 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1771/3421] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2954 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.107872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e838747d-f552-49ad-babb-78cc3d5c6f80 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-46640288", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e838747d-f552-49ad-babb-78cc3d5c6f80 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 171 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-46640288", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-46640288', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi -1 Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:41.128768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e838747d-f552-49ad-babb-78cc3d5c6f80 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e838747d-f552-49ad-babb-78cc3d5c6f80 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.038637 Oct 04 18:05:41.135129 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1772/3422] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:41 2022] POST /compute/v2.1/servers => generated 145 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:41.154480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6886cd-5c22-48d9-8138-cceaecce7d7d", "name": "network-vif-plugged", "status": "completed", "tag": "d00a9668-77a1-4e1d-ac21-d67b2dd21838"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:41.194454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.194987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.195437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.218037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] Creating event network-vif-plugged:d00a9668-77a1-4e1d-ac21-d67b2dd21838 for instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d on n-h2-831194-21 Oct 04 18:05:41.230754 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-956f90a6-8135-4c20-bf58-3c4a88fc8eed req-503528e1-8d94-472e-bd26-1f98276ba8d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095222 Oct 04 18:05:41.234076 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1773/3423] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:41.242841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.244044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.252477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.253351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.254082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.255287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.256018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.256735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.520645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66a63ee6-0f0e-4e80-88cf-c93c1ba3c734 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.284377 Oct 04 18:05:41.521398 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1774/3424] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7/os-interface => generated 1830 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:05:41.538915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.539923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.548200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:41.557497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.559296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.560725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.561955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.564506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.565213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.956404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:41.966272 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86510df1-bb07-460c-9de0-1a0ca5d99b8f tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 1.371212 Oct 04 18:05:41.967616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1651/3425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:40 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:41.973244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:41.974338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:41.981857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.983021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.983705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:41.984662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:41.985378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:41.986085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.107727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.121901 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14d9929a-afa8-42c7-be64-e48d687f7b10 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.588757 Oct 04 18:05:42.124610 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1775/3426] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.149185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.150253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.161872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.162779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.163385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.165167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.165885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.166288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.318889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.330441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adeeecaa-97c2-4c98-a509-6a0c980cac2d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1267 microversion: 2.1 time: 0.203976 Oct 04 18:05:42.331025 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1776/3427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.335860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.336854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:42.345174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.346052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.346666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.347549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:42.348175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:42.348976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:42.531741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:42.547366 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c1f5b13-c2c9-4c2b-a570-c59f521f3d12 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.576544 Oct 04 18:05:42.584782 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1652/3428] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:41 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:42.997713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:42.998678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.019379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.027084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.030258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.030837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.034975 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-35cff5bc-3252-4545-97db-9e15d87b7770 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.702177 Oct 04 18:05:43.035769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.036718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.037960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.054945 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1777/3429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.238975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d6cdd89-3487-4714-a92d-d6347e44e20e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-354370310", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:43.246526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-6d6cdd89-3487-4714-a92d-d6347e44e20e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d6cdd89-3487-4714-a92d-d6347e44e20e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 215 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-354370310", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-354370310', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:43.249080 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d6cdd89-3487-4714-a92d-d6347e44e20e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d6cdd89-3487-4714-a92d-d6347e44e20e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.020067 Oct 04 18:05:43.254769 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1778/3430] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:43 2022] POST /compute/v2.1/servers => generated 123 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:43.270376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.271014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.284693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.286516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.287082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.287961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.288532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.289300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.408089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.422936 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-931b98cb-432b-40f0-aa69-a69fd61a54e0 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.431622 Oct 04 18:05:43.423544 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1653/3431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:42 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:43.439557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.440184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.459115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.459618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.460064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.460778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.461236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.462967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.805410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.820321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15142286-5159-4e13-b0f9-e3d6c2004460 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.558964 Oct 04 18:05:43.824432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1779/3432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.838094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.839170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.858713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.860508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.861232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.862884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.863714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.864312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.894525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:43.913092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-07885339-94c1-4c88-ad66-93486b797047 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.485603 Oct 04 18:05:43.915637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1654/3433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:43.931564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:43.935294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:43.945175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.945969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.946577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:43.948073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:43.948762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:43.949353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.239863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.249106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc1d9b01-6838-4d26-ac1e-2be9144de4af tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.423094 Oct 04 18:05:44.249978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1780/3434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:44.376770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:44.388254 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efa52d32-73cf-4104-b156-101ae805216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.468315 Oct 04 18:05:44.402501 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1655/3435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:43 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:44.450511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:44.451938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:44.464721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.468541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.470392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.473096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:44.474698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:44.475361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:44.609357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-659287370", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-key-1634941034", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:44.728253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] validate_networks() for [('4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:05:45.154402 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Invalid key_name provided. Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 246 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-659287370", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-key-1634941034", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid key_name provided. Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-659287370', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'key_name': 'tempest-key-1634941034', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1634941034 not found for user 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:45.166930 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid key_name provided. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d442351-36bb-4a86-9598-334532c66e77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.560883 Oct 04 18:05:45.178458 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1656/3436] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:44 2022] POST /compute/v2.1/servers => generated 70 bytes in 574 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 04 18:05:45.183473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.184716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.201422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.203119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.203595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.204331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.204797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.205232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.341491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.351416 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7b4f34e-72b4-44aa-9745-6fcb51470268 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1328 microversion: 2.1 time: 0.906613 Oct 04 18:05:45.360140 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1781/3437] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:44 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1328 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.360140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.360140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.366518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.367177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.367623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.368378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.368975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.369424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.520182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.540066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6b9dc59-bbe7-40b5-86ca-14fab2b92822 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.359660 Oct 04 18:05:45.554484 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1657/3438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:45.567655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:45.571050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:45.581398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.583169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.583986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.584988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:45.585614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:45.586599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:45.863153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:45.885367 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c7c9168-3fde-4084-aa4f-6d5de6531fcc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1476 microversion: 2.1 time: 0.328099 Oct 04 18:05:45.891608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1658/3439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1476 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.270854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.280173 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-becba94a-36ff-4fa3-82a9-71df4d458813 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.926659 Oct 04 18:05:46.281039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1782/3440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:45 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.317479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.318646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.333119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.334854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.337247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.339384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.340835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.341983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.380964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.382691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.397777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.398648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.399294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.401218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.403943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.407139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.800164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.812546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd737ac0-e2ac-4852-ba1b-df23219345eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.505980 Oct 04 18:05:46.814482 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1659/3441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.825896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.829085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:46.839060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:46.845379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:46.860879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.861373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.863810 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42bdb8bc-f131-43f5-84bb-fe078d097187 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1528 microversion: 2.1 time: 0.488394 Oct 04 18:05:46.866442 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1783/3442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1528 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:46.869911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.873983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e10c3a89-ee61-4496-829d-1f69e54a0da9", "tag": "63ce1c72-8b68-40af-8535-9c32e01ff966"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:46.882896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.883402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.883855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.901537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:46.908377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:46.910006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:46.939862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] Creating event network-changed:63ce1c72-8b68-40af-8535-9c32e01ff966 for instance e10c3a89-ee61-4496-829d-1f69e54a0da9 on n-h1-831194-21 Oct 04 18:05:46.967660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f3d08754-bf1e-413a-a393-c8c2de15cea0 req-975c162b-18d1-4a94-a346-621631742f89 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098368 Oct 04 18:05:46.969854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1784/3443] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:46.983963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:46.985288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.008787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.009790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.010548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.011675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.013820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.014550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.452447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.461009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cc68aca-5b92-49b2-b882-36cc8dcd57f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.643928 Oct 04 18:05:47.461803 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1660/3444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:47.466503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:47.467401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:47.473571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.474103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.474746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.475796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:47.476510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:47.477095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:47.482107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:47.502218 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d4647067-1cd8-4d73-a3a6-15cfbbf54735 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1528 microversion: 2.1 time: 0.527286 Oct 04 18:05:47.522531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1785/3445] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:46 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1528 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:47.530732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1252664134", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:47.851881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.security_group_api [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Neutron security group does_not_exist not found {{(pid=128849) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 04 18:05:47.852480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 258 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1252664134", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1252664134', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 04 18:05:47.864720 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 04 18:05:47.869658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:47.884582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:47.884582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54ee45b3-8c4d-45f3-980b-daf3bc6305c3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.357492 Oct 04 18:05:47.884582 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1786/3446] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:47 2022] POST /compute/v2.1/servers => generated 106 bytes in 359 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:48.170664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.171394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.177574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.178152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.178574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.179456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.180073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.180670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.196798 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] HTTP exception thrown: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Request method failure captured: Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d HTTP/1.1 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHXhsuUDdJAidFH6c8InNRfRUlpVju8i2MuKL_RbCrHUM-uncugNvM6SEkTcsdSq7WiV57PHOIOEi57WSW5SPCipZgtdJjW-QAIjQMOQIFwBTnZjuXCyaBPdsgMpHpwGT9ShD2vxLNvcW41BN6F0jjzgxylOe0UQ_va88hqDuSnBk6M Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a3c9974c6c3b40368fe60a14a7acce5c Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a3c9974c6c3b40368fe60a14a7acce5c Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2009626322-project Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be18cda15f9c4e68b03a8e34cc097c80 Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322-project Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '5d6886cd-5c22-48d9-8138-cceaecce7d7d'} Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:48.199317 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:48.204476 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:48.207197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Returning 404 to user: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:48.208236 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ef36571-16f9-4790-abb3-f455b633cb3a tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 404 len: 111 microversion: 2.1 time: 0.321523 Oct 04 18:05:48.209898 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1787/3447] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:47 2022] DELETE /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 111 bytes in 326 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:48.216315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.218319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.219115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.226271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.227202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.227819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.228331 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7b372b6-41dc-4877-84ea-916264ea1555 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1475 microversion: 2.1 time: 0.765353 Oct 04 18:05:48.228879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.229496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.229985 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1661/3448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:47 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1475 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.230325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.238491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.239764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.249479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.250338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.250821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.252059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.253465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.254003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.654400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.665472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:48.668779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1f2eb67-9821-42ff-a882-7b4504055df8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.457495 Oct 04 18:05:48.670196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1788/3449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.675238 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee995a12-0dac-4ce2-98d4-9af963aaf605 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1528 microversion: 2.1 time: 0.444210 Oct 04 18:05:48.678535 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1662/3450] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1528 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:48.687108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8ca415-2151-4ac4-a246-9fe38706fce2", "name": "network-vif-unplugged", "status": "completed", "tag": "cfd5e7ae-0dce-4f3b-857e-757cac25b3e1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:48.695653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.696558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.707007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.708325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.709182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.711115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.711931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.712924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.718400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.720024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.720498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.750211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Creating event network-vif-unplugged:cfd5e7ae-0dce-4f3b-857e-757cac25b3e1 for instance fb8ca415-2151-4ac4-a246-9fe38706fce2 on n-h2-831194-21 Oct 04 18:05:48.766533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:05:48.791794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b1085260-9ebd-46ea-be09-189d3149f8ff req-7be194bc-1ffb-474d-b5ea-ecb628d10066 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111737 Oct 04 18:05:48.792722 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1663/3451] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:48.798874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:48.799584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:48.811617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.812116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.812557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:48.813269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:48.813729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:48.814182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.124499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.139512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc66c73b-e201-4125-a92a-134c2fa9ce91 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.344814 Oct 04 18:05:49.140953 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1664/3452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.148264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.159179 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff728168-412d-4989-b98f-fab36eeeb69a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.474960 Oct 04 18:05:49.160251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Action: 'update', calling method: >, body: {"server": {"name": "5d6886cd-5c22-48d9-8138-cceaecce7d7d_new"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:49.161065 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1789/3453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:48 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.164913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.176568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.177437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: f4d4966b-d5cb-4797-8c18-0d30505d7283] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.179459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.179971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.180420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.181811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.182313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.182750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.196198 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/f4d4966b-d5cb-4797-8c18-0d30505d7283 HTTP/1.1 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'f4d4966b-d5cb-4797-8c18-0d30505d7283'} Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.197693 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance f4d4966b-d5cb-4797-8c18-0d30505d7283 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13c7cb2f-db0f-4434-8d1b-2583c5b3eb6d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f4d4966b-d5cb-4797-8c18-0d30505d7283" status: 404 len: 111 microversion: 2.1 time: 0.035126 Oct 04 18:05:49.203987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1790/3454] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:49 2022] DELETE /compute/v2.1/servers/f4d4966b-d5cb-4797-8c18-0d30505d7283 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:49.212057 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] HTTP exception thrown: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:49.212844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.213464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Request method failure captured: Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d HTTP/1.1 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 64 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHXhsuUDdJAidFH6c8InNRfRUlpVju8i2MuKL_RbCrHUM-uncugNvM6SEkTcsdSq7WiV57PHOIOEi57WSW5SPCipZgtdJjW-QAIjQMOQIFwBTnZjuXCyaBPdsgMpHpwGT9ShD2vxLNvcW41BN6F0jjzgxylOe0UQ_va88hqDuSnBk6M Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a3c9974c6c3b40368fe60a14a7acce5c Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3c9974c6c3b40368fe60a14a7acce5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a3c9974c6c3b40368fe60a14a7acce5c Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestMultiTenantJSON-2009626322-project Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be18cda15f9c4e68b03a8e34cc097c80 Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-2009626322-project Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "5d6886cd-5c22-48d9-8138-cceaecce7d7d_new"}} Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5d6886cd-5c22-48d9-8138-cceaecce7d7d', 'body': {'server': {'name': '5d6886cd-5c22-48d9-8138-cceaecce7d7d_new'}}} Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:49.215733 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:49.228731 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:49.239210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] Returning 404 to user: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:49.239559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.240369 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63326d5a-6d88-4687-8968-5b3bf79e0226 tempest-ServersNegativeTestMultiTenantJSON-2009626322 tempest-ServersNegativeTestMultiTenantJSON-2009626322-project] 10.222.0.42 "PUT /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 404 len: 111 microversion: 2.1 time: 0.092361 Oct 04 18:05:49.241320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1665/3455] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:05:49 2022] PUT /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:49.241967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.242628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.249501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.250546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.254771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.255296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.255854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.259827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.261170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.262436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.263647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.264316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.264943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.298351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:49.395398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:49.416619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e6f060f-ecc3-4d7f-910c-d2b9e2867dea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 204 len: 0 microversion: 2.1 time: 0.172684 Oct 04 18:05:49.422152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1666/3456] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:49 2022] DELETE /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:49.436554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.438158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.447941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.448817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.450546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.451920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.452905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.454139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.619403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:49.850230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:49.861766 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0ee8ce44-3c72-4060-9358-a4a19634be55 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1473 microversion: 2.1 time: 0.438013 Oct 04 18:05:49.862491 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1667/3457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1473 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:49.879683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:49.880481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:49.888436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.889488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.890055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.891041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:49.891586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:49.892093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:49.896063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:50.055989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.066997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9932595c-db8a-4bde-bd30-463c014d1125 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.858778 Oct 04 18:05:50.067927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1791/3458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:50.115332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.116239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.125584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.126717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.127394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.128549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.129221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.129896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.199677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.222564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf184ef9-4df9-484e-a159-ca5017ade625 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1534 microversion: 2.1 time: 0.358657 Oct 04 18:05:50.223166 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1668/3459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:49 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1534 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.228483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.228757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.244491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.245433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.247425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.249412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.250717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.251879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.469890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.486119 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d24124a7-f763-40c4-a138-3b45459fb641 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.261595 Oct 04 18:05:50.487257 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1669/3460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.530319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:50.550957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b245ece-8dc5-4798-8527-986133fcd926 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.434191 Oct 04 18:05:50.566961 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1792/3461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:50.579523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.580193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:05:50.580780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 9223372036854775808 could not be found. Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '9223372036854775808'} Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:50.582893 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e58bd5cb-7cb1-496c-8677-2197fc393ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010857 Oct 04 18:05:50.592362 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1670/3462] 10.222.0.42 () {58 vars in 1188 bytes} [Tue Oct 4 18:05:50 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:50.596042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.602435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.622607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.622890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.623315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.624303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.624773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.625213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.884100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:50.888980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:50.898481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:50.919762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.920270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.920709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:50.921428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:50.921920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:50.922350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.062127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.073403 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f7832e6-f6a3-43b3-aeb7-e6ef94ee910c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.480951 Oct 04 18:05:51.074241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1793/3463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.099930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.109331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.116800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.117752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.118687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.119657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.121660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.122323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.158379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.178504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96ba005d-06f8-4ce2-84b3-f289160942e2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1473 microversion: 2.1 time: 0.293209 Oct 04 18:05:51.181990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1671/3464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:50 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:51.252820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.253802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.260049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.260893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.261645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.262744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.263439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.264150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.576540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.589885 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c31fc03e-ab75-47c7-a51c-d5d308d13eb7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.494215 Oct 04 18:05:51.591726 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1794/3465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:51.597396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.598445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.606547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.607638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.608440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.609648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.611511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.612196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.651891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.661123 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-880eb187-ac29-4fa8-a2d8-34e52d79a6ea tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1534 microversion: 2.1 time: 0.412392 Oct 04 18:05:51.663375 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1672/3466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:51.681494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.682018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Failed to fetch instance by id -1 {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:05:51.682538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance -1 could not be found. Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance -1 could not be found. Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '-1'} Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:51.684075 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:51.689480 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6483e477-ac5b-403c-b159-b73a4058820c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.024270 Oct 04 18:05:51.691075 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1673/3467] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:05:51 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:05:51.698424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:51.702034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:51.711939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.712845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.713634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.715752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:51.716498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:51.717194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:51.916945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:51.928541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45d05405-99f8-4ddb-8e1e-ddcc80794662 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.335052 Oct 04 18:05:51.929159 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1795/3468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.130389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.152488 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-62d38e12-341f-4431-a35e-92ca79ea5a78 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.457412 Oct 04 18:05:52.155247 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1674/3469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:51 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:52.185347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.186403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.197965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.198745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.200343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.205482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.206280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.208572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.208867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.212320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.245206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.249494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.251528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.255214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.255916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.256903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.646087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.702940 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-95f960de-a8ec-4f35-9129-471488e3985f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.524435 Oct 04 18:05:52.726236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1796/3470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:52.739437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6886cd-5c22-48d9-8138-cceaecce7d7d", "name": "network-vif-deleted", "tag": "d00a9668-77a1-4e1d-ac21-d67b2dd21838"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:52.751558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.752888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.753713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.774009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] Creating event network-vif-deleted:d00a9668-77a1-4e1d-ac21-d67b2dd21838 for instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d on n-h2-831194-21 Oct 04 18:05:52.780489 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-42a63329-b7a5-4071-af72-43345bfdcdff req-8d2538bb-cbb4-4ad7-8794-1a72d599a30b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051780 Oct 04 18:05:52.781772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1797/3471] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:52.788374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:52.789338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:52.797895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.799377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.800080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.801060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.801762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.802534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.862476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:52.863248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:52.864461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:52.865296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lazy-loading 'fault' on Instance uuid 5d6886cd-5c22-48d9-8138-cceaecce7d7d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:05:52.961814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d52e6289af445ab097b66a5601a3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4b87c1e060845b59eda48bc58f1da94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:52.985448 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b2e82c1-c84c-4007-9b1c-1903ca80262d tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 200 len: 1318 microversion: 2.1 time: 0.202161 Oct 04 18:05:52.986121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1798/3472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:52.991085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:52.991900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 4f9abe45-2b7f-49e4-a6a0-d6e4645942de] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.003588 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/4f9abe45-2b7f-49e4-a6a0-d6e4645942de/action HTTP/1.1 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 19 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: {"forceDelete": {}} Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '4f9abe45-2b7f-49e4-a6a0-d6e4645942de', 'body': {'forceDelete': {}}} Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:53.017309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 4f9abe45-2b7f-49e4-a6a0-d6e4645942de could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6b5b1e0-e56d-4fee-9c16-56f1be8c6e8e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/4f9abe45-2b7f-49e4-a6a0-d6e4645942de/action" status: 404 len: 111 microversion: 2.1 time: 0.031668 Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1799/3473] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:52 2022] POST /compute/v2.1/servers/4f9abe45-2b7f-49e4-a6a0-d6e4645942de/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:53.024042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.030113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.049888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.051110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.051646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.052642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.052881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.054354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.054354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.061749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6da37d0-1574-4462-8cfb-58eb1f1210df tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1470 microversion: 2.1 time: 0.858305 Oct 04 18:05:53.074326 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1675/3474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:52 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1470 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.102480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.104920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.131822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.133193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.133816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.134920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.136278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.138079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.659917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:53.669888 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12adb395-e3b8-42e7-8c33-578cbd8d31c5 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.593248 Oct 04 18:05:53.670799 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1676/3475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:53.698271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:53.699020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.709691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.710684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.713109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.714483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.715505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.716523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.887198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81b57f49-f51d-4997-99f7-e8330202815d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2/action" status: 204 len: 0 microversion: 2.1 time: 0.201416 Oct 04 18:05:53.890832 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1677/3476] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:53 2022] POST /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2/action => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:53.898020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10c3a89-ee61-4496-829d-1f69e54a0da9", "name": "network-vif-plugged", "status": "completed", "tag": "63ce1c72-8b68-40af-8535-9c32e01ff966"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:53.913941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.915043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.915808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.937604 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] Creating event network-vif-plugged:63ce1c72-8b68-40af-8535-9c32e01ff966 for instance e10c3a89-ee61-4496-829d-1f69e54a0da9 on n-h1-831194-21 Oct 04 18:05:53.945475 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-82a205c4-0d68-4777-9dc9-b9cac3e84a71 req-9e916d5f-5223-4d86-a857-bc58b37c1a6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051729 Oct 04 18:05:53.947244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1678/3477] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:53.953624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:53.954993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:53.965322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.967327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.968275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:53.971412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:53.972121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:53.972801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.014216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.030823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55b58239-293b-4344-aaed-6d8b43394e09 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 1.010241 Oct 04 18:05:54.035986 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1800/3478] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.047599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.054460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.064588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.068690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.069889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.070841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.071493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.072099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.292003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:54.304193 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cbaf8ba4-abe9-4be5-9d3b-f6e83ce9ff3d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.355443 Oct 04 18:05:54.319059 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1679/3479] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:53 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:54.351119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.353981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] [instance: 5d6886cd-5c22-48d9-8138-cceaecce7d7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.380797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.381314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.381763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.382525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.383026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.383461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.426852 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] HTTP exception thrown: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Request method failure captured: Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d HTTP/1.1 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHXRhpMx0CLNFdwHeSzmbo_Jf6NSSI9mzpmof3Z4_wuJiM3EXdFkhJihbOuFHIErDD4Og4jlo1W5hM1D-s9r05r-BRC12lGB85LdopZ66p4vsIznzj-2s4EgCuvtpNTm49CGYm2BbAercM5hhAiLLnoN4IPFSVRkps1aRYF1in7kwho Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: f4b87c1e060845b59eda48bc58f1da94 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1040103466 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f4b87c1e060845b59eda48bc58f1da94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b87c1e060845b59eda48bc58f1da94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f4b87c1e060845b59eda48bc58f1da94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f4b87c1e060845b59eda48bc58f1da94"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1040103466 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: f4b87c1e060845b59eda48bc58f1da94 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1040103466 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1040103466-project Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 48d52e6289af445ab097b66a5601a3b9 Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1040103466-project Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5d6886cd-5c22-48d9-8138-cceaecce7d7d'} Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:54.428591 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] Returning 404 to user: Instance 5d6886cd-5c22-48d9-8138-cceaecce7d7d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:54.435614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29fd70c0-06ec-4703-92c1-7e432b7eb2d8 tempest-ServersNegativeTestMultiTenantJSON-1040103466 tempest-ServersNegativeTestMultiTenantJSON-1040103466-project] 10.222.0.42 "GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d" status: 404 len: 111 microversion: 2.1 time: 0.109953 Oct 04 18:05:54.441209 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1680/3480] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/5d6886cd-5c22-48d9-8138-cceaecce7d7d => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:54.454725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:54.457786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.481327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9/action HTTP/1.1 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 39 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: {"os-getConsoleOutput": {"length": 10}} Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.488775 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. Oct 04 18:05:54.494502 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:05:54.497366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:54.498575 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f677d3d4-67ec-4494-96b2-6630b9d02ca8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9/action" status: 404 len: 111 microversion: 2.1 time: 0.056284 Oct 04 18:05:54.502906 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1681/3481] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:54 2022] POST /compute/v2.1/servers/9e18fdcf-5b1b-4397-b9d0-16f55e91e5d9/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:54.513896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:54.514503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:54.535193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.536150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.537038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.537965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:54.538781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:54.540080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:54.993718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.015701 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dde66af6-1a8d-4171-801f-058ab02f7ea9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1470 microversion: 2.1 time: 0.975893 Oct 04 18:05:55.035389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1801/3482] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1470 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.058375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.059178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.069911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.070710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.073320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.074565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.075392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.077799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.255974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.263243 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-185a019c-756a-4958-85d9-9f3abf7c1c98 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.758903 Oct 04 18:05:55.263876 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1682/3483] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:54 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.292505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.293697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:55.305141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.307862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.308601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.311655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:55.312358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:55.314579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:55.514572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.526832 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e459ef1-0b50-449a-ba38-4165d99fe1eb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1309 microversion: 2.1 time: 0.474087 Oct 04 18:05:55.527511 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1802/3484] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1309 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:55.953279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:55.963670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4740fab8-fa40-474b-8b6a-287c26842e02 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.675945 Oct 04 18:05:55.983244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1683/3485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:55.992453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:55.993281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.001618 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 HTTP/1.1 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4'} Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:56.004205 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:56.009626 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:56.009626 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:56.009626 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:56.009626 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. Oct 04 18:05:56.009626 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:56.011096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:56.012188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-009fac2f-3ae8-4c16-8c73-6af79d91407f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4" status: 404 len: 111 microversion: 2.1 time: 0.024588 Oct 04 18:05:56.018405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1803/3486] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:55 2022] GET /compute/v2.1/servers/0babde2c-c2cb-4348-a5f3-bc5a2a3ed2a4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:56.025513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.026708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.035666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.036539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.037151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.038081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.038752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.039359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.048661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.053867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.083947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.087284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.089731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.091245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.092109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.094436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.423833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.434584 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14bd3120-dadf-4928-9d1f-9b415de4bca5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1470 microversion: 2.1 time: 0.397433 Oct 04 18:05:56.435273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1804/3487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1470 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.443917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8ca415-2151-4ac4-a246-9fe38706fce2", "name": "network-vif-plugged", "status": "completed", "tag": "cfd5e7ae-0dce-4f3b-857e-757cac25b3e1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:56.479597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.480353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.482487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.497861 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] Creating event network-vif-plugged:cfd5e7ae-0dce-4f3b-857e-757cac25b3e1 for instance fb8ca415-2151-4ac4-a246-9fe38706fce2 on n-h2-831194-21 Oct 04 18:05:56.509743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-fbfbebcb-57fc-4c3a-8315-699e7e6b3064 req-bb52a631-9a9f-479a-95e3-946efd0d2dc3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063643 Oct 04 18:05:56.510154 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1805/3488] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:56.529678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:56.541070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-adb958f9-038b-478d-af33-09da85dd1675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.521719 Oct 04 18:05:56.542092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1684/3489] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:56.552397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.553396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.569597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:56.570759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.571436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.572076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.572977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.574328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:56.575244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.579096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.592851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.593969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.594730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:56.595924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:56.596821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:56.597699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.060278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.064703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:57.073937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e359fa19-a2d1-4d62-91bb-aaadc05ef7ec tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1490 microversion: 2.1 time: 0.525778 Oct 04 18:05:57.085707 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1806/3490] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1490 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.120327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:57.123696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.138146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.145122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.146111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.147208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.147846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.151914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.285299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.294490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6bb74aa6-f698-4d02-bd49-ea7c9ed864ed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "PUT /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1085 microversion: 2.1 time: 0.178607 Oct 04 18:05:57.295170 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1807/3491] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:05:57 2022] PUT /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1085 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:05:57.316483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.320350 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72964030-7a64-47ac-b465-b121cb883713 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.754719 Oct 04 18:05:57.323059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.323816 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1685/3492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:56 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.338403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.342318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.343133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.346380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.347059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.348593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.461651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.462356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.470745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.471228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.471855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.472735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.473504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.474169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.689307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.725988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7161ddf9-f230-4476-a520-36878732714c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1511 microversion: 2.1 time: 0.413909 Oct 04 18:05:57.727462 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1808/3493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1511 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.753232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25073b4-1ee3-451b-853f-ee7213f645be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-178178056", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:57.764619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:57.778765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4a65792-f139-4020-a81f-c5c6d5e3085e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1462 microversion: 2.1 time: 0.321936 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25073b4-1ee3-451b-853f-ee7213f645be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 237 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-178178056", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-178178056', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.780345 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25073b4-1ee3-451b-853f-ee7213f645be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:57.786243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e25073b4-1ee3-451b-853f-ee7213f645be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038854 Oct 04 18:05:57.790409 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1809/3494] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:57 2022] POST /compute/v2.1/servers => generated 139 bytes in 60 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:57.790639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1686/3495] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1462 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:57.801495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.802146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.806751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:57.807853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:57.828181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.828802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.829279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.830035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.830542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.830975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.837112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.837695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.838225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:57.839045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:57.839548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:57.840229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.179287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.179765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.197617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:05:58.209854 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30e6d92f-6a9f-4919-9885-3bef008db000 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.418775 Oct 04 18:05:58.226496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3677b58e-50d8-40cb-829f-19ac37987342 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1511 microversion: 2.1 time: 0.411682 Oct 04 18:05:58.227044 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1810/3496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1511 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.228506 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1687/3497] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:57 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.241435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.242779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.243637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.244504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.263645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.264154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.264789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.265305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.265722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.266261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.267070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.267886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.268490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.268918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.269441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.270121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.498704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.516776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63ff45b3-1e05-4903-85fb-4515bceebb3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1462 microversion: 2.1 time: 0.288575 Oct 04 18:05:58.518006 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1811/3498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1462 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.523204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.523995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.531407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.532286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.532978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.534028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.535932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.536629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.572069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:05:58.587110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:58.597560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14f862eb-9a54-4219-81ff-6618dde8f679 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.360143 Oct 04 18:05:58.599713 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1688/3499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:58.604929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca3fc935-f9bd-4b0c-910b-15189f36d47d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'create', calling method: .version_select at 0x7fbdbdc25b80>, body: {"keypair": {"name": "tempest-keypair-1682318482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMaZas5OgdL6kW/tYo9/t1F08orjQFzr8urDeul1ljv/0bsvchFCQyar9QHNOkNrVL6TG+WKedOK4e4jJPxBdCohRw1FkqFcw0TKPb2VV2DxciEkkE+rLdyiOVdQ2P5wcQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:58.623507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ca3fc935-f9bd-4b0c-910b-15189f36d47d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:05:58.630959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ca3fc935-f9bd-4b0c-910b-15189f36d47d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:05:58.660320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca3fc935-f9bd-4b0c-910b-15189f36d47d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.059307 Oct 04 18:05:58.661731 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1689/3500] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:05:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:05:58.775181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8940d0d-710c-4432-a67e-b827d049a13b tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 204 len: 0 microversion: 2.1 time: 0.255643 Oct 04 18:05:58.779281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1812/3501] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:05:58 2022] DELETE /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:05:58.788374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:58.789881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:58.797433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.798330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.799041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.800051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:58.800713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:58.801380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:58.968409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4038007a-7253-4eb1-bcdb-510286a021e0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2095317879", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4038007a-7253-4eb1-bcdb-510286a021e0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 235 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2095317879", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2095317879', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.975706 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4038007a-7253-4eb1-bcdb-510286a021e0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:58.981425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4038007a-7253-4eb1-bcdb-510286a021e0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.014349 Oct 04 18:05:58.985618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1813/3502] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:05:58 2022] POST /compute/v2.1/servers => generated 133 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:05:59.000333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.006667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.037793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.040717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.041337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.042268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.043225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.044019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.246766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.257533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cbf6895f-5216-4aad-ad21-da857661acca tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1517 microversion: 2.1 time: 0.473891 Oct 04 18:05:59.259434 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1690/3503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1517 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.409209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.420422 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16117c1a-8174-45ce-9494-abc7f79780fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.433898 Oct 04 18:05:59.442255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1814/3504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:58 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.453407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.454462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.460955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.461800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.462534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.463476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.464186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.465062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.789925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:05:59.798755 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24c1758f-b42a-4855-8192-220968e110d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.349569 Oct 04 18:05:59.827636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:05:59.828185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: bba30506-9d90-4657-9e63-bcd2ce938c78] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.833523 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1691/3505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:05:59.834855 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/bba30506-9d90-4657-9e63-bcd2ce938c78/action HTTP/1.1 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 13 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: {"pause": {}} Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bba30506-9d90-4657-9e63-bcd2ce938c78', 'body': {'pause': {}}} Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:05:59.846156 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance bba30506-9d90-4657-9e63-bcd2ce938c78 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:05:59.855606 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1a7f7b8-0de2-43a7-b1db-33a65eea34ac tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/bba30506-9d90-4657-9e63-bcd2ce938c78/action" status: 404 len: 111 microversion: 2.1 time: 0.025745 Oct 04 18:05:59.862283 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1815/3506] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:05:59 2022] POST /compute/v2.1/servers/bba30506-9d90-4657-9e63-bcd2ce938c78/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:05:59.864486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:05:59.865657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:05:59.887866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.888941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.889395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:05:59.890179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:05:59.890647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:05:59.891075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.288468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.289080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.302905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.303994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.305694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.308091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.308633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.309156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.352714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.366292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d71abea8-d0f0-4ebb-b04f-1c199ecf51aa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.509361 Oct 04 18:06:00.369541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1692/3507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:05:59 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.397478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.398689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.414393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.415546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.415996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.416720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.417181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.417611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.692236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:00.700624 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f412d881-46f2-46a6-b3a2-9be1dbd8934d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.308009 Oct 04 18:06:00.701210 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1693/3508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:00.726416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:00.726975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.744741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.747659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.748577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.749842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.750549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.751635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.868330 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a182f30c-527a-4515-b18a-ab18e0ad8ec9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.145396 Oct 04 18:06:00.875388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1694/3509] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:00 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:00.901636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:00.905130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:00.923433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.924197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.925035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:00.925967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:00.926646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:00.927263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:01.161947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.176792 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d09ef7e1-5b50-47b4-bdb2-2a94d31ce06d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1510 microversion: 2.1 time: 0.297797 Oct 04 18:06:01.177396 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1695/3510] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:01.203182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:01.212649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a50ec112-c155-4c41-8640-f82ebf35804a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1517 microversion: 2.1 time: 0.931409 Oct 04 18:06:01.213246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1816/3511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:00 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1517 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.620860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c361d5e-4bc2-4c81-ae91-e31aac302fe7 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.631931 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c361d5e-4bc2-4c81-ae91-e31aac302fe7 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.153840 Oct 04 18:06:01.642819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1696/3512] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.647847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fda24139-c7e4-4d93-a6af-5e2353a61368 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.669443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fda24139-c7e4-4d93-a6af-5e2353a61368 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.025843 Oct 04 18:06:01.670338 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1817/3513] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.687130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba4237bb-e0af-4f6b-8b1d-0586aec0963d tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.698651 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba4237bb-e0af-4f6b-8b1d-0586aec0963d tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017497 Oct 04 18:06:01.706625 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1697/3514] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.713628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-569bfe3c-c4f2-466c-9808-53bbed85178f tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.722058 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-569bfe3c-c4f2-466c-9808-53bbed85178f tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012055 Oct 04 18:06:01.722894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1818/3515] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.737370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50c7f50c-a3b7-4624-a296-cec694784d26 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.766925 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50c7f50c-a3b7-4624-a296-cec694784d26 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.035314 Oct 04 18:06:01.768179 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1698/3516] 10.222.0.42 () {58 vars in 1165 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.787011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28694e1d-6624-4c2c-bd2d-764840666591 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.797476 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28694e1d-6624-4c2c-bd2d-764840666591 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015503 Oct 04 18:06:01.798376 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1819/3517] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.814252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e6e9181-8248-47cf-b0a5-8631f9258074 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.842703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e6e9181-8248-47cf-b0a5-8631f9258074 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.033888 Oct 04 18:06:01.843385 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1699/3518] 10.222.0.42 () {58 vars in 1169 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.871652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cedce21d-a8ec-4917-80d5-2a6f2ac9e7ca tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.886510 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cedce21d-a8ec-4917-80d5-2a6f2ac9e7ca tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.020523 Oct 04 18:06:01.887292 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1820/3519] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.902040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aedf471d-1f85-4457-83ef-f48a5b30b9d5 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.912355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aedf471d-1f85-4457-83ef-f48a5b30b9d5 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014225 Oct 04 18:06:01.913159 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1700/3520] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:01.926799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7869e65f-e99e-474e-b9ed-19c5a0a50c29 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:01.972910 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7869e65f-e99e-474e-b9ed-19c5a0a50c29 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.050387 Oct 04 18:06:01.973524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1821/3521] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:01.994276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f196e52e-8012-40b4-a05e-364d45ecc001 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.006268 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f196e52e-8012-40b4-a05e-364d45ecc001 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015707 Oct 04 18:06:02.020976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f028b7b5-cb30-4080-8d1f-98c8b6300d8f tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.023003 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1701/3522] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:02.070731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f028b7b5-cb30-4080-8d1f-98c8b6300d8f tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.054536 Oct 04 18:06:02.087998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1822/3523] 10.222.0.42 () {58 vars in 1144 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.090625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fe03420-c3ed-4e78-a36d-6f160882d8bb tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.098982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1fe03420-c3ed-4e78-a36d-6f160882d8bb tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012473 Oct 04 18:06:02.100358 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1702/3524] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:02.113465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e6d33c2-01ee-4639-9c4f-567b0a800c20 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.137153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:02.153450 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e6d33c2-01ee-4639-9c4f-567b0a800c20 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.043090 Oct 04 18:06:02.154802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1823/3525] 10.222.0.42 () {58 vars in 1148 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.170870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1737563-dbd3-4616-8fe4-09122dd3f1f1 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.194232 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1737563-dbd3-4616-8fe4-09122dd3f1f1 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.028775 Oct 04 18:06:02.195267 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1703/3526] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:02.205816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.206619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.214642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06596e19-cd56-4004-88ae-7af07cf9f142 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.223141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.223141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.223141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.224402 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06596e19-cd56-4004-88ae-7af07cf9f142 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017687 Oct 04 18:06:02.225000 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1704/3527] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:02.225339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.226140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.228498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.241366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.242439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.250690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.251704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.252444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.254389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.255054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.255685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.347158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.359497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3782421a-7c55-4980-820c-489fcea8574f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1475 microversion: 2.1 time: 0.126080 Oct 04 18:06:02.361709 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1705/3528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1475 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:02.367997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff57c806-84c8-420c-9e9f-5550e1f0de88 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.420591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff57c806-84c8-420c-9e9f-5550e1f0de88 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.056593 Oct 04 18:06:02.423031 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1706/3529] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.442754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6b067fe-03d1-409f-932c-32a6281327da tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.491017 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6b067fe-03d1-409f-932c-32a6281327da tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053311 Oct 04 18:06:02.491895 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1707/3530] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.511340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a905a05a-e5cf-45c5-89b5-0f5f05f25625 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:02.548527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a905a05a-e5cf-45c5-89b5-0f5f05f25625 tempest-FlavorsV2TestJSON-1307313714 tempest-FlavorsV2TestJSON-1307313714-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035828 Oct 04 18:06:02.549553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1708/3531] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:02.607184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e10c3a89-ee61-4496-829d-1f69e54a0da9", "name": "network-vif-deleted", "tag": "63ce1c72-8b68-40af-8535-9c32e01ff966"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:02.640844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.641398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.642070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.698023 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] Creating event network-vif-deleted:63ce1c72-8b68-40af-8535-9c32e01ff966 for instance e10c3a89-ee61-4496-829d-1f69e54a0da9 on n-h1-831194-21 Oct 04 18:06:02.721048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6c2d463b-7aea-41ed-ae9c-0c298c51e4dd req-b41aee40-378e-46f9-bb93-c432a3d8a9f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114152 Oct 04 18:06:02.728347 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1709/3532] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:02.744815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:02.762639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4025961b-9648-47e1-a7ee-26bf5620f9f8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1490 microversion: 2.1 time: 0.561935 Oct 04 18:06:02.794270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:02.794925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.802077 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1824/3533] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:02 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1490 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:02.805151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:02.806895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.814931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.815864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.816980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.818753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.821251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.883825 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'pause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state paused Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 13 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: {"pause": {}} Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot 'pause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state paused Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'pause': {}}} Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state paused. Cannot pause while the instance is in this state. Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state paused Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:02.889039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:02.894949 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:02.894949 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:02.894949 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:02.894949 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state paused Oct 04 18:06:02.894949 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:02.898188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'pause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state paused {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:02.898188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b97aa35b-3198-4cc9-b398-4664b4f21502 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 143 microversion: 2.1 time: 0.109090 Oct 04 18:06:02.898702 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1710/3534] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 143 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:02.909522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:02.910032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:02.936717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.943226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.944525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:02.947259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:02.948576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:02.953086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.175135 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb0783ff-8eb2-4cc8-b115-5eb4350e471e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.270558 Oct 04 18:06:03.178135 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1825/3535] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:02 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:03.195411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.201644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.240913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.248052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.256930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.258933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.264385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.264908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.387312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.388759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:03.408138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.410540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.411110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.425328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.434632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.435094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.533113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.534173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.534863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.535567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid e10c3a89-ee61-4496-829d-1f69e54a0da9 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:03.653715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.665351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ce030ca-428d-40bc-a884-ce73061da711 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 200 len: 1320 microversion: 2.1 time: 0.283237 Oct 04 18:06:03.682212 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1826/3536] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.848914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b3d97de-045d-45e8-9768-3edabb106d66 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '.version_select at 0x7fbdbc870550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.853568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b3d97de-045d-45e8-9768-3edabb106d66 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:03.854204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b3d97de-045d-45e8-9768-3edabb106d66 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:03.854775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b3d97de-045d-45e8-9768-3edabb106d66 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:03.863951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b3d97de-045d-45e8-9768-3edabb106d66 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/os-migrations" status: 200 len: 811 microversion: 2.1 time: 0.020581 Oct 04 18:06:03.879069 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1827/3537] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/os-migrations => generated 811 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.893367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18df85a4-ec56-45de-80b0-0825ebd5b7f4 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.894927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:03.900802 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18df85a4-ec56-45de-80b0-0825ebd5b7f4 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011058 Oct 04 18:06:03.909068 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1828/3538] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:03.909322 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b78b78c8-1ca3-4f18-ab96-dcbbfaafe79a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1497 microversion: 2.1 time: 0.726544 Oct 04 18:06:03.909322 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1711/3539] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1497 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:03.915073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd28c8e2-3246-4026-8e1c-afece12dc7f4 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1181302618", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:03.941094 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd28c8e2-3246-4026-8e1c-afece12dc7f4 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.030086 Oct 04 18:06:03.941713 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1829/3540] 10.222.0.42 () {60 vars in 1146 bytes} [Tue Oct 4 18:06:03 2022] POST /compute/v2.1/flavors => generated 499 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:03.954252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26d466aa-6100-4ef4-83e0-0c8d41b52369 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:03.963253 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26d466aa-6100-4ef4-83e0-0c8d41b52369 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013041 Oct 04 18:06:03.964156 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1712/3541] 10.222.0.42 () {58 vars in 1182 bytes} [Tue Oct 4 18:06:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:04.134109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-79579741", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "477fbca8-e546-4479-9705-5f0077981483"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:04.220598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:04.692365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.693720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.705667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.708227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.719113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.720351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.723045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.723763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.765224 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 HTTP/1.1 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e10c3a89-ee61-4496-829d-1f69e54a0da9'} Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:04.778367 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:06:04.783146 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:04.787731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:04.788923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48375398-339e-4338-830b-c26b34d57ab9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 404 len: 111 microversion: 2.1 time: 0.100348 Oct 04 18:06:04.793418 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1713/3542] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:04.859764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:04.861122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:04.861798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:04.862417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:04.863035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:04.892512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.902976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.906033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.908279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.910975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.913313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.944817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:04.945971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:04.968664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.969990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.971095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.972766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:04.973871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:04.974619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:04.975799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:04.997302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:05.030712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:05.036026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:05.153723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6632502-11a6-4d86-bbc5-fbe72f3e3f0f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021594 Oct 04 18:06:05.155297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1830/3543] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:05.164005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-321179854", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5354a813-4786-4b4f-91a3-2bccb8bd3bbc"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:05.285728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] validate_networks() for [('5354a813-4786-4b4f-91a3-2bccb8bd3bbc', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:05.753478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:05.770275 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94772d06-2863-49cb-af14-5996bd02cefa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.829388 Oct 04 18:06:05.773731 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1714/3544] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:04 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:05.787204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc5e253d-6f77-47a8-9952-a6c283df29dc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:05.788161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc5e253d-6f77-47a8-9952-a6c283df29dc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.002345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc5e253d-6f77-47a8-9952-a6c283df29dc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:06.022220 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc5e253d-6f77-47a8-9952-a6c283df29dc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1277 microversion: 2.1 time: 0.244382 Oct 04 18:06:06.025917 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1715/3545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:05 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:06.044489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.048269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.070473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.071552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.072312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.092657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.093254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.093713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.546884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:06.563230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a7b0738-393e-4a0e-8d98-2bd09a6053db tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.531554 Oct 04 18:06:06.586958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1716/3546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:06.602996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:06.609136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.628999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.635388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.638002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.639841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.641119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.644144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.691662 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action HTTP/1.1 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 28 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: {"reboot": {"type": "SOFT"}} Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e027e87e-91c7-43d2-b904-d227fa91c486', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:06.695481 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:06.701062 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:06.706422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:06.709623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd102250-9207-42ea-9894-92943957d80d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action" status: 404 len: 111 microversion: 2.1 time: 0.118246 Oct 04 18:06:06.711631 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1717/3547] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:06 2022] POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:06.731985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:06.736294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:06.760972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.762377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.766675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:06.767880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:06.768997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:06.769702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.570721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:07.571208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:07.572213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:07.572722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:07.574199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:07.608765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.626961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.629979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.639826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.643502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.645355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:07.711545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:07.729640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Getting quotas for user be9a279829be4d62b6dc849fc988bb4a and project dbed17a220334e15871c3afb682ce4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:07.764097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:07.772502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:07.952344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27ca0bec-f052-4b89-8fc3-3bf735971cc8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.789483 Oct 04 18:06:07.959381 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1831/3548] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:07.984120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:07.984801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:07.998085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:07.998875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:07.999327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.014449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.015275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.016008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.056407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.077122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ee40643-54e9-4b7d-bc7c-758db566efda tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.359900 Oct 04 18:06:08.098221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1718/3549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:06 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:08.112204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caecc60b-09a4-4fa2-ae49-f98664a2dd55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.130988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-caecc60b-09a4-4fa2-ae49-f98664a2dd55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.304966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-caecc60b-09a4-4fa2-ae49-f98664a2dd55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.318748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-caecc60b-09a4-4fa2-ae49-f98664a2dd55 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1208 microversion: 2.1 time: 0.219014 Oct 04 18:06:08.334514 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1719/3550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1208 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.348047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:08.357477 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-39b3a9e0-7877-4ace-807a-8b9e9e258b9c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1347 microversion: 2.1 time: 0.396879 Oct 04 18:06:08.371583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.382973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:08.384602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1832/3551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:07 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1347 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:08.409289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.409800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.410278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.418183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:08.418755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:08.419274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:08.891419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-606eb6cd-4bbe-4536-84b7-9aff2e384263 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdbc7aba60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:08.960257 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-606eb6cd-4bbe-4536-84b7-9aff2e384263 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd" status: 200 len: 636 microversion: 2.1 time: 0.074646 Oct 04 18:06:08.971625 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1833/3552] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd => generated 636 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:08.979750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6876b3a8-e3e3-42be-8f5f-78bf58d6c56e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdc1d2b280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:09.028272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:09.052476 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12b91c96-45d4-4926-ae03-c70ab530674e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.690543 Oct 04 18:06:09.052967 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1720/3553] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:08 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.085815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:09.088956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.103838 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd/action HTTP/1.1 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 28 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: {"reboot": {"type": "SOFT"}} Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd', 'body': {'reboot': {'type': 'SOFT'}}} Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. Oct 04 18:06:09.117112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. Oct 04 18:06:09.124027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:09.125365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:09.127423 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f91a526-4b57-4d97-912b-df4527fc3806 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd/action" status: 404 len: 111 microversion: 2.1 time: 0.046348 Oct 04 18:06:09.128518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6876b3a8-e3e3-42be-8f5f-78bf58d6c56e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:09.131379 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1721/3554] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:09 2022] POST /compute/v2.1/servers/74a8ee5f-dc26-4fd7-b387-dfff4cd6a5dd/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:06:09.146871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6876b3a8-e3e3-42be-8f5f-78bf58d6c56e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:09.147793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.149514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.161469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.162400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.163110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.164344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.165106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.165773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.778627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:09.782737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:09.800017 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8e734cd-9a7d-4d69-8f62-3924364b45ea tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.654074 Oct 04 18:06:09.830800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1722/3555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:09.853209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:09.857654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:09.888806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.890201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.892450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.895125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:09.896891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:09.899612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:09.989636 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6876b3a8-e3e3-42be-8f5f-78bf58d6c56e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 1.017066 Oct 04 18:06:09.991013 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1834/3556] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:08 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:06:10.005404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.011795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.031120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.034812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.035533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.036486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.038962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.040423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.124309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.136236 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-804f21fa-fcf5-460e-8fa0-5089a4f1546a tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1260 microversion: 2.1 time: 0.303664 Oct 04 18:06:10.137874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1723/3557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1260 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.145709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.146887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.155738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.156645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.157322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.158585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.160151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.161393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.260620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.265597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:10.283038 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-74561b1e-f745-4c23-90e7-9fde93bb0b39 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1335 microversion: 2.1 time: 0.277776 Oct 04 18:06:10.285223 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1835/3558] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:09 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1335 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.292319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e68f5554-f801-4f5e-929b-0408dbd8ba68 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdbc7a4ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.498408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:10.512515 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-270e8900-64b5-4969-ac11-bf88c66ec524 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.372685 Oct 04 18:06:10.536477 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1724/3559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:10.545433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:10.552943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.567460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.572752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.573221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.577616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.578944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.586743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.651237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action HTTP/1.1 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 65 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e027e87e-91c7-43d2-b904-d227fa91c486', 'body': {'rebuild': {'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1'}}} Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:06:10.653814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:10.660723 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3fce7a59-d1da-4a2a-8214-d53cf50751fa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action" status: 404 len: 111 microversion: 2.1 time: 0.117488 Oct 04 18:06:10.666224 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1725/3560] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:10 2022] POST /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486/action => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:10.671757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:10.686710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:10.701965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.702477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.702939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.703668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:10.704145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:10.704634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:10.958331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e68f5554-f801-4f5e-929b-0408dbd8ba68 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "DELETE /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.671584 Oct 04 18:06:10.959843 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1836/3561] 10.222.0.42 () {58 vars in 1296 bytes} [Tue Oct 4 18:06:10 2022] DELETE /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_version => generated 0 bytes in 674 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:06:10.974342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c3c2619-2410-4296-b7c2-6dc281227315 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdbc7abee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.081961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c3c2619-2410-4296-b7c2-6dc281227315 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 37 microversion: 2.1 time: 0.106925 Oct 04 18:06:11.085678 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1837/3562] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 37 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:11.109176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d860010-b117-4539-8ef8-f4f23d91e015 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbc8705e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:11.215676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.223331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-5d860010-b117-4539-8ef8-f4f23d91e015 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:11.228591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-375991e3-44c0-4515-bd38-7d65e694afde tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.561009 Oct 04 18:06:11.229677 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1726/3563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:10 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:11.248249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.249188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.255704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-5d860010-b117-4539-8ef8-f4f23d91e015 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:11.266781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.268035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.268535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.274873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.279182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.279732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.504062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:11.518236 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7ed0f12-4bb2-407d-b51c-ea36b350690f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1266 microversion: 2.1 time: 0.284910 Oct 04 18:06:11.533023 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1727/3564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:11.550239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.551342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.586181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.587349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.588140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.590066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.591093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.591872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.770612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d860010-b117-4539-8ef8-f4f23d91e015 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.674989 Oct 04 18:06:11.771657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1838/3565] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:11 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:11.780510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:11.781562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:11.790294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.790797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.791237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:11.791964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:11.802988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:11.803504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.075539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.130358 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f32f20a4-9beb-461f-8226-a35aa9c74d1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1335 microversion: 2.1 time: 0.355743 Oct 04 18:06:12.132284 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1839/3566] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1335 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.138810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f1b84e5-e38f-4843-8b39-588e24e25ca3 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdc1d42b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.196125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f1b84e5-e38f-4843-8b39-588e24e25ca3 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.061273 Oct 04 18:06:12.196746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1840/3567] 10.222.0.42 () {58 vars in 1290 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_distro => generated 33 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:12.212730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48a63ca1-11f8-4caf-becf-ac9d3afd2ab8 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbc748280>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:12.265360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.279229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42f9e5eb-f338-4265-8d69-39685b448b63 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.744042 Oct 04 18:06:12.280170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1728/3568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:11 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:12.298006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-48a63ca1-11f8-4caf-becf-ac9d3afd2ab8 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:12.312377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:12.316322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 538d8889-2f6a-44d2-a29c-ec4180addf9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.322552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-48a63ca1-11f8-4caf-becf-ac9d3afd2ab8 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:12.347762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/538d8889-2f6a-44d2-a29c-ec4180addf9d/action HTTP/1.1 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 65 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '538d8889-2f6a-44d2-a29c-ec4180addf9d', 'body': {'rebuild': {'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1'}}} Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 04 18:06:12.351633 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 538d8889-2f6a-44d2-a29c-ec4180addf9d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47f06992-5741-42f8-abd9-066955487a92 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/538d8889-2f6a-44d2-a29c-ec4180addf9d/action" status: 404 len: 111 microversion: 2.1 time: 0.048733 Oct 04 18:06:12.364724 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1729/3569] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:12 2022] POST /compute/v2.1/servers/538d8889-2f6a-44d2-a29c-ec4180addf9d/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:12.371098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.371676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.395464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.396141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.404583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.405995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.407158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.416511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.684610 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48a63ca1-11f8-4caf-becf-ac9d3afd2ab8 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.478464 Oct 04 18:06:12.685207 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1841/3570] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:12 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:12.690622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:12.691266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:12.711673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.712170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.712612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.713459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:12.713782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:12.725335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:12.984439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:12.994032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-163c167e-3df1-4dbf-b730-25aa54cf9754 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1266 microversion: 2.1 time: 0.307266 Oct 04 18:06:12.995407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1842/3571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1266 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.000966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-885b9b4c-98c2-4a7c-86fe-a58ef00e9b5f tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdbc7c7d30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.069374 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-885b9b4c-98c2-4a7c-86fe-a58ef00e9b5f tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.071913 Oct 04 18:06:13.070404 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1843/3572] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:13.083566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-274a1f2f-d13e-4341-b7c0-64a714e84e18 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbc748670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:13.155224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.165731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5457ba08-bb9f-4366-a93d-43016f1e6675 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.800936 Oct 04 18:06:13.170676 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1730/3573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:12 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.191453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.194647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.228253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.231249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.232775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.233388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-274a1f2f-d13e-4341-b7c0-64a714e84e18 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:13.236525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.237269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.239468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.241701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-274a1f2f-d13e-4341-b7c0-64a714e84e18 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:13.555915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-274a1f2f-d13e-4341-b7c0-64a714e84e18 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.476348 Oct 04 18:06:13.556512 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1844/3574] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:13 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:06:13.584110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:13.584851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:13.612271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.616498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.617104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.620352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:13.626536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:13.637745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:13.715631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:13.727122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82ba0565-b7d8-490d-a827-be14da2bc82e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.553831 Oct 04 18:06:13.737292 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1731/3575] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:13.757130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c609b168-4194-408d-9e3f-37f0bafd24eb tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbd827ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:13.828117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c609b168-4194-408d-9e3f-37f0bafd24eb tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:13.834881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c609b168-4194-408d-9e3f-37f0bafd24eb tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:14.180543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:14.190791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ed19a04-ac2a-46aa-8547-c145afb80ddd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.624857 Oct 04 18:06:14.191270 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1845/3576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:13 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:14.228496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.231380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.253086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.254412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.255310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.257156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.257892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.258489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.379455 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c609b168-4194-408d-9e3f-37f0bafd24eb tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.640737 Oct 04 18:06:14.380390 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1732/3577] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:13 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 64 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:14.392022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:14.393570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 0b2b9e86-ad93-4a40-bb45-cce40d66a68f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.402524 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/0b2b9e86-ad93-4a40-bb45-cce40d66a68f/action HTTP/1.1 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 15 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: {"restore": {}} Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0b2b9e86-ad93-4a40-bb45-cce40d66a68f', 'body': {'restore': {}}} Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:14.406285 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:14.413431 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:14.413431 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:14.413431 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. Oct 04 18:06:14.413431 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:14.416267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 0b2b9e86-ad93-4a40-bb45-cce40d66a68f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:14.417653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f01a861f-0caf-4a35-9aa7-0ac55185e035 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/0b2b9e86-ad93-4a40-bb45-cce40d66a68f/action" status: 404 len: 111 microversion: 2.1 time: 0.031508 Oct 04 18:06:14.418658 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1733/3578] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:14 2022] POST /compute/v2.1/servers/0b2b9e86-ad93-4a40-bb45-cce40d66a68f/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:14.428027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39fc538e-1ebb-4c38-b73c-c756cde2213e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdbd86ae50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.491979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-39fc538e-1ebb-4c38-b73c-c756cde2213e tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 64 microversion: 2.1 time: 0.071348 Oct 04 18:06:14.502285 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1734/3579] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 64 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:14.508429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:14.509353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:14.518831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.519726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.520480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:14.522083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:14.523657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:14.524981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.153192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:15.177400 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eae353b1-bf9f-4987-ba4c-0aabd0b7f787 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.967561 Oct 04 18:06:15.178046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1846/3580] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:15.202936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-383c6a8c-81cc-47fb-b9ad-f8cf7c4f24c7 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbc7abc10>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:15.286270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-383c6a8c-81cc-47fb-b9ad-f8cf7c4f24c7 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:15.301880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-383c6a8c-81cc-47fb-b9ad-f8cf7c4f24c7 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:15.499510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:15.511724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-094a9530-490b-4c89-b607-21110208d872 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.004186 Oct 04 18:06:15.527931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1735/3581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:14 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:15.564545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:15.579888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:15.615368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.618070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.619838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:15.621514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:15.623599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:15.624325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.010074 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-383c6a8c-81cc-47fb-b9ad-f8cf7c4f24c7 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.816827 Oct 04 18:06:16.012054 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1847/3582] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:15 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:16.018382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.037349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:16.046323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.047556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.052463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.078488 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] Creating event network-changed:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:06:16.084114 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-eac0f3cc-364c-41f9-9415-3ad795d18982 req-c8a9e4a4-0b3f-41ef-af04-a9c5803056ba service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070449 Oct 04 18:06:16.087510 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1848/3583] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:16.097053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.099069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.112708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.114082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.115189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.117641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.119145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.120218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.362060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.371391 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80c15f47-5970-4adb-87ee-e7cf2f902620 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.834830 Oct 04 18:06:16.381859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1736/3584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:15 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:16.404147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fff4c81c-3a0b-4083-ac04-e3277c6ab4b0 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update', calling method: .version_select at 0x7fbdc1c5aaf0>, body: {"meta": {"os_version": "alt"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.509150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fff4c81c-3a0b-4083-ac04-e3277c6ab4b0 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:16.523445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fff4c81c-3a0b-4083-ac04-e3277c6ab4b0 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:16.658609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:16.671272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b810a84-198c-432d-bcc6-6e6cc36a0f83 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.581599 Oct 04 18:06:16.675162 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1849/3585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:16.700593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:16.701713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.709063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.710196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.711077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.712136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.713177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.713916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.968046 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fff4c81c-3a0b-4083-ac04-e3277c6ab4b0 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.594795 Oct 04 18:06:16.973239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1737/3586] 10.222.0.42 () {60 vars in 1313 bytes} [Tue Oct 4 18:06:16 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata/os_version => generated 31 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:16.978808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:16.979438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:16.987208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.987723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.988152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:16.989060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:16.989732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:16.990441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.055258 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'restore' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 15 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: {"restore": {}} Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot 'restore' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'restore': {}}} Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state active. Cannot restore while the instance is in this state. Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:17.057336 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:17.062710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:17.062710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:17.062710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:17.062710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:17.062710 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:17.064649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'restore' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:17.065761 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a9e6ae4-3ae5-44cc-a3ab-ea057e5816eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 145 microversion: 2.1 time: 0.091200 Oct 04 18:06:17.066737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1738/3587] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:16 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 145 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:06:17.072216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b08236e-df53-487f-a49a-17ba37ece495 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdc1de8ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.148190 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b08236e-df53-487f-a49a-17ba37ece495 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 58 microversion: 2.1 time: 0.079991 Oct 04 18:06:17.148784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1739/3588] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 58 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:17.160906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.161804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.173143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.173888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.174723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.175696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.176648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.177341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.267676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.276525 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3310fa04-0b7e-44cc-a150-63bcf3cd3ef9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.588126 Oct 04 18:06:17.278310 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1850/3589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:16 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.283634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c43eca0-0451-4d01-9c35-facd902beb89 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'update_all', calling method: .version_select at 0x7fbdbc7d5af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:17.340525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6c43eca0-0451-4d01-9c35-facd902beb89 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:17.347180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6c43eca0-0451-4d01-9c35-facd902beb89 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:17.462740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.477084 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4bb47539-71cd-4893-a66e-4688a2250e75 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.319300 Oct 04 18:06:17.509378 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1740/3590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.522184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.528298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.541086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.544825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.545557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.546394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.547145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.548452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.686856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:17.810165 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c43eca0-0451-4d01-9c35-facd902beb89 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 61 microversion: 2.1 time: 0.530479 Oct 04 18:06:17.811295 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1851/3591] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:06:17 2022] PUT /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 61 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:17.818803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:17.820054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:17.853384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.854360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.858294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.861911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:17.862662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:17.863074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:17.923151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:17.940606 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94bf4576-17cb-4eef-917e-4cbd2af19762 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.428006 Oct 04 18:06:17.943191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1741/3592] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:17.957357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2001bcad-d375-4aed-95d5-d02c3bc53319 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Action: 'create', calling method: .version_select at 0x7fbdc1c64f70>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:18.088905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2001bcad-d375-4aed-95d5-d02c3bc53319 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:18.129857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2001bcad-d375-4aed-95d5-d02c3bc53319 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Getting quotas for user 578a9c9948d54eb89310ba856fecf6cd and project 9c4108d19d984a7f999800e49049bcb2. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:18.296957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.310686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-976850ef-837f-49e1-a636-125976a5b92d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.498165 Oct 04 18:06:18.311268 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1852/3593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:17 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:18.331200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de5e7e44-b1c9-4a49-aa18-44ba6f897f2a", "tag": "45165d1f-cb74-4191-abad-0a072c39f012"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:18.353570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.353979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.358849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.388961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] Creating event network-changed:45165d1f-cb74-4191-abad-0a072c39f012 for instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a on n-h2-831194-21 Oct 04 18:06:18.420997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1f6a28f9-f0e8-4647-af23-8d841e780eb1 req-0a847c14-bb0a-47d5-b73a-d4c86868ad1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102477 Oct 04 18:06:18.420997 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1853/3594] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:18.427875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.429722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.437347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.438331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.439790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.440937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.441678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.442970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.644017 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2001bcad-d375-4aed-95d5-d02c3bc53319 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "POST /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.698454 Oct 04 18:06:18.645202 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1742/3595] 10.222.0.42 () {60 vars in 1281 bytes} [Tue Oct 4 18:06:17 2022] POST /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 85 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:18.651153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:18.652223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 30c20916-15bc-4125-ac36-a4cc544395ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.662212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/30c20916-15bc-4125-ac36-a4cc544395ba/action HTTP/1.1 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 14 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: {"resume": {}} Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '30c20916-15bc-4125-ac36-a4cc544395ba', 'body': {'resume': {}}} Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:18.673986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 30c20916-15bc-4125-ac36-a4cc544395ba could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-daffce98-9414-46e6-a277-ba3fd9bafcc6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/30c20916-15bc-4125-ac36-a4cc544395ba/action" status: 404 len: 111 microversion: 2.1 time: 0.029441 Oct 04 18:06:18.680889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1743/3596] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:18 2022] POST /compute/v2.1/servers/30c20916-15bc-4125-ac36-a4cc544395ba/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:18.689381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df5065f9-06bc-42ff-aefd-624cad04fb61 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] Calling method '.version_select at 0x7fbdc1d5d940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.753479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df5065f9-06bc-42ff-aefd-624cad04fb61 tempest-ImagesMetadataTestJSON-1697295836 tempest-ImagesMetadataTestJSON-1697295836-project] 10.222.0.42 "GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata" status: 200 len: 85 microversion: 2.1 time: 0.073491 Oct 04 18:06:18.754186 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1744/3597] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/images/f944dc87-43ab-4202-9005-f992610b00bd/metadata => generated 85 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:06:18.773460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.774528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.799255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.807404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.810398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.812283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.812781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.815073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.902823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:18.913343 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-792c2838-cd41-4833-9c35-724c8d735529 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.490749 Oct 04 18:06:18.916138 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1854/3598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:18.975426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:18.977964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:18.988979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.989949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.990889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:18.992400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:18.993141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:18.994757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.243378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.254748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6680b753-4085-449f-9940-618bcc945707 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.499137 Oct 04 18:06:19.257626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1745/3599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.280800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.281422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.294662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.295171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.295588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.296303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.297081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.297684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.456247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.472069 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6180051-0a0a-45e1-844c-beaf44d0553b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.507505 Oct 04 18:06:19.476165 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1855/3600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:18 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.774927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:19.784482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ac3545d-3f30-4074-a02b-197a403f9df0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.507109 Oct 04 18:06:19.789905 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1746/3601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:19.806823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:19.807586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.817300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.819799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.821258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.822247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.824043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.824758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.929018 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'resume' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 14 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: {"resume": {}} Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'resume' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'resume': {}}} Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state active. Cannot resume while the instance is in this state. Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:19.933639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:06:19.938174 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:19.939763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.939763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.944449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.944948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.945390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.946553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'resume' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:19.947635 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2698071-3856-4fff-b7c9-44c5ccda83a1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 144 microversion: 2.1 time: 0.145008 Oct 04 18:06:19.951400 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1856/3602] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:19 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 144 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:06:19.961359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:19.963931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:19.971327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.972351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.975374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.982295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.983034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.983816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:19.986703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:19.991300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:19.993628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.257784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.267860 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96bdefcf-d725-4608-a2d2-9af8285738e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.310858 Oct 04 18:06:20.283040 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1857/3603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.295735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.296862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.305309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.305897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.306716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.307605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.308599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.309039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.712781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.723202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8e4dc4c-6d34-4e83-a227-98bc4133d2c6 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.790332 Oct 04 18:06:20.723787 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1747/3604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:19 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:20.749280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:20.750132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:20.755123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:20.761712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.762955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.763629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.765075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:20.766163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:20.766993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:20.774015 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca6ecfa2-291c-4d00-8d58-e3c62dcc45fd tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.481182 Oct 04 18:06:20.776378 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1858/3605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:21.044262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-41ff7cf3-d7c5-4a41-b833-7f7d8d908141 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Action: 'create', calling method: .version_select at 0x7fbdbc7c7280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-687002638"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:21.254236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.271418 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b19b2b6-6a9d-45b0-954d-79fc9f7bffd3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.531024 Oct 04 18:06:21.272078 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1748/3606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:20 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:21.284708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da3eca4c-381e-4263-817e-bfb7aeacd38d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da3eca4c-381e-4263-817e-bfb7aeacd38d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 160 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": "", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79"}]}} Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'server': {'name': '', 'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1', 'flavorRef': '452', 'networks': [{'uuid': '4ab6bc40-2c8b-4ce0-bf10-4f90b0ae8d79'}]}}} Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '' Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:06:21.293896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:06:21.300668 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:21.308844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da3eca4c-381e-4263-817e-bfb7aeacd38d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:21.310327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da3eca4c-381e-4263-817e-bfb7aeacd38d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.037119 Oct 04 18:06:21.311621 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1749/3607] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:21 2022] POST /compute/v2.1/servers => generated 108 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:06:21.323047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.324129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.337338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.338103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.338829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.340592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.341168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.341685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.368665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:21.515649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-41ff7cf3-d7c5-4a41-b833-7f7d8d908141 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.722110 Oct 04 18:06:21.526415 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1859/3608] 10.222.0.42 () {60 vars in 1155 bytes} [Tue Oct 4 18:06:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 734 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 04 18:06:21.532396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-781a6b6d-306a-4d5a-a66c-90277977a08c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc870820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.614293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-781a6b6d-306a-4d5a-a66c-90277977a08c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 344 microversion: 2.1 time: 0.086137 Oct 04 18:06:21.615159 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1860/3609] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 344 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:21.728914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:21.741480 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7767a663-8251-46ab-9123-2d82cf25183b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.423567 Oct 04 18:06:21.743086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1750/3610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:21.769985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.770648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.780693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:21.781974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:21.790415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.792962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.793624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.794502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.794858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.795300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.810199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.812957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.814082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:21.815759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:21.816467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:21.817202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.110127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.133161 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09dcf138-33bc-4cf1-a200-85d1ce1c161e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.373312 Oct 04 18:06:22.154429 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1861/3611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.186328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.202066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6019937-a59e-4fbb-877a-ba2104bae43d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.429871 Oct 04 18:06:22.205004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1751/3612] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:21 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.236640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:22.237192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: fe005e60-6a16-45a8-b9f5-33b7e5daab85] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.248444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/fe005e60-6a16-45a8-b9f5-33b7e5daab85/action HTTP/1.1 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 14 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: {"shelve": {}} Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'fe005e60-6a16-45a8-b9f5-33b7e5daab85', 'body': {'shelve': {}}} Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:22.254805 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance fe005e60-6a16-45a8-b9f5-33b7e5daab85 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8acfc980-5f1c-45eb-a671-3f50e42b092a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/fe005e60-6a16-45a8-b9f5-33b7e5daab85/action" status: 404 len: 111 microversion: 2.1 time: 0.025099 Oct 04 18:06:22.264216 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1862/3613] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:22 2022] POST /compute/v2.1/servers/fe005e60-6a16-45a8-b9f5-33b7e5daab85/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:22.266369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.266993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.280793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.281289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.281731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.282506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.282960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.283383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.301429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.302443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.314922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.315427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.316493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.317461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.318172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.318998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.576563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.588542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2227aa97-3357-4d4c-81d5-8ea2a7a9cd5b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.289386 Oct 04 18:06:22.590522 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1863/3614] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:22.641606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a35c7415-b08d-429a-a42e-91a0c6c8f94c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc748b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.774400 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a35c7415-b08d-429a-a42e-91a0c6c8f94c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 344 microversion: 2.1 time: 0.147757 Oct 04 18:06:22.784578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1864/3615] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:22.823628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:22.836762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f81267ed-3e90-4e70-9fd4-772b3708b69c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.574436 Oct 04 18:06:22.839616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1752/3616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:22.866773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:22.869771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:22.882999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.883547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.884061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.885730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.887005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.898051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-plugged", "status": "completed", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:22.905195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.913115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:22.933605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:22.936506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:22.938039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:22.968880 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] Creating event network-vif-plugged:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:06:22.990947 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-385b9464-e8f6-4571-a5ff-04b56af84d0a req-b67f38b2-8b5b-40fc-bb78-4ce42583e7ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094113 Oct 04 18:06:22.991784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1753/3617] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:23.164169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.165083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.183613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.187573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.188067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.190926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.191881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.192338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.473847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.490426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37a89935-6de8-4603-9f58-22f6447fb8f9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.331058 Oct 04 18:06:23.491039 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1754/3618] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:23.545051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:23.555133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a723b1c8-fded-4097-a32d-b7ad518f34d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.694529 Oct 04 18:06:23.556889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1865/3619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:22 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:23.584526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:23.585271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.595853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.596697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.597150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.597883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.598520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.598965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.613198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.613849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.621680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.623770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.624219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.624935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.625394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.630180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.632371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lazy-loading 'flavor' on Instance uuid 82709aba-62fd-4fbe-87c8-b951080fdd93 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:06:23.866480 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-416b16f9-3fc7-4504-b91c-ae040e6e257c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.287807 Oct 04 18:06:23.867313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1755/3620] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:23 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:23.876567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-afbda05f-822f-487f-b80c-bc8a14ed9245 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1cd0e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.949131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-afbda05f-822f-487f-b80c-bc8a14ed9245 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 345 microversion: 2.1 time: 0.080252 Oct 04 18:06:23.951010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1756/3621] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:23.956348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:23.957101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:23.965529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.966060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.966790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:23.969460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:23.970219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:23.970911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.120822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.129163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d8269b24-c2e7-483c-8a25-128f5a6984be tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.176918 Oct 04 18:06:24.129743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1757/3622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:24.134340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e6178a2-6c3b-40ae-9445-7b8774ac18e3 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Action: 'create', calling method: .version_select at 0x7fbdbe4094c0>, body: {"snapshot": {"volume_id": "f41ce79a-b6f4-448e-8ce3-62f5b87a07e2", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-985744738"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:24.219147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.228096 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b7f0777-5c8e-4ece-8693-56263f2f7b3c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1377 microversion: 2.1 time: 0.618930 Oct 04 18:06:24.239763 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1866/3623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:23 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1377 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:24.331731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e6178a2-6c3b-40ae-9445-7b8774ac18e3 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.200894 Oct 04 18:06:24.332326 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1758/3624] 10.222.0.42 () {60 vars in 1162 bytes} [Tue Oct 4 18:06:24 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:24.343582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36ea8970-5598-4867-9385-e90b736a1c58 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1ce73a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.438710 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36ea8970-5598-4867-9385-e90b736a1c58 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.099363 Oct 04 18:06:24.439586 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1867/3625] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:24.450663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-583f69c4-ddf8-41c5-ae58-0a657851314f tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1d5d5e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.504506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-583f69c4-ddf8-41c5-ae58-0a657851314f tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.057614 Oct 04 18:06:24.509495 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1759/3626] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:24.520777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9bf2f66-6f9f-4fe5-ab55-7b9fae91b771 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbd20faf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.533290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:24.534763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:24.545310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.546407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.547233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.548298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:24.549353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:24.549904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:24.554719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9bf2f66-6f9f-4fe5-ab55-7b9fae91b771 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.038927 Oct 04 18:06:24.556157 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1868/3627] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:24.710129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:24.727426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0138cfe9-85eb-4fe1-b754-89e8c3bae361 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.199642 Oct 04 18:06:24.729166 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1760/3628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:24 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.156086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.157428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.165875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.166792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.169326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.170515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.171203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.171848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.177682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:25.257154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.258040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.269986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.271506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.272528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.273716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.274865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.276495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.435224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.445251 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a6cb7ed-069c-4cdf-b3d7-cb6e300d23f7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.295006 Oct 04 18:06:25.446783 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1869/3629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:25.453263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5e7e44-b1c9-4a49-aa18-44ba6f897f2a", "name": "network-vif-plugged", "status": "completed", "tag": "45165d1f-cb74-4191-abad-0a072c39f012"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:25.466076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.467649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.468380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.485522 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] Creating event network-vif-plugged:45165d1f-cb74-4191-abad-0a072c39f012 for instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a on n-h2-831194-21 Oct 04 18:06:25.492373 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7777e25d-9076-4af7-a458-bc6be300f56b req-729f97d3-ec59-4480-ad3f-bd930b5f5019 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044122 Oct 04 18:06:25.493856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1870/3630] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:25.502601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ebd8dbc-5755-479d-a2db-4ec57ce2bb97 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd172ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.517310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.532734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-480ea165-3b28-453a-88e4-953169a77f07 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1527 microversion: 2.1 time: 0.280911 Oct 04 18:06:25.535258 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1761/3631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1527 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:25.560759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.561915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.570624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.571122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.572232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.572941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.573436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.574955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.582596 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ebd8dbc-5755-479d-a2db-4ec57ce2bb97 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291" status: 200 len: 661 microversion: 2.1 time: 0.086733 Oct 04 18:06:25.594211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1871/3632] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291 => generated 661 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:25.599429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84d536f4-901c-42d7-af9e-a901353a0600 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1ce7040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.641954 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84d536f4-901c-42d7-af9e-a901353a0600 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.046539 Oct 04 18:06:25.642691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1872/3633] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:25.653647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6ff36dc-7b28-4b82-b8de-19db4480acea tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7abca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.699127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6ff36dc-7b28-4b82-b8de-19db4480acea tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291" status: 200 len: 661 microversion: 2.1 time: 0.050391 Oct 04 18:06:25.700146 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1873/3634] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291 => generated 661 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:25.754111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.755266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:25.767305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.768250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.770440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.772100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:25.780338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:25.781182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:25.877105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:25.887535 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac50e801-c7a9-4c92-af34-81de782ebb79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1527 microversion: 2.1 time: 0.331146 Oct 04 18:06:25.888516 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1762/3635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1527 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.912124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-423c6306-f8d9-4e31-b05e-a07add62b4b7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.940063 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-423c6306-f8d9-4e31-b05e-a07add62b4b7 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/477fbca8-e546-4479-9705-5f0077981483" status: 202 len: 0 microversion: 2.1 time: 0.031666 Oct 04 18:06:25.941008 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1763/3636] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:25 2022] DELETE /compute/v2.1/flavors/477fbca8-e546-4479-9705-5f0077981483 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:25.949519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3131fbc-019d-48e2-ba52-15adfae25d43 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:25.972471 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3131fbc-019d-48e2-ba52-15adfae25d43 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026980 Oct 04 18:06:25.977889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1764/3637] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:25.992175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:25.994649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.002366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.003160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.003883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.004941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.006108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.006607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.134428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.151036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Old instance type tempest-test_resize_flavor_-1181302618, new instance type m1.heat {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:06:26.160094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:26.160511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:26.161189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:26.161473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:26.161944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:26.319942 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d84e323-4c1c-4196-8ad2-88fd81be4c98 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb/action" status: 202 len: 0 microversion: 2.1 time: 0.331797 Oct 04 18:06:26.321234 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1765/3638] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:25 2022] POST /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:06:26.342949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.347486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.360713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.361225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.361675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.366592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.367121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.367538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.371766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.384348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06563ccd-1ee5-4364-b94d-e4a285d51314 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1308 microversion: 2.1 time: 0.634640 Oct 04 18:06:26.421277 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1874/3639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:25 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:26.471552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.472419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:26.484142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.484402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.484950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.485867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:26.489238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:26.489806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:26.567161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.576295 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c4ef5ba-081c-4532-b2c6-c520df3fd2da tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1536 microversion: 2.1 time: 0.244578 Oct 04 18:06:26.577570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1766/3640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1536 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:26.654950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4209c66f-b9c9-46ba-9c78-0f30dc5b84fb tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1e610d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.691734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4209c66f-b9c9-46ba-9c78-0f30dc5b84fb tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 287 microversion: 2.1 time: 0.040610 Oct 04 18:06:26.692707 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1767/3641] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:26.710192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d010be2-955a-41ec-8500-bc85b713a34c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbca57820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.763352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:26.778468 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7601d006-5e7f-4b4f-ac71-1897f4c21bcb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.310271 Oct 04 18:06:26.779345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1875/3642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:26.798399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d010be2-955a-41ec-8500-bc85b713a34c tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 202 len: 0 microversion: 2.1 time: 0.093750 Oct 04 18:06:26.799611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1768/3643] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Oct 4 18:06:26 2022] DELETE /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:26.810389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3af9f033-d94f-42b2-8f94-392eea70d1ee tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc7704c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:26.868572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3af9f033-d94f-42b2-8f94-392eea70d1ee tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.062560 Oct 04 18:06:26.869144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1876/3644] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:26 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:27.334802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b866958-6aa0-42d5-8709-77f6c1cf135b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1de83a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.410322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:27.416148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.418130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.426946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b866958-6aa0-42d5-8709-77f6c1cf135b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883" status: 200 len: 662 microversion: 2.1 time: 0.104589 Oct 04 18:06:27.429379 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1769/3645] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883 => generated 662 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:27.434472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.435211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.435827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.436762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.450065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77eb409e-6d91-4b51-bd0b-6a8f55fdf914 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd9c4a60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.452390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.453162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.538255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77eb409e-6d91-4b51-bd0b-6a8f55fdf914 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883" status: 200 len: 662 microversion: 2.1 time: 0.100091 Oct 04 18:06:27.539154 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1770/3646] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883 => generated 662 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:27.605302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.606015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.618637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.619142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.619587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.620419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.620879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.623586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.892559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.922323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b002f0e-11d8-4ed7-825e-7c637d4ded74 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1488 microversion: 2.1 time: 0.514630 Oct 04 18:06:27.929177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1877/3647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1488 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:27.945409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:27.954119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:27.978922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.980250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.984061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.985440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:27.987524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:27.990007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:27.990618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:27.994149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae3dd68e-0072-4840-a758-a7d5ae296645 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1536 microversion: 2.1 time: 0.393167 Oct 04 18:06:28.011792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1771/3648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1536 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.029518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a33797b3-177b-44d9-90be-7a72854fb559 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1de8b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.132303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a33797b3-177b-44d9-90be-7a72854fb559 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.119071 Oct 04 18:06:28.138311 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1772/3649] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:28.143937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-625621098"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:28.151002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.158605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=20 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:28.170145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.172987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.173517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.179077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.179586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.180030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.303295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:28.324135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6bafe43b-2234-4ed9-8c0e-e642c31a09f0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "PUT /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1073 microversion: 2.1 time: 0.183669 Oct 04 18:06:28.326200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1773/3650] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:06:28 2022] PUT /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1073 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.350753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.351753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.372857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.374018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.374750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.376867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.377652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.378423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.575521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.593069 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c145184d-475d-4310-8e6b-502366c6cfef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.662362 Oct 04 18:06:28.595186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1878/3651] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:27 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.661985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:28.672457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fdfc275b-59c8-4b18-9503-a20e1e957baf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1499 microversion: 2.1 time: 0.328327 Oct 04 18:06:28.673328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1774/3652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1499 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:28.706687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:28.707895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:28.728406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.729165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.730170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:28.734766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:28.738741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:28.739445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.028119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.028806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.043763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.044330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.044787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.045523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.047018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.047475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.455731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:29.461978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:29.473084 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b11329de-6b16-4e38-8ff0-7e319df829d5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1536 microversion: 2.1 time: 0.451433 Oct 04 18:06:29.473711 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1775/3653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1536 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:29.474582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fadde8b-a941-4258-93a1-41673206e957 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1499 microversion: 2.1 time: 0.772751 Oct 04 18:06:29.476862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1879/3654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:28 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1499 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:29.490810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6dbe6cd2-f7b9-472b-a0a9-9296cb34c153 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd1558b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.537119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16b85a48-c4c0-4747-883c-b976d8a5f2c7 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc9e0820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.576205 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6dbe6cd2-f7b9-472b-a0a9-9296cb34c153 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387" status: 200 len: 662 microversion: 2.1 time: 0.097935 Oct 04 18:06:29.577023 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1880/3655] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387 => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:29.583244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:29.596792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.597549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.598232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.643590 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16b85a48-c4c0-4747-883c-b976d8a5f2c7 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 200 len: 286 microversion: 2.1 time: 0.120308 Oct 04 18:06:29.647068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1776/3656] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:29.653322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5fa8f6a-e4e9-4f54-b9f1-d6d8978ae8c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbca00040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.657405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:06:29.730870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5fa8f6a-e4e9-4f54-b9f1-d6d8978ae8c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387" status: 200 len: 662 microversion: 2.1 time: 0.081752 Oct 04 18:06:29.738301 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1777/3657] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387 => generated 662 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:29.741654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e14170a-c881-43de-812f-d92782e930a4 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "POST /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a/action" status: 202 len: 0 microversion: 2.1 time: 0.162919 Oct 04 18:06:29.742373 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1881/3658] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:29 2022] POST /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a/action => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:29.753956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.755609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:29.758604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.759655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:29.775126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.775944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.776423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.776755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.777281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.778194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.778789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.779269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.780687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:29.781840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:29.782852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:29.784847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.171421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.181178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efe577a5-270b-4bfd-9152-2b139232ff5b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.441386 Oct 04 18:06:30.181752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1778/3659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.195314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1106284609", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:30.208269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.220508 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be198a6d-70e0-45d1-8699-752726c9ed96 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.471674 Oct 04 18:06:30.233795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1882/3660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:29 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:30.274004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:30.511633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.512514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:30.527935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.531218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.536317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.537759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:30.538449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:30.539168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:30.897972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:30.912737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e27ac1de-9a55-4f1d-be60-166d3675e039 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.406161 Oct 04 18:06:30.914098 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1883/3661] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:30.935962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1da131c7-0f67-4f55-a890-91e0d0f76c94 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1ce78b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:30.966009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-1da131c7-0f67-4f55-a890-91e0d0f76c94 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] HTTP exception thrown: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1da131c7-0f67-4f55-a890-91e0d0f76c94 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Request method failure captured: Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c HTTP/1.1 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHYcMpYrcAkLlwag9yZu4K3aFMR8JTl-GdYy29quUUG96b3nSAhzk3YewiiZ92Qu4f5rufuD3QpV4BHJE_vh-bxo7r3grSrUtP0SBUjM7vUBy_8LrwHAQtJO8Q73vHInA9ooZHWdV7zUm7LG_oNvcEOgV9TeyRjgfxw7a0J405wL0R4 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: df506fc450e14dbfac7551d453e821fe Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: exception: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e51b895d-41db-4632-a271-618cd645dd3c'} Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. (HTTP 404) (Request-ID: req-527347bc-d2c9-4412-8e91-fc9714e45025) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:30.971694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1da131c7-0f67-4f55-a890-91e0d0f76c94 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Returning 404 to user: Snapshot e51b895d-41db-4632-a271-618cd645dd3c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:30.977516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1da131c7-0f67-4f55-a890-91e0d0f76c94 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c" status: 404 len: 111 microversion: 2.1 time: 0.060319 Oct 04 18:06:30.982046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1884/3662] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:06:30 2022] GET /compute/v2.1/os-snapshots/e51b895d-41db-4632-a271-618cd645dd3c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:30.987957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fd48c93-cc84-4ce7-940f-d0cea541c583 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbd1725e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.070423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:31.071642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:31.078351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:31.079004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:31.079826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:31.080082 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fd48c93-cc84-4ce7-940f-d0cea541c583 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 202 len: 0 microversion: 2.1 time: 0.095854 Oct 04 18:06:31.081567 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1885/3663] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:06:30 2022] DELETE /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:06:31.089222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebc4fb24-9466-4e98-bb5a-560e5619e9c8 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1ce78b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.093398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.093920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.094792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.096104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.096789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.097417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.118768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Getting quotas for project 4c016f78a35d468289072287c86aa591. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:31.125249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Getting quotas for user aa6904ce795943c98f374398064d0328 and project 4c016f78a35d468289072287c86aa591. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:31.141358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:31.143756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:31.185334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebc4fb24-9466-4e98-bb5a-560e5619e9c8 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 344 microversion: 2.1 time: 0.100248 Oct 04 18:06:31.186125 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1886/3664] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 344 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:31.196661 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13941713-3d82-4384-b51b-75cca8f65f3f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.009583 Oct 04 18:06:31.197881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1779/3665] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:31.223088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.223947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.247471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.248004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.248510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.249959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.250432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.250873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.256971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.258090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.280083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.280653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.281104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.281872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.282328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.282755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.578030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.594020 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2577827-200a-40ab-b6bd-22e80efd486b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.376652 Oct 04 18:06:31.595027 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1887/3666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:31.602449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-2074888296", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:31.703748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:06:31.823100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:31.833969 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6cf85f3-a99a-48cf-9720-3c25b5dcccf1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.580956 Oct 04 18:06:31.834554 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1780/3667] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:31.942462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:31.943365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:31.953315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.959681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.960466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:31.961419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:31.962084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:31.962710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.089149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:06:32.090237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:06:32.090927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:06:32.091526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:06:32.092877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:06:32.133976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.137366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.138218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.139888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.140653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.141381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.175891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Getting quotas for project 4c016f78a35d468289072287c86aa591. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:06:32.184886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Getting quotas for user aa6904ce795943c98f374398064d0328 and project 4c016f78a35d468289072287c86aa591. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:06:32.209417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:06:32.214783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:06:32.275676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.286555 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c573bc27-cc6f-42dc-977c-802658763fac tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689497 Oct 04 18:06:32.288345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1888/3668] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:06:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:06:32.290719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e325adcd-a3ff-426f-86e4-cbca9579bb91 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.352138 Oct 04 18:06:32.301855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1781/3669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:31 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.301855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-842c005f-9d5f-4d54-8db0-1368ff6bc7f7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.301855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-842c005f-9d5f-4d54-8db0-1368ff6bc7f7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.314231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58309d7b-2de4-44ae-afa3-7cab7952dd27 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc6f71f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.423863 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58309d7b-2de4-44ae-afa3-7cab7952dd27 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 344 microversion: 2.1 time: 0.133718 Oct 04 18:06:32.424763 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1889/3670] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:32.485454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-842c005f-9d5f-4d54-8db0-1368ff6bc7f7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:32.499198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-842c005f-9d5f-4d54-8db0-1368ff6bc7f7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1218 microversion: 2.1 time: 0.203082 Oct 04 18:06:32.500643 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1782/3671] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1218 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:32.629179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.630071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.648433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.649810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.650646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.653483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.670938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.671562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.863739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:32.864699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:32.879759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.881004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.883319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:32.884241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:32.887280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:32.888055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.164582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.174062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3da77a08-09ee-455d-b3b4-49465b22f5a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.315199 Oct 04 18:06:33.175714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1783/3672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:33.320599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.321461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.333185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.333942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.334587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.336545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.338377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.339231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.607225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.616572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fcfb36d-3095-4607-9fb2-b43a7e9ac2d8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.997396 Oct 04 18:06:33.617452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1890/3673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:32 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:33.654948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-861eed51-f325-4bc1-9cc4-438087da4017 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc7c7ee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.660424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.677685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4705b17-1d6b-4473-9bcb-9a154009259b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.360924 Oct 04 18:06:33.694637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1784/3674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:33.702561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:33.703182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:33.737673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.738217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.742424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.743363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:33.744048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:33.747013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:33.817753 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-861eed51-f325-4bc1-9cc4-438087da4017 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 200 len: 344 microversion: 2.1 time: 0.198313 Oct 04 18:06:33.820467 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1891/3675] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 344 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:33.911827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:33.920699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efe2c2b1-7c3f-42ae-bcac-6713fce42ed1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1270 microversion: 2.1 time: 0.225332 Oct 04 18:06:33.925075 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1785/3676] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:33 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1270 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:34.202752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.203612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.227531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.228044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.228512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.229224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.230466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.231016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.649917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:34.651826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:34.660011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.660857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.661518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.662552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:34.667398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:34.668358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:34.972895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:34.984548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adeee6e2-edea-4692-8545-0ca1b606c622 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.787638 Oct 04 18:06:34.988104 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1892/3677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.016863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.029147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.030856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.035062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d639fb06-ec4e-4713-a84b-2f7b9779790e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.390492 Oct 04 18:06:35.035795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1786/3678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.048674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.049031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7e3fed5-66ae-40bb-92d7-aa855dc2e7a4 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbd827f70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.050915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.055492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.056884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.058480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.059236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.132982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b7e3fed5-66ae-40bb-92d7-aa855dc2e7a4 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] HTTP exception thrown: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7e3fed5-66ae-40bb-92d7-aa855dc2e7a4 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Request method failure captured: Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 HTTP/1.1 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHYcMpYrcAkLlwag9yZu4K3aFMR8JTl-GdYy29quUUG96b3nSAhzk3YewiiZ92Qu4f5rufuD3QpV4BHJE_vh-bxo7r3grSrUtP0SBUjM7vUBy_8LrwHAQtJO8Q73vHInA9ooZHWdV7zUm7LG_oNvcEOgV9TeyRjgfxw7a0J405wL0R4 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: df506fc450e14dbfac7551d453e821fe Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: exception: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'f41ce79a-b6f4-448e-8ce3-62f5b87a07e2'} Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. (HTTP 404) (Request-ID: req-45d6f967-1b97-4ec8-886a-ac37bf32ffb3) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:35.149001 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.155122 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.166399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7e3fed5-66ae-40bb-92d7-aa855dc2e7a4 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Returning 404 to user: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:35.168952 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7e3fed5-66ae-40bb-92d7-aa855dc2e7a4 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 404 len: 109 microversion: 2.1 time: 0.131967 Oct 04 18:06:35.176565 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1787/3679] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 109 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:35.182264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.183440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:35.202743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.203531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.204134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.204985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:35.205555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:35.206756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:35.341511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.353130 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf90beb8-5235-4852-aca6-2063e1ae9b84 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1276 microversion: 2.1 time: 0.175122 Oct 04 18:06:35.374738 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1788/3680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1276 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:35.381722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-526fda38-dc34-4130-9f93-38f571c22c61 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdc1c583a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.452777 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-526fda38-dc34-4130-9f93-38f571c22c61 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] HTTP exception thrown: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-526fda38-dc34-4130-9f93-38f571c22c61 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Request method failure captured: Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 HTTP/1.1 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHYcMpYrcAkLlwag9yZu4K3aFMR8JTl-GdYy29quUUG96b3nSAhzk3YewiiZ92Qu4f5rufuD3QpV4BHJE_vh-bxo7r3grSrUtP0SBUjM7vUBy_8LrwHAQtJO8Q73vHInA9ooZHWdV7zUm7LG_oNvcEOgV9TeyRjgfxw7a0J405wL0R4 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: df506fc450e14dbfac7551d453e821fe Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: exception: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'f41ce79a-b6f4-448e-8ce3-62f5b87a07e2'} Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. (HTTP 404) (Request-ID: req-565b8079-f6f5-4248-92a9-8bffe7bba344) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:35.455272 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.460218 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.463498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-526fda38-dc34-4130-9f93-38f571c22c61 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Returning 404 to user: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:35.470106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-526fda38-dc34-4130-9f93-38f571c22c61 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 404 len: 109 microversion: 2.1 time: 0.089357 Oct 04 18:06:35.470776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1789/3681] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:06:35 2022] DELETE /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:35.477266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76f21728-ff0f-4b86-9813-a246308f5483 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Calling method '.version_select at 0x7fbdbc978a60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:35.512934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-76f21728-ff0f-4b86-9813-a246308f5483 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] HTTP exception thrown: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76f21728-ff0f-4b86-9813-a246308f5483 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Request method failure captured: Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 HTTP/1.1 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHYcMpYrcAkLlwag9yZu4K3aFMR8JTl-GdYy29quUUG96b3nSAhzk3YewiiZ92Qu4f5rufuD3QpV4BHJE_vh-bxo7r3grSrUtP0SBUjM7vUBy_8LrwHAQtJO8Q73vHInA9ooZHWdV7zUm7LG_oNvcEOgV9TeyRjgfxw7a0J405wL0R4 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1b7e09190aaf44bcad5794c4ce85ae31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1b7e09190aaf44bcad5794c4ce85ae31 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-786196391 Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: df506fc450e14dbfac7551d453e821fe Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesSnapshotsTestJSON-786196391-project Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: exception: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'f41ce79a-b6f4-448e-8ce3-62f5b87a07e2'} Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. (HTTP 404) (Request-ID: req-3f3b988a-3dd1-415c-ba68-0c6480c2d9e4) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:06:35.515204 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:06:35.520724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76f21728-ff0f-4b86-9813-a246308f5483 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] Returning 404 to user: Volume f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:06:35.526631 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76f21728-ff0f-4b86-9813-a246308f5483 tempest-VolumesSnapshotsTestJSON-786196391 tempest-VolumesSnapshotsTestJSON-786196391-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2" status: 404 len: 109 microversion: 2.1 time: 0.049814 Oct 04 18:06:35.529098 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1790/3682] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:06:35 2022] GET /compute/v2.1/os-volumes/f41ce79a-b6f4-448e-8ce3-62f5b87a07e2 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:06:35.852052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:35.872703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4bee015a-4240-45ff-9fb7-8bf1562afb45 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.882129 Oct 04 18:06:35.874094 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1893/3683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:34 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.016782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.017461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.030936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.031439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.037067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.039759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.042399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.043715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.064041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.066232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.083731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.084519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.095095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.099600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.102592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.103053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.625461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.644643 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61803e47-77a5-41fc-a8b9-128214ff7346 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.624301 Oct 04 18:06:36.645320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1791/3684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.651404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.653089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.671717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.686497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.686962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.691385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.691932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.692382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.727698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.738725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a97a4e10-4882-4ab5-85e6-106b8e0f69e6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.676675 Oct 04 18:06:36.744329 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1894/3685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:36.898182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:36.898803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:36.913267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.913772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.914246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.914955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:36.923154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:36.924054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:36.926904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:36.936102 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98662f3e-2018-4722-9557-74ee623dfa72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1276 microversion: 2.1 time: 0.288636 Oct 04 18:06:36.942690 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1792/3686] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1276 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:37.372497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:37.405943 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fe2016d-c005-45ee-be0a-4f32ac8e2a97 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.506105 Oct 04 18:06:37.408252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1895/3687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:36 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:37.680533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.684015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.694388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.695263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.695982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.697040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.697821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.700401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.766419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:37.767589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:37.777057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.778057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.778813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.779765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:37.780463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:37.781388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:37.787207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:38.036272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.047269 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2640eea1-7a20-4cd5-9169-4bbcd0541db0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.382114 Oct 04 18:06:38.062780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1793/3688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.069162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.070038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.081956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.082810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.084425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.089205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.090113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.091361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.323016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.339269 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ab75ed8c-1f0d-45ef-a726-799934d4206c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.577258 Oct 04 18:06:38.354783 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1896/3689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:37 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:38.434955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:38.436444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:38.446210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.449413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.450414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.451427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:38.452137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:38.452804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:38.753015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:38.771586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c04ce7f-df92-4df1-b34c-5c6d2b87efce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.707348 Oct 04 18:06:38.772577 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1794/3690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.081554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.081554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.087305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.087794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.088234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.089124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.090488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.091892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.120518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.144038 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8704684c-a579-4a11-837d-5668d29cbef3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.715623 Oct 04 18:06:39.144636 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1897/3691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:38 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:39.183698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:39.201247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.202367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.204052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.223485 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] Creating event network-changed:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:06:39.243385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-faca2f7d-d43b-429e-a352-3fe7a121b72e req-fe15ff3a-6d3c-4e38-b589-9e26e01cfbce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063818 Oct 04 18:06:39.249891 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1898/3692] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:39.365539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.366580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.384383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.507544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.515791 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b516a31-ade5-4eda-8b0e-745ce1038e62 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.445060 Oct 04 18:06:39.534186 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1795/3693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:39.753559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:39.774339 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23ab19c2-4a84-4ce2-a401-50742b76586f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.412970 Oct 04 18:06:39.792488 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1899/3694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:39.798946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:39.800294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:39.808461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.809267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.809914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:39.811453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:39.812418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:39.813085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.128571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:40.140336 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27cd6c9a-c3e4-4812-b341-6371ea00bc9e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.348794 Oct 04 18:06:40.145970 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1796/3695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:39 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:40.173097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.174005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.192905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.193546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.194784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.204744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.205545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.206121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.545357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.546425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.553635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.554350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.554986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.557035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.558496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.559173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.586680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:40.598480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:40.621015 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b62c0099-6aca-4c9b-99b4-df42826f2648 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.452280 Oct 04 18:06:40.621912 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1900/3696] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:40.805813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:40.806477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:40.817145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.821818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.822322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:40.826383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:40.826881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:40.827480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.009258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.021156 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f49907be-ee0c-4352-9e85-ca8aad457031 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.481451 Oct 04 18:06:41.022706 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1797/3697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:41.170217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.170847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.179604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:41.184440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.185037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.187501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.188715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.191479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.192399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.253760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.265303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e328e5a-9831-4d17-8e8c-822566bb7aaa tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1532 microversion: 2.1 time: 0.463236 Oct 04 18:06:41.268296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1901/3698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:40 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1532 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:41.304632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf515d2-c200-4b22-a08c-19590990b35a", "tag": "a49b44e1-f245-4953-b88f-ad51c81241d6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:41.320042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.320564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.321024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.340211 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] Creating event network-changed:a49b44e1-f245-4953-b88f-ad51c81241d6 for instance daf515d2-c200-4b22-a08c-19590990b35a on n-h2-831194-21 Oct 04 18:06:41.363712 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-08143ce4-5de1-418d-8b33-5da1a31bd6c8 req-d5edfbb6-c336-4419-90ed-5bde9856970c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062165 Oct 04 18:06:41.365021 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1902/3699] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:06:41.622438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.633356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47b5b6c0-4afe-460c-a07f-d292a646ca51 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.468613 Oct 04 18:06:41.634961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1798/3700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:41.649989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:41.651500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:41.657277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:41.659534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.660671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.661387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.662322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:41.662929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:41.663503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:41.822643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:41.838106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d4462f4-8d24-46fa-8c10-b4dc487bd3ec tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.195772 Oct 04 18:06:41.840500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1903/3701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:41 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.047851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.049891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.058714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.059485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.060032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.060959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.061511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.062162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.298189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.299787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.303093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:42.304289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:42.310612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.311318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.311938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.312950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.313567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.314191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.498640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:42.513398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.527910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81ef6e05-a8f5-418a-81f9-c3ff098cb040 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.484315 Oct 04 18:06:42.529059 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1799/3702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:42.636621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:42.644972 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e68fba97-c9e7-4545-ab56-b2f343b7a797 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1532 microversion: 2.1 time: 0.352001 Oct 04 18:06:42.648048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1904/3703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1532 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:42.674184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.675512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.683497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.684303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.684944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.685879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.686559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.687185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.809693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "name": "network-vif-plugged", "status": "completed", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:42.834287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.834886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.835196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.884649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] Creating event network-vif-plugged:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h1-831194-21 Oct 04 18:06:42.896444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d43001c1-8a16-4171-a382-9d497db0386b req-69c95544-7b69-4f49-8c16-a7ce8a97d7ed service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091809 Oct 04 18:06:42.897062 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1905/3704] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:42.915745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:42.923460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:42.940301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.940789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.941230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:42.941966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:42.942424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:42.942840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.190846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.203234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19b4e39a-faf1-424f-a630-4a1cf82a0cfc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.541004 Oct 04 18:06:43.217874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1800/3705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.226468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.234673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7abae8e3-5965-4f02-81ee-40d51886d7c1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.323345 Oct 04 18:06:43.246635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1906/3706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:42 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:43.560332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:43.561216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:43.575724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.578951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.579995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.581582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.582646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.583461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.676356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:43.676977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:43.697595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.701561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.705545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.708995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:43.713196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:43.717741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:43.884887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:43.900734 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e3df5af4-8866-4804-8446-c930234f6cb8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.349410 Oct 04 18:06:43.903725 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1801/3707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:43 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.066118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.075774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ff2fe66-55e5-422f-b0fc-17bc65e4711e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.402836 Oct 04 18:06:44.076837 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1907/3708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:43 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.236436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.237881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.252246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.253726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.256238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.258501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.259268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.259886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.260885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.261722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.271012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.273438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.274901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.278668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.281182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.281782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.604818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.617227 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d192ea3-cdd2-4149-b469-9a8b93ff6544 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.384266 Oct 04 18:06:44.618561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1802/3709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:44.712395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:44.724717 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4a015fa2-3827-4c01-920a-12c3cdf0f889 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.469189 Oct 04 18:06:44.725304 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1908/3710] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:44.928587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:44.929214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:44.946234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.947103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.947809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:44.949469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:44.949986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:44.954333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.105509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.106311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.123804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.124636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.125245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.126422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.127036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.127603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.230809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.245657 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4d8404b-e900-4254-843a-f5ce3f4efcc0 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.319595 Oct 04 18:06:45.246862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1803/3711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:44 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.646047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.647027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:45.661412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:45.664392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.665207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.665926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.667235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:45.678737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:45.679365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:45.961395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:45.973465 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d27d1ed-14be-41eb-b6ee-26237193241f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.873948 Oct 04 18:06:45.978600 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1909/3712] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:45.993418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:45.996418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.012459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.021481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.026890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.027808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.028402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.028953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.325975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.340313 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4ee3d57-16ee-4fa7-9011-02893980e5f1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.353236 Oct 04 18:06:46.352276 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1910/3713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:46.362366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:46.366420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:46.392446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.393141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.395780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.397268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:46.399155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:46.400485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:46.480237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.497594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ecdafdf6-4ba0-470c-8ebb-28ac2d2bc770 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.856383 Oct 04 18:06:46.498432 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1804/3714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:45 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:46.748656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:46.761225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-40be5254-f81d-4809-8879-2787958590aa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.404325 Oct 04 18:06:46.763402 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1911/3715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.005247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.005653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.019282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.020615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.022035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.024003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.027280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.029392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.313467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.337014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4cbb3b0-7624-44ad-a4a8-8a4a6b0bcfab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.334798 Oct 04 18:06:47.354455 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1805/3716] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:46 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.392055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.394641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.413887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.416060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.420552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.423344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.424110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.426403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.522956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.523569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.536972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.538642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.543280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.544231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.544872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.545452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.832224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:47.850250 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c5d8c03-9cdb-4336-9a0d-e98ba3511e6b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.471436 Oct 04 18:06:47.865899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1912/3717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:47.867806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:47.868423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:47.892052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.892546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.893002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:47.893701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:47.903356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:47.903850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.165975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.180329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-018396f7-befc-43ce-a49a-c1b0b715ca6f tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.316051 Oct 04 18:06:48.182657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1913/3718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:48.286614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.303191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94389102-8aaf-46f0-b65a-bb7532b5533d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.784211 Oct 04 18:06:48.304689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1806/3719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:47 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:48.378187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.378987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.393667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.395007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.401679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.403558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.404051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.404590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.875537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:48.876961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:48.887841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.890498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.894713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.895556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:48.896426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:48.896794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:48.911015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:48.914889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:48.923764 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5cbabd1-9fd8-47dd-854b-5deeafeff400 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.550373 Oct 04 18:06:48.943174 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1914/3720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.214307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.216800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.226758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.227365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.229444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.233595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.234599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.235266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.545400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.576618 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29fd8419-3bf8-4d6c-9ef4-be9c8952bf42 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.704967 Oct 04 18:06:49.577206 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1807/3721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:48 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:49.611260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.612213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.620146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.620883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.621629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.622563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.623204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.624438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.819183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:49.834669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a3eaa68-7773-436e-a43b-9d11719076fa tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.624337 Oct 04 18:06:49.837554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1915/3722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:49.844820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-plugged", "status": "completed", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:49.884018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.889675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.891202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.926547 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] Creating event network-vif-plugged:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:06:49.933164 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1e2a2f16-310c-4326-86ec-81b48b42b296 req-893508c8-7c61-4821-915c-dcffeae9a6dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092421 Oct 04 18:06:49.933996 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1916/3723] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:49.967835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:49.972711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:49.991218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.992012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:49.993412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:49.998630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:49.999646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.003332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.204316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.219348 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e89dcca1-1004-4c34-b903-3d79c1242f72 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.632772 Oct 04 18:06:50.223241 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1808/3724] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:50.458734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:50.474301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf4d5437-9a61-455f-83e0-17aadf38478b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.518403 Oct 04 18:06:50.486549 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1917/3725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:49 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:50.642363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.643471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.653204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.653971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.654489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.655643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.655989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.656729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.868185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:50.869139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:50.885034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.888046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.888548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:50.890864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:50.892039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:50.894935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.129115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.147323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-385ea848-a137-47ef-9e52-f684d008af3e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.285933 Oct 04 18:06:51.148879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1918/3726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.253391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.254502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.281515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.285111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.285696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.290564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.292101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.292842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.762747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:51.783293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1fc40cb-4775-4f01-bb27-55eb4b95c964 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 1.145763 Oct 04 18:06:51.784205 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1809/3727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:50 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:51.789487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:51.793655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:51.809911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.810867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.811633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:51.812563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:51.813399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:51.816406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.097731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.107689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19eb7c27-9ad1-4b05-bfd9-a35dd16ad738 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.860349 Oct 04 18:06:52.108457 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1919/3728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.112801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf515d2-c200-4b22-a08c-19590990b35a", "name": "network-vif-plugged", "status": "completed", "tag": "a49b44e1-f245-4953-b88f-ad51c81241d6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:52.162562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.163654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.164443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.201441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] Creating event network-vif-plugged:a49b44e1-f245-4953-b88f-ad51c81241d6 for instance daf515d2-c200-4b22-a08c-19590990b35a on n-h2-831194-21 Oct 04 18:06:52.215609 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-94aa8ab3-abc8-48e8-9a14-ff1d71e16450 req-3353c839-51fd-4128-a198-dd37bb1ef21b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102112 Oct 04 18:06:52.217422 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1920/3729] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:06:52.233595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.234355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.258672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.258993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.259454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.269223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.270081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.275056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.425355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.438980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d11cea3e-0848-445b-8d8d-baa128b0ad27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.653385 Oct 04 18:06:52.439598 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1810/3730] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:51 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.707383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:52.720498 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b84b8c25-5262-414e-b063-3d5ae9ebacdb tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.501661 Oct 04 18:06:52.722168 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1921/3731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:52.813460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:52.814662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:52.830389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.830890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.842178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:52.843183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:52.845033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:52.846605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.139676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.140370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.155508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.156415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.156941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.158425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.160679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.161200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.241257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.251389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-109c7273-e571-41a4-84cb-99707a0fb52e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.442789 Oct 04 18:06:53.274664 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1811/3732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:52 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:53.438881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.449534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e39c1b6c-0d66-4806-b73c-1e77b78e1bdf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1318 microversion: 2.1 time: 0.316820 Oct 04 18:06:53.450564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1922/3733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:53.468432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.469050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.477032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.478207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.480515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.482112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.482929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.483602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.744108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:53.745441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:53.754944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.756117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.771897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.778942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:53.781044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:53.783514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:53.786762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:53.796704 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e4ba250-d2a4-44d1-bd73-31dd3d4e3bef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.330377 Oct 04 18:06:53.799214 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1812/3734] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.110898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.120405 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e8025a0-954e-4bf8-b5b5-e894e88160d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1509 microversion: 2.1 time: 0.380057 Oct 04 18:06:54.141452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1923/3735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:53 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1509 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.283118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.283777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.298580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.299085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.299530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.302497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.302973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.303409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.482906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.483583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.493504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.495210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.495922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.497257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.497992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.498688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.710204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.722191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-112881dd-7c8d-4c6c-a789-d00c24a3a6ff tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1468 microversion: 2.1 time: 0.247063 Oct 04 18:06:54.723005 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1924/3736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.726323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:54.736106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:54.752915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.753942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.756007 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f37ea59-8b34-4abc-96c8-030df4b56607 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.478543 Oct 04 18:06:54.765997 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1813/3737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:54.766646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.767557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.769798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.771406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.773214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.773932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.825079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:54.825915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:54.845752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.846525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.846989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:54.847712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:54.849189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:54.849654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.092520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.100995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a242306-f7f0-4e60-8e2d-c025bf98d9d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1467 microversion: 2.1 time: 0.353947 Oct 04 18:06:55.109928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1925/3738] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1467 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:55.135150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1392463138"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:55.141055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.151112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.152413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.153223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.154182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.154852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.155553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.673751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:55.682842 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-580d61f2-c22f-4115-987f-c1f45a94a372 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.863603 Oct 04 18:06:55.694611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1814/3739] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:54 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:55.700080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:55.700982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:55.712303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.713106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.713787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.715165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:55.719579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:55.720273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:55.772632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8110e11e-05c9-4a26-8977-0d059e47f05f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "POST /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a/action" status: 202 len: 0 microversion: 2.1 time: 0.641021 Oct 04 18:06:55.774237 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1926/3740] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:06:55 2022] POST /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:06:55.814494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecba39f4-5b90-4c62-a9a9-9b1bd802ad0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc844550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.036940 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecba39f4-5b90-4c62-a9a9-9b1bd802ad0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.233417 Oct 04 18:06:56.037790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1927/3741] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.045797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.051281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.061039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.061845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.062664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.063625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.064232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.064811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.231418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.241422 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f68c951a-2ffb-42aa-90ef-3b28f6255eae tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1486 microversion: 2.1 time: 0.545488 Oct 04 18:06:56.262407 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1815/3742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:55 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1486 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.273859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2000603320"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:06:56.281553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.298050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.299657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.301479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.303975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.304923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.306180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.308278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.308743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa8efcae-3190-45e0-b983-b18899bbb09c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.268825 Oct 04 18:06:56.309341 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1928/3743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.427951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ccb69c9-b2a5-43c5-8a24-543577028661 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "PUT /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1060 microversion: 2.1 time: 0.157925 Oct 04 18:06:56.428602 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1816/3744] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:06:56 2022] PUT /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1060 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.452296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.453079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.463015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.463990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.464576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.465440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.466770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.467584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.652640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.665266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e16effda-9640-40b9-87e8-853f58ac2b4c tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1487 microversion: 2.1 time: 0.220251 Oct 04 18:06:56.667275 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1929/3745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1487 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.694880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.696428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.703705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.704545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.705252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.706312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.706988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.707630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.722984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.723724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.741945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.742476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.746228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.746875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.747674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.748295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.922006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:56.929864 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe329cf7-a037-40fa-b386-e6c0db5978d1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1487 microversion: 2.1 time: 0.241042 Oct 04 18:06:56.950222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1817/3746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1487 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:56.960549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:56.961591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:56.975373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.978155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.981547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:56.982984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:56.983465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:56.983905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.035277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:06:57.115289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.130639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb43b4b9-6ef9-41b3-b287-79e345bc3e1f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.413019 Oct 04 18:06:57.177141 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1930/3747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:56 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:57.215758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96bbc629-f685-4aac-aa6b-670370995506 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7701f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.253036 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9222ea8a-3eec-4ad4-b866-8901c8b17f85 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 204 len: 0 microversion: 2.1 time: 0.295994 Oct 04 18:06:57.254232 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1818/3748] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:06:56 2022] DELETE /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:06:57.267665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.270323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.279646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.280576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.281213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.282206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.283179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.283750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.307859 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96bbc629-f685-4aac-aa6b-670370995506 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.107429 Oct 04 18:06:57.308784 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1931/3749] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.339423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:57.340253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:57.354086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.359992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.362364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.368982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:57.371473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:57.377814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:57.528671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.550196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4f2893f-0406-4eb0-92d5-4bd46fdc3b8e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1493 microversion: 2.1 time: 0.291014 Oct 04 18:06:57.562261 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1819/3750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1493 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:57.808510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:57.835934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc88447e-aea5-4344-a1d0-3017221470a0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1541 microversion: 2.1 time: 0.500865 Oct 04 18:06:57.836966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1932/3751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:57 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1541 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:06:58.204009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.204652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.216272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.218410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.218871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.227203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.227649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.228103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.324139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9c9194b-2a4f-46ea-a9fa-40625ca2423d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7c7550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.395131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d9c9194b-2a4f-46ea-a9fa-40625ca2423d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.075797 Oct 04 18:06:58.396141 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1933/3752] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.580711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.581496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.598159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.600673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.602986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.606990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.607941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.609048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.646539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:06:58.812469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:58.830188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff9408de-cef2-4bad-89ff-4ef213ba2ee9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.629788 Oct 04 18:06:58.831950 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1820/3753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:58.883915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:58.885119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:58.899601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.900082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.901088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:58.901821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:58.902305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:58.902724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.175605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.192333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-590ba761-0d4c-485d-9f5c-0f13a2eb3bc5 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1493 microversion: 2.1 time: 0.618006 Oct 04 18:06:59.211039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1934/3754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1493 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.413903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6bb7a6e2-f083-4712-9d7a-93a5e3aada35 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc844a60>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.537803 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6bb7a6e2-f083-4712-9d7a-93a5e3aada35 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.128569 Oct 04 18:06:59.539016 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1935/3755] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.545435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:06:59.586186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7494c02-e9b6-48ee-a1d2-afd2ceb8e6fb tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1540 microversion: 2.1 time: 0.704526 Oct 04 18:06:59.587137 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1821/3756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:58 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1540 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:06:59.858868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:06:59.859823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:06:59.887631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.888419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.889135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:06:59.890007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:06:59.890676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:06:59.891344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.219561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.220388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.237647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.238230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.238853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.239784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.240420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.241006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.373967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.390571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-73a44367-aa2b-4492-81c7-a27f9ab84295 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.538422 Oct 04 18:07:00.404576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1936/3757] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:06:59 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:00.439408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:00.455766 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce7f8bbe-1a67-4d7c-b1b4-dc7d5e76f40d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1451 microversion: 2.1 time: 0.239792 Oct 04 18:07:00.456573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1822/3758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:00.520447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de5e7e44-b1c9-4a49-aa18-44ba6f897f2a", "name": "network-vif-deleted", "tag": "45165d1f-cb74-4191-abad-0a072c39f012"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:00.546915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.551709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.552326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.556199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6422af9-e0ce-4113-b7f9-2e7771f05e5c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99aca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.583215 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] Creating event network-vif-deleted:45165d1f-cb74-4191-abad-0a072c39f012 for instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a on n-h2-831194-21 Oct 04 18:07:00.614488 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-94c9bf91-c426-46cd-8008-fea4a4ce616e req-e5b08e88-0552-493e-a462-f15453780812 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097554 Oct 04 18:07:00.615825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1937/3759] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:00.625258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:00.630957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:00.652600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.653136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.653588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.656350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:00.659062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:00.659772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:00.694127 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6422af9-e0ce-4113-b7f9-2e7771f05e5c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.142152 Oct 04 18:07:00.694922 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1823/3760] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:01.139358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.155922 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7959d1d2-c30d-4187-9e52-7c09d643298d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1472 microversion: 2.1 time: 0.538673 Oct 04 18:07:01.159756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-plugged", "status": "completed", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:01.161186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1938/3761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:00 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1472 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.186406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.188235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.190445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.209139 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] Creating event network-vif-plugged:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:07:01.227714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f87f3076-47b8-4f1d-a88b-7403f904eaaf req-9b7d3083-5fdc-465f-9a02-e09b92cc8d0d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071580 Oct 04 18:07:01.230245 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1824/3762] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:01.427974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.428968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.442695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.445313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.446576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.450432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.451483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.454296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.487023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.488017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:01.503943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.506395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.507264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.508306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.514678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.515314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.611613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:01.612195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:01.612547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:01.613011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid de5e7e44-b1c9-4a49-aa18-44ba6f897f2a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:01.714525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:01.722106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee2aec1d-71a8-4543-a071-094aebb618d8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 200 len: 1310 microversion: 2.1 time: 0.239230 Oct 04 18:07:01.729373 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1825/3763] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 1310 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:01.738137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70228fe0-2e6a-44dd-a8b2-335f737696ce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc978670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:01.883606 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70228fe0-2e6a-44dd-a8b2-335f737696ce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.153064 Oct 04 18:07:01.884364 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1826/3764] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.068545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.081641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c91a7f46-d89d-48b5-905a-773cf9f8ef06 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.659902 Oct 04 18:07:02.084681 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1939/3765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:01 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.190947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.191575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.199237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.199778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.200227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.200933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.201425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.201876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.601105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:02.616577 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ad353a5-ea54-4d53-884c-06a3e401a094 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1469 microversion: 2.1 time: 0.429430 Oct 04 18:07:02.618638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1827/3766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:02.643648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:02.644397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.657122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.657965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.658436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.659199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.661184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.663932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.731709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.732584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.733250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.734370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.736988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.738241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.749723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.750746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.761307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.764308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.765297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.766389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.769058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.769695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.785576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:02.791800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:02.811211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a HTTP/1.1 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'de5e7e44-b1c9-4a49-aa18-44ba6f897f2a'} Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.812954 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f8b6123-860e-4957-bc08-ae8d1942ff5e tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 404 len: 111 microversion: 2.1 time: 0.070914 Oct 04 18:07:02.816225 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1828/3767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:02.834692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:02.835187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:02.862153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.862653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.863089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.875573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:02.877259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:02.879199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:02.955717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a HTTP/1.1 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'de5e7e44-b1c9-4a49-aa18-44ba6f897f2a'} Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:02.963273 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:02.966491 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:02.969094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:02.972926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d878de8-69cf-4fff-9fed-1aec4e1c7f77 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 404 len: 111 microversion: 2.1 time: 0.139265 Oct 04 18:07:02.974271 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1829/3768] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:02 2022] DELETE /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:02.993289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-65dc346d-df67-429f-848a-42431615c1d2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbda430d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.186886 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb964b5f-35c2-4bcb-86df-5086fb176d11 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb/action" status: 202 len: 0 microversion: 2.1 time: 0.547388 Oct 04 18:07:03.198945 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1940/3769] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:02 2022] POST /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb/action => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:03.218589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.220565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: de5e7e44-b1c9-4a49-aa18-44ba6f897f2a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.247156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.247681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.248494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.250951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.253161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.253804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.307378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a HTTP/1.1 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'de5e7e44-b1c9-4a49-aa18-44ba6f897f2a'} Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:03.312841 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. Oct 04 18:07:03.316866 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:03.321109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance de5e7e44-b1c9-4a49-aa18-44ba6f897f2a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:03.323794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e2dd1687-2dc7-4b7c-bfa2-100b0bb667b1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a" status: 404 len: 111 microversion: 2.1 time: 0.123507 Oct 04 18:07:03.324892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1941/3770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/de5e7e44-b1c9-4a49-aa18-44ba6f897f2a => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:03.331846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.333499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.345490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.346418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.347151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.348061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.349051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.350007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.902783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:03.922052 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9f7a7c0-bc4a-4b1d-9667-bcf5f76ea937 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.595738 Oct 04 18:07:03.924184 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1942/3771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:03.937675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:03.942420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:03.966244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.968107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.971718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:03.974405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:03.976804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:03.979763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.475677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:04.488626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59523a6f-55d5-456c-88ef-c8e13cee5b15 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1468 microversion: 2.1 time: 0.563123 Oct 04 18:07:04.492047 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1943/3772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:03 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1468 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:04.502756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-unplugged", "status": "completed", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:04.523734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.525889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.527705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.562951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Creating event network-vif-unplugged:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:07:04.586278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:04.614637 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2451d873-762d-43e7-ae1a-0bcab59dfa67 req-a7eb2ec1-98f2-469d-ae33-4371487e36d7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116214 Oct 04 18:07:04.615488 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1944/3773] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:04.644176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.645004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.671461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.671982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.672435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.683750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.684239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.684704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.750343 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 HTTP/1.1 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e10c3a89-ee61-4496-829d-1f69e54a0da9'} Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:04.752392 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:04.755639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1451907-fe89-4a6a-8e6d-85e1ceec5184 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 404 len: 111 microversion: 2.1 time: 0.131028 Oct 04 18:07:04.775625 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1945/3774] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:04 2022] DELETE /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:04.785206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.785843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: e10c3a89-ee61-4496-829d-1f69e54a0da9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.818877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.825557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.826096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.826861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.834490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.835130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.918284 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 HTTP/1.1 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e10c3a89-ee61-4496-829d-1f69e54a0da9'} Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:04.920134 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance e10c3a89-ee61-4496-829d-1f69e54a0da9 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:04.923831 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aaaabef3-5f34-4ccc-8271-78fc50b8287d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9" status: 404 len: 111 microversion: 2.1 time: 0.140380 Oct 04 18:07:04.931929 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1946/3775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:04 2022] GET /compute/v2.1/servers/e10c3a89-ee61-4496-829d-1f69e54a0da9 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:04.943076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:04.953327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:04.977112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.983718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.985589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:04.986641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:04.992765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:04.993560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.045823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 HTTP/1.1 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '829cc4ee-0d6a-4535-9eb9-f966e9f8d743'} Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:05.054509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:05.058331 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:05.065648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:05.066851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c52eb84c-1c51-48e9-86fa-cd23e54baaed tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 404 len: 111 microversion: 2.1 time: 0.127859 Oct 04 18:07:05.074092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1947/3776] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:04 2022] DELETE /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:05.089689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:05.090538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:05.117579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.118535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.119779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:05.125550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:05.126654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:05.127382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.106512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.116969 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f7eda77-b7a7-426b-9be7-02bf9bb426e2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 1.041432 Oct 04 18:07:06.126420 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1948/3777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:05 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.131767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.141274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 829cc4ee-0d6a-4535-9eb9-f966e9f8d743] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.167715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.168738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.169419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.173258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.174091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.174764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.206563 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 HTTP/1.1 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '829cc4ee-0d6a-4535-9eb9-f966e9f8d743'} Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.211643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. Oct 04 18:07:06.215501 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.217097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 829cc4ee-0d6a-4535-9eb9-f966e9f8d743 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:06.218224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adc919ab-2a1a-42b4-b8df-a83f6bb36da8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743" status: 404 len: 111 microversion: 2.1 time: 0.090456 Oct 04 18:07:06.222535 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1949/3778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/829cc4ee-0d6a-4535-9eb9-f966e9f8d743 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:06.227869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.234736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.247625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:06.250140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.254499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.255253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.256301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.256972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.258349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.595887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:06.605567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ffd6408a-f115-4e16-bfe9-c5c16406dd00 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1468 microversion: 2.1 time: 0.381629 Oct 04 18:07:06.609271 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1950/3779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1468 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:06.632888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.633799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.647667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.648703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.654285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.655360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.656065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.656734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.693791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 HTTP/1.1 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bbed2183-c767-4bf6-8c8f-f23f9aa443f3'} Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:06.695996 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.700212 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.702105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:06.703192 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-260f17c8-698a-49cb-a165-f16f43f87182 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 404 len: 111 microversion: 2.1 time: 0.092723 Oct 04 18:07:06.704326 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1951/3780] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:06 2022] DELETE /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:06.709958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-plugged", "status": "completed", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:06.720271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.721087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.721725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.737369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Creating event network-vif-plugged:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:07:06.745549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:06.752792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3ff321c0-16fd-428a-a4aa-04a68b8bf4e9 req-1e9732fa-3bd4-4a9f-b439-5160eeb81f99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047060 Oct 04 18:07:06.758196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1952/3781] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:06.768204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.769217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: bbed2183-c767-4bf6-8c8f-f23f9aa443f3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.777273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.778307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.778992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.779942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.780811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.781539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.799325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 HTTP/1.1 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'bbed2183-c767-4bf6-8c8f-f23f9aa443f3'} Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.801353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. Oct 04 18:07:06.804627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.807484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance bbed2183-c767-4bf6-8c8f-f23f9aa443f3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:06.808768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3472dcfb-6159-46ab-b74b-f87e1be58ce8 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3" status: 404 len: 111 microversion: 2.1 time: 0.048952 Oct 04 18:07:06.809874 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1953/3782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/bbed2183-c767-4bf6-8c8f-f23f9aa443f3 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:06.818063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.819106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.826949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.828393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.829238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.830424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.831131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.831768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.867290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a HTTP/1.1 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '502af315-9bad-4ae0-bb36-68615f5ba18a'} Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:06.872191 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.876835 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.885642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:06.886850 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a594682d-8ee7-4a7d-a7c5-8ac12c6dc027 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 404 len: 111 microversion: 2.1 time: 0.073035 Oct 04 18:07:06.888420 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1954/3783] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:06 2022] DELETE /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:07:06.902798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:06.903768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 502af315-9bad-4ae0-bb36-68615f5ba18a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:06.925600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.926275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.926823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.927781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:06.930114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:06.930923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:06.982195 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a HTTP/1.1 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '502af315-9bad-4ae0-bb36-68615f5ba18a'} Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:06.986165 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 502af315-9bad-4ae0-bb36-68615f5ba18a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:06.989530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37647153-9868-4869-a784-f9aa62edea14 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a" status: 404 len: 111 microversion: 2.1 time: 0.096231 Oct 04 18:07:06.993788 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1955/3784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:06 2022] GET /compute/v2.1/servers/502af315-9bad-4ae0-bb36-68615f5ba18a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:07.012499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.013544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.028419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.029105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.029661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.030525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.034536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.035123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.069043 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 HTTP/1.1 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '43970361-0367-4b47-89fd-5fd73d14c177'} Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:07.075919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8335c09-efe2-4f0d-96f8-3b2b766983ea tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 404 len: 111 microversion: 2.1 time: 0.082825 Oct 04 18:07:07.079163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1956/3785] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:06 2022] DELETE /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:07.088382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.092033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 43970361-0367-4b47-89fd-5fd73d14c177] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.104097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.107987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.108831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.113528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.114217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.114777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.124542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:07.153843 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 HTTP/1.1 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '43970361-0367-4b47-89fd-5fd73d14c177'} Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.155875 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. Oct 04 18:07:07.159242 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.161192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 43970361-0367-4b47-89fd-5fd73d14c177 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:07.162293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-314c04f8-558c-4f43-b364-20dffc28b177 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177" status: 404 len: 111 microversion: 2.1 time: 0.079021 Oct 04 18:07:07.163358 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1957/3786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/43970361-0367-4b47-89fd-5fd73d14c177 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:07.169227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.170243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.177766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.178638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.179334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.180360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.182853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.183533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.608048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:07.620868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2888a7c-ef60-4c6d-9e7b-5100cfba865e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1527 microversion: 2.1 time: 0.456256 Oct 04 18:07:07.621448 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1958/3787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1527 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:07.627691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.634035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.649134 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f HTTP/1.1 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'd1822c80-bf39-4c67-9396-1b19fe963b2f'} Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.653710 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.658081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.658607 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-65dc346d-df67-429f-848a-42431615c1d2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 4.679172 Oct 04 18:07:07.661586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:07.662647 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13af0103-d621-40a5-9d7b-658b04b878b2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f" status: 404 len: 111 microversion: 2.1 time: 0.038967 Oct 04 18:07:07.670332 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1959/3788] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:07 2022] DELETE /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:07.672182 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1830/3789] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:02 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 4697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:07.676964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.677582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: d1822c80-bf39-4c67-9396-1b19fe963b2f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.683123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.684666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.688932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f HTTP/1.1 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd1822c80-bf39-4c67-9396-1b19fe963b2f'} Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:07.690497 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance d1822c80-bf39-4c67-9396-1b19fe963b2f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-caa10cc5-5ac9-4dba-9e7a-3287b9c84cba tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f" status: 404 len: 111 microversion: 2.1 time: 0.018692 Oct 04 18:07:07.694013 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1831/3790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/d1822c80-bf39-4c67-9396-1b19fe963b2f => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:07.702951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.703748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.704078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.704578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.705211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.706935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.709879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.710573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.713279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.714003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.714453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.716079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.716569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.717003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.750557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:07.797618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:07.897564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cb3f46e-0cab-4258-a4a1-18793fb4de90 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "DELETE /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 204 len: 0 microversion: 2.1 time: 0.196864 Oct 04 18:07:07.908800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1832/3791] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:07 2022] DELETE /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:07:07.929817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:07.934742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:07.948428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.954308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.955149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:07.957607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:07.958344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:07.960746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.154933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.167137 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7695dc6f-284c-4f00-9a06-2d7329c6e7d3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1468 microversion: 2.1 time: 0.495136 Oct 04 18:07:08.184264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1960/3792] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1468 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:08.312485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:08.328434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa2c88c1-d1a3-4f66-96c9-ce21fa32c3a1 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1478 microversion: 2.1 time: 0.417850 Oct 04 18:07:08.329977 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1833/3793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:07 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1478 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:08.649482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.653187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:08.672691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50c3d0c7-dfe1-4e17-8a89-fc361901c6f5 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99c670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:08.682459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.683967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.683967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.684882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:08.685615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:08.686926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:08.767595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50c3d0c7-dfe1-4e17-8a89-fc361901c6f5 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.098715 Oct 04 18:07:08.768426 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1834/3794] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:09.060020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.069359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18c62753-5da1-4830-8564-0f3f40ee2fb4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1509 microversion: 2.1 time: 0.424590 Oct 04 18:07:09.073991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1961/3795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:08 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1509 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:09.193343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.194962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.209424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.212334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.213126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.214691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.217761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.218468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.353400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.354878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:09.365708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.366587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.368267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.371984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:09.374015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:09.374716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:09.836680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:09.849310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a66f511d-2cbb-49eb-8b29-b67d0abb3c1d tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1478 microversion: 2.1 time: 0.499554 Oct 04 18:07:09.866545 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1962/3796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1478 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:09.878294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e80c4d21-e09e-43c2-926e-fe00cf6b224c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1d29e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:09.954371 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e80c4d21-e09e-43c2-926e-fe00cf6b224c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.085809 Oct 04 18:07:09.978911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1963/3797] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:10.101582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.101582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.117844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.118644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.119346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.121555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.122402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.123006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.232867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:10.242519 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3bffec4-dd18-4e22-bf9f-0cacff20a8e3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1468 microversion: 2.1 time: 1.053802 Oct 04 18:07:10.244512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1835/3798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:09 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1468 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:10.882494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:10.883643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:10.901122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.903601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.905333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:10.908980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:10.909807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:10.911823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.047383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.065016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10e8a111-9ec6-4972-b04e-94baf81e7053 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1509 microversion: 2.1 time: 0.972106 Oct 04 18:07:11.065974 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1964/3799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1509 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:11.070645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ba514f7-a88f-4b62-8f54-239c2269c780 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc6c2310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.156252 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ba514f7-a88f-4b62-8f54-239c2269c780 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.089182 Oct 04 18:07:11.156834 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1965/3800] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:11.272873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:11.273728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:11.294207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.294734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.295190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.295925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.296394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.296829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.622809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.638239 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37413e87-7efc-47c6-b308-d58b45bd48b9 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1478 microversion: 2.1 time: 0.757511 Oct 04 18:07:11.639035 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1836/3801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:10 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1478 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:11.666223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:11.680753 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-762e5fef-880b-456a-ae2a-e360d084b1c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1534 microversion: 2.1 time: 0.412692 Oct 04 18:07:11.682701 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1966/3802] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:11 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1534 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:11.923327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12cd8b77-f723-460f-aa1e-39b5b73dabbd", "name": "network-vif-deleted", "tag": "796272b8-f504-4c86-ab3f-995b78e9bfac"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:11.938922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:11.940380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:11.941026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:11.957756 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] Creating event network-vif-deleted:796272b8-f504-4c86-ab3f-995b78e9bfac for instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd on n-h1-831194-21 Oct 04 18:07:11.965988 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a5e2efbc-4459-437b-aeaa-5241b3f71c0c req-32b2252d-8fbd-4eac-b1ef-336c59a730ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047508 Oct 04 18:07:11.967285 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1837/3803] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:12.089189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.089861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.099936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.107871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.108592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.109734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.111508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.112875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.174074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0714116b-e893-4dc9-aeec-2be615b74681 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc8be670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.270049 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0714116b-e893-4dc9-aeec-2be615b74681 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.100537 Oct 04 18:07:12.271333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1838/3804] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:12.398823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:12.411581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a85a932-1750-4c7f-90d5-bbb9620efea6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1509 microversion: 2.1 time: 0.326428 Oct 04 18:07:12.412913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1967/3805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1509 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:12.669322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.671200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.680286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.680781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.681391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.688043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.689228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.693087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.710111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:12.710965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:12.725369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.726644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.727555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.731447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:12.733515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:12.735839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:12.780403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:13.016635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.027655 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bed99ef7-b545-46d2-a546-eb24a1eda8a2 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1436 microversion: 2.1 time: 0.362601 Oct 04 18:07:13.033812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1839/3806] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1436 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.104966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.119794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-unplugged", "status": "completed", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:13.132808 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a90f08a0-94e2-4d5c-a4c5-6a1b1949f976 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1534 microversion: 2.1 time: 0.428800 Oct 04 18:07:13.138914 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1968/3807] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:12 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1534 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:13.148150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.148677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.149081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.184214 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Creating event network-vif-unplugged:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:07:13.199069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:07:13.221690 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d237994d-7dd1-472c-9f6d-a2b6b9d23670 req-1b3d9462-e451-4880-851e-9d549cde5eb9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106181 Oct 04 18:07:13.222967 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1840/3808] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:13.286537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15326cdf-d659-4ba9-ad8d-10c3904a827f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1d2be50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.412289 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15326cdf-d659-4ba9-ad8d-10c3904a827f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.130460 Oct 04 18:07:13.413178 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1969/3809] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.437705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.438853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.455028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.456707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.457813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.460686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.461767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.462529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.833441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:13.842225 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a846408-6150-4adb-bef1-5422acf3dae6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1512 microversion: 2.1 time: 0.410021 Oct 04 18:07:13.842817 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1841/3810] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1512 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:13.873886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:13.874524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:13.888877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.889372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.889822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:13.890565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:13.891034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:13.891463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.065162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.066560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.077497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.078265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.080124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.081016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.081629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.082255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.128508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.129348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.130054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.130699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lazy-loading 'fault' on Instance uuid 12cd8b77-f723-460f-aa1e-39b5b73dabbd {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:14.277373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be9a279829be4d62b6dc849fc988bb4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbed17a220334e15871c3afb682ce4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.286515 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e17f30d5-2511-44bd-bb4d-b3c187442041 tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 200 len: 1282 microversion: 2.1 time: 0.225063 Oct 04 18:07:14.306810 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1842/3811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.306810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.306810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.319263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.319769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.320211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.323261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.323925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.324577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.391436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:14.414322 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dd62c026-b186-4982-b938-11f13509257d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1512 microversion: 2.1 time: 0.545190 Oct 04 18:07:14.450297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1970/3812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:13 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.455898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bcc464ce-5367-4f33-98c7-e4eaf71329d8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd20f1f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:14.629112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bcc464ce-5367-4f33-98c7-e4eaf71329d8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.177271 Oct 04 18:07:14.629686 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1971/3813] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:14.652271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:14.653415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.677358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.682023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.684308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.686171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.687411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.703529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.754317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lazy-loading 'flavor' on Instance uuid 82709aba-62fd-4fbe-87c8-b951080fdd93 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:07:14.823410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'shelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state shelved_offloaded Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 14 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: {"shelve": {}} Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'shelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state shelved_offloaded Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'shelve': {}}} Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:07:14.830692 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state shelved_offloaded Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state shelved_offloaded Oct 04 18:07:14.834255 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:14.839067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'shelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state shelved_offloaded {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:14.839967 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-957c7f7b-1dcf-46ef-a0b3-3e7c75804611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 155 microversion: 2.1 time: 0.207674 Oct 04 18:07:14.853676 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1972/3814] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:14 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 155 bytes in 222 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:07:14.862607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:14.863217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:14.875685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.876713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.877315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.878223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:14.878834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:14.879497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:14.942670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128849) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:07:15.078810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:15.094662 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8c14a09-69d7-44d1-8a15-589c13effc8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1534 microversion: 2.1 time: 0.806494 Oct 04 18:07:15.097022 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1843/3815] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:14 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1534 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:15.106862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bbdb73ab-9574-4254-b7e8-646e0656b45f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.247849 Oct 04 18:07:15.111558 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1973/3816] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:14 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:15.118659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.120917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.138158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.138997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.141270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.142445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.146026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.146751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.308528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "name": "network-vif-unplugged", "status": "completed", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:15.339376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.340387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.341722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.370572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_external_events [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] Unable to find a host for instance 82709aba-62fd-4fbe-87c8-b951080fdd93. Dropping event network-vif-unplugged {{(pid=128849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:07:15.375456 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dfbc3409-3a69-48d4-8a48-a06deeed908f req-f2c30fa8-714e-477f-b2ec-133e4fbfd3b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.073645 Oct 04 18:07:15.383257 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1974/3817] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 83 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:07:15.403051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.404988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] [instance: 12cd8b77-f723-460f-aa1e-39b5b73dabbd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:15.414825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.416414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.417558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.418584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:15.420704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:15.421612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:15.460827 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] HTTP exception thrown: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Request method failure captured: Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd HTTP/1.1 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVA1JcAvvySbhvBNptgqwSAYoO9TwJWlNzwSA6ISAsRVWNWD558m6SRyecxd_CKzuTRQ9vE78rK4RYwWZz7ctddTyvWZuPmzj5LHbnl_I1SjTuS_yda0NLDueTLRJh_PGbyT5k57pJpiQzueYOJEJGlE7RctvINYUtPIAc8Dv2oyJg Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_dbed17a220334e15871c3afb682ce4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestJSON-2109163673 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: dbed17a220334e15871c3afb682ce4e2 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestJSON-2109163673 Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: be9a279829be4d62b6dc849fc988bb4a Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestJSON-2109163673-project Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '12cd8b77-f723-460f-aa1e-39b5b73dabbd'} Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:15.464898 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. Oct 04 18:07:15.468208 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:15.471005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] Returning 404 to user: Instance 12cd8b77-f723-460f-aa1e-39b5b73dabbd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:15.476864 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a989952-b1e8-478f-aba2-23a9c7f64eaf tempest-ServersTestJSON-2109163673 tempest-ServersTestJSON-2109163673-project] 10.222.0.42 "GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd" status: 404 len: 111 microversion: 2.1 time: 0.084299 Oct 04 18:07:15.480654 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1975/3818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/12cd8b77-f723-460f-aa1e-39b5b73dabbd => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:15.645669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0258015b-5e80-480c-8425-8f68843ec379 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7d5310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:15.743170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0258015b-5e80-480c-8425-8f68843ec379 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.102235 Oct 04 18:07:15.763279 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1976/3819] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:16.124833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.125631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:16.141192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.142038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.142764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.143966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:16.144650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:16.145499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:16.527636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.548603 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ace08a3-254a-407a-a983-df86aa0adc1e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1534 microversion: 2.1 time: 0.427660 Oct 04 18:07:16.551540 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1977/3820] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1534 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:16.758427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:16.764509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ce2e134-6ce8-4289-814d-c361bbf87060 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbdab30d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:16.787892 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b38f804-97de-48aa-b83a-6d4635251fd9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1460 microversion: 2.1 time: 1.674527 Oct 04 18:07:16.793131 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1844/3821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:15 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1460 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:16.882586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ce2e134-6ce8-4289-814d-c361bbf87060 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.123520 Oct 04 18:07:16.883177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1978/3822] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:16 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:17.575742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.576362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.581221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:17.599256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.600819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.601291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.609679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.610216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.610661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.820099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:17.820623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:17.843323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.843831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.844278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:17.855928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:17.856443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:17.856899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.155731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.175898 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-785a0a09-21f0-4789-a772-663ebe4dc3eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1460 microversion: 2.1 time: 0.361931 Oct 04 18:07:18.177035 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1979/3823] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1460 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:18.184589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c25222b4-0226-463e-aa63-5b39ec9dba22 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd155310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.273222 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c25222b4-0226-463e-aa63-5b39ec9dba22 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.094104 Oct 04 18:07:18.274076 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1980/3824] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.838258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:18.855260 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d9458e0-3723-4a0b-82f2-b28aacd8ceb9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1527 microversion: 2.1 time: 1.277502 Oct 04 18:07:18.855926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1845/3825] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:17 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1527 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:18.883892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:18.885767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:18.912554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.913063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.913514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:18.924625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:18.925497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:18.925987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.203780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.205962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:19.216437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.216948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.217660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.222649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:19.223432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:19.224081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:19.750503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:19.764894 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc976707-edec-4bdb-961a-5d7da18af9e5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1527 microversion: 2.1 time: 0.886411 Oct 04 18:07:19.775851 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1981/3826] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:18 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1527 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.793476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e13a287c-3b6c-4c09-b503-5a7aee46a3fb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd21e9d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.886419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e13a287c-3b6c-4c09-b503-5a7aee46a3fb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.097288 Oct 04 18:07:19.889679 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1982/3827] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:19.920686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63b559de-3187-458a-8a28-03b388492f88 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:19.954950 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-63b559de-3187-458a-8a28-03b388492f88 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] HTTP exception thrown: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63b559de-3187-458a-8a28-03b388492f88 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Request method failure captured: Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/flavors/477fbca8-e546-4479-9705-5f0077981483 HTTP/1.1 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVrNYCU1PK2CZzqVyjqQ8BOrNdQRH_qqtOIH2DLsdaqnYFI1Sh987p4Xuwkb8NvJRn2HDSc9P4QR3WcXkTSAjscs1p2H-wuM2TxVEbZnJ-IgY_3yGj9MiO_3E9XtAm7E_JctIebo5cE2sFEKFLsiiJxi8S1NnBbkcndW731Wuw1HwE Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5fb22f70dbad4d27a225050db6de2d97 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MigrationsAdminTest-492694866 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5fb22f70dbad4d27a225050db6de2d97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5fb22f70dbad4d27a225050db6de2d97"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5fb22f70dbad4d27a225050db6de2d97"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5fb22f70dbad4d27a225050db6de2d97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MigrationsAdminTest-492694866 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5fb22f70dbad4d27a225050db6de2d97 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MigrationsAdminTest-492694866 Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MigrationsAdminTest-492694866-project-admin Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 8ed0f8ba9714428ea8ea710356a42cfb Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MigrationsAdminTest-492694866-project-admin Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: exception: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '477fbca8-e546-4479-9705-5f0077981483'} Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.963231 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. Oct 04 18:07:19.967593 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:19.969124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63b559de-3187-458a-8a28-03b388492f88 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Returning 404 to user: Flavor 477fbca8-e546-4479-9705-5f0077981483 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:19.970888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63b559de-3187-458a-8a28-03b388492f88 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/477fbca8-e546-4479-9705-5f0077981483" status: 404 len: 109 microversion: 2.1 time: 0.079533 Oct 04 18:07:19.974880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1983/3828] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:07:19 2022] DELETE /compute/v2.1/flavors/477fbca8-e546-4479-9705-5f0077981483 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:20.074929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:20.121070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f11a9fb-39e1-4560-93b2-6ffdf3b3a101 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.920959 Oct 04 18:07:20.122397 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1846/3829] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:19 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:20.200982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-324871734", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:20.306559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:07:20.903236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7568fe37-8936-4217-b65e-7470c3cf5d26 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc9e09d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.020771 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7568fe37-8936-4217-b65e-7470c3cf5d26 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.121283 Oct 04 18:07:21.021364 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1847/3830] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:20 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:21.150273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.152078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:21.170770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.172074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.175811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.180448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.194205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.195002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.218574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:07:21.220005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:07:21.220675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:07:21.221307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:07:21.223062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:07:21.248010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.249889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.250510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.252360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.254757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.255409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.317580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:07:21.346934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Getting quotas for user e701576afd70420c8f2e7a970fb33920 and project ffcaedcfb5954419a573f58488eca4e2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:07:21.401574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:07:21.409473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:07:21.462409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:21.478159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c05771b3-61c0-4202-8da2-a4a784409ee4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.332233 Oct 04 18:07:21.481588 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1848/3831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:21.491069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-plugged", "status": "completed", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:21.518992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:21.522070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:21.524249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:21.551324 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] Creating event network-vif-plugged:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:07:21.562984 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b53eeaa0-a600-4793-ad05-335144532fb8 req-3602ea39-9903-44ca-96f1-6321db4ea6c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076034 Oct 04 18:07:21.568364 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1849/3832] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:21.578127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-02d07e67-4502-46f6-8663-ec332a26ba04 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.384123 Oct 04 18:07:21.579212 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1984/3833] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:07:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1386 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:07:21.593511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f42e0ae-08ad-49f0-b807-2f936f42bb89 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:21.594527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f42e0ae-08ad-49f0-b807-2f936f42bb89 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.023325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3f42e0ae-08ad-49f0-b807-2f936f42bb89 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:22.038677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32ae0cec-1c21-47de-a76c-192986faa10a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd067670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.051257 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f42e0ae-08ad-49f0-b807-2f936f42bb89 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1212 microversion: 2.1 time: 0.464130 Oct 04 18:07:22.062512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1850/3834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:21 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1212 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.145472 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32ae0cec-1c21-47de-a76c-192986faa10a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.111834 Oct 04 18:07:22.150989 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1985/3835] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:22.412395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:22.443609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.444483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.445119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.488926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] Creating event network-changed:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h2-831194-21 Oct 04 18:07:22.496169 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-eb01680d-a356-46c6-9742-8ac67e500362 req-a9e70b10-9767-4b6c-8dc0-1e3b49626d2e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087411 Oct 04 18:07:22.512502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:22.514094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:22.520257 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1851/3836] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:22.525431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.526663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.527326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.532013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:22.532687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:22.533351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:22.590808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:23.087176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.088185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:23.113393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.122844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.127165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.130939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:23.136169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:23.137964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:23.335411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.345118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c2738ea-c94d-48b9-bda6-b0161d5ab9ab tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.840410 Oct 04 18:07:23.360971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1986/3837] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:22 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:23.374107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef3bdd8b-544c-4e2d-a647-1de88a009c11 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbe206f70>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:23.393040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:23.402267 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e19edc1-4940-42f9-8275-6a32a5045093 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1208 microversion: 2.1 time: 0.320846 Oct 04 18:07:23.428656 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1852/3838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1208 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:23.566031 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef3bdd8b-544c-4e2d-a647-1de88a009c11 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.199331 Oct 04 18:07:23.568768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1987/3839] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:23 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:24.395548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.397122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.407824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.417347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.418199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.419156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.419824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.420464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.431647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.433269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:24.451348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.457493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.458448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.462060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:24.463863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:24.465653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:24.715035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:24.756792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4001186a-2ee0-4b50-821d-6208b9771adc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1272 microversion: 2.1 time: 0.329135 Oct 04 18:07:24.778887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1988/3840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1272 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:24.785662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-05e52c66-f2c9-45dc-b102-a7dbe0c60b54 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd160700>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:24.957815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-05e52c66-f2c9-45dc-b102-a7dbe0c60b54 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1455 microversion: 2.1 time: 0.177365 Oct 04 18:07:24.963244 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1989/3841] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1455 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.562925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:25.576724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff553808-8c0d-41d5-bf15-190071950b8c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.185071 Oct 04 18:07:25.597926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1853/3842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:24 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:25.786641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:25.788059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:25.798514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.802360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.804033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.806521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:25.808187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:25.809639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:25.979436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85fb80dd-ccb6-47e9-b2c3-4157f1a43579 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc982310>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.364150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:26.458436 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb70f94e-46df-436b-b0d0-8c542b1a1ec8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1270 microversion: 2.1 time: 0.666649 Oct 04 18:07:26.464089 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1990/3843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1270 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:26.631354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:26.632299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:26.641704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.646219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.646871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:26.647802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:26.648945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:26.650523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.536273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.560529 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c83e996f-6668-4c2f-8cee-387ce29a060a tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.952299 Oct 04 18:07:27.565491 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1991/3844] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:26 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:27.590272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:27.590967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:27.622895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.623815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.624284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.625030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:27.629682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:27.634668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:27.913586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:27.924018 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b5890b3-ce01-4889-b021-f2fb08cc9799 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1270 microversion: 2.1 time: 0.354889 Oct 04 18:07:27.924602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1992/3845] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:27 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1270 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:28.593361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:28.594703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:28.604178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.606194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.608192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.609124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:28.611434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:28.612037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:28.806768 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85fb80dd-ccb6-47e9-b2c3-4157f1a43579 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1464 microversion: 2.1 time: 2.830359 Oct 04 18:07:28.808604 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1854/3846] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:25 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1464 bytes in 2834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:28.831987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e544396f-6141-486c-9aa9-fe7f831da9cc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc91c160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.035270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e544396f-6141-486c-9aa9-fe7f831da9cc tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 200 len: 1464 microversion: 2.1 time: 0.208122 Oct 04 18:07:29.035998 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1855/3847] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 1464 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.058888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.059673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:29.083948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.084460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.084909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.085636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.086572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.086572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.904936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:29.933625 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ae09661-9c5c-436e-8383-76621dc307e1 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.344676 Oct 04 18:07:29.950692 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1993/3848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:28 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:29.964121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:29.965020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:29.982291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.983366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.984261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:29.985461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:29.986906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:29.987612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:30.185882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.198494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:30.210163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d33403f1-177a-48c7-b31f-bdfbeeab7e51 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 1.169684 Oct 04 18:07:30.213299 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1856/3849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:30.965987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:30.974312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:30.975266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:30.989418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a647c10c-30e3-4ca8-8c1c-dc367ff18c04 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1467 microversion: 2.1 time: 1.033719 Oct 04 18:07:30.992589 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1994/3850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:29 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1467 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:31.009713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.011558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.014102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.023252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.025736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.026535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.029575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-404235518"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:31.040071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.065376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.065908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.066355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.091419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.091916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.092364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.292162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:31.364464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:31.705865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a48e4c1-a50e-4820-a23a-67f2fb767f81 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "POST /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a/action" status: 202 len: 0 microversion: 2.1 time: 0.685340 Oct 04 18:07:31.713592 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1995/3851] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:31 2022] POST /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:07:31.726388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.727560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:31.746909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.748020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.748626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.750603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:31.753849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:31.755168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:31.755773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:31.778167 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63c800ea-b5fb-4f45-8c10-d48e0f620ab6 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.808109 Oct 04 18:07:31.787086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1857/3852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:30 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:31.817004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c408a05-e79d-4178-92c6-1a68804d2710 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99cdc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:31.919877 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c408a05-e79d-4178-92c6-1a68804d2710 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.130549 Oct 04 18:07:31.929320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1858/3853] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:32.571727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:32.582489 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cee0c51a-9a49-4d52-b196-f48cc12b27e0 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.867190 Oct 04 18:07:32.583084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1996/3854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:31 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:32.760939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:32.789082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:32.798401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.803460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.807848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.808192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:32.809546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:32.834348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.836092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.839110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.840183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:32.840823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:32.843033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:32.868909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] Creating event network-changed:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:07:32.886278 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f61cbad6-2b21-4763-adef-59203bf786e6 req-bf7cb48e-5cbc-48c6-a736-1d1bf5df8a37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130476 Oct 04 18:07:32.890606 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1859/3855] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:07:32.944912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a9e9056-7991-4564-9cd1-4b4769f820f1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc8bedc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.028018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a9e9056-7991-4564-9cd1-4b4769f820f1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.088343 Oct 04 18:07:33.030242 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1860/3856] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:33.140932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-unplugged", "status": "completed", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:33.163233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.165632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.169257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.198635 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] Creating event network-vif-unplugged:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:07:33.209780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-eebb8237-04ba-4c29-a88b-6516f366cd74 req-a2683578-611f-4726-9dc1-f482479a5308 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073715 Oct 04 18:07:33.215296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1861/3857] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:33.612067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:33.613591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:33.624256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.630879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.631518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:33.632789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:33.645861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:33.646760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:34.063245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.075288 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ce31b11-40ac-4368-bfcf-aacc4d82556f tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.272304 Oct 04 18:07:34.087019 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1997/3858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:32 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:34.092220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b014d4c9-3127-456d-9c50-7a6f92a5cdbd tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd155040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:34.175354 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b014d4c9-3127-456d-9c50-7a6f92a5cdbd tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.086767 Oct 04 18:07:34.176066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1998/3859] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:34 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:34.393437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:34.410151 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40a13cc7-843a-4671-9ef6-5d51db0a63fc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.803978 Oct 04 18:07:34.411339 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1862/3860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:33 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:35.121221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.122825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.141400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.142758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.143773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.146753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.147733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.148759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.192991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c5d21c14-ad32-4ed3-b8b0-e6a3fef4417c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92f4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.287264 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c5d21c14-ad32-4ed3-b8b0-e6a3fef4417c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.098461 Oct 04 18:07:35.296404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1863/3861] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:35.437172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:35.438509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:35.454446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.455198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.455873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:35.456856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:35.457503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:35.458760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:36.143732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.152727 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78047c35-f9a6-4db0-8d01-da252d9f4f79 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.719571 Oct 04 18:07:36.157266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1864/3862] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:36.240875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:36.253247 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d0b8e4b-e24e-485b-9acd-3f62a5b0e539 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.140085 Oct 04 18:07:36.282577 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 1999/3863] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:35 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:36.303777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f43ee98-de88-48d6-b3d3-35c0fac90223 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc96e940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:36.385010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f43ee98-de88-48d6-b3d3-35c0fac90223 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.085145 Oct 04 18:07:36.385596 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1865/3864] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:36 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:37.179319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.180249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.202684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:37.211850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.212760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.214277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.222013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.224092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.225181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.293394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:37.294122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:37.315367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.317597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.318421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:37.329515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:37.330411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:37.330859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.385875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:38.410958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91cdf93d-0077-4dc3-a5a1-86278d40f530 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.108553 Oct 04 18:07:38.410958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1866/3865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:38.411741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57b5c1dc-a46a-438c-87f4-c82aa565e98e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc931550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:38.481267 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57b5c1dc-a46a-438c-87f4-c82aa565e98e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.082339 Oct 04 18:07:38.482692 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1867/3866] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:38 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:38.499332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf515d2-c200-4b22-a08c-19590990b35a", "name": "network-vif-plugged", "status": "completed", "tag": "a49b44e1-f245-4953-b88f-ad51c81241d6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:38.543901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:38.544378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:38.544818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:38.578100 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] Creating event network-vif-plugged:a49b44e1-f245-4953-b88f-ad51c81241d6 for instance daf515d2-c200-4b22-a08c-19590990b35a on n-h2-831194-21 Oct 04 18:07:38.584180 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-34814769-afdc-49fb-8d36-d4aef4f6f327 req-7233ae70-6366-463d-bbb6-2b9f45f08dfe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088886 Oct 04 18:07:38.609166 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1868/3867] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:39.301347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.326011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c4b3116-dfc4-4cb1-980b-3f1e4d54e292 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 2.148784 Oct 04 18:07:39.335618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2000/3868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:37 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:39.426850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.428448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:39.440590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.440949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.441407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.447226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:39.450928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:39.451556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:39.502427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bf86e05-a189-460a-b193-e6b2fe2f2c01 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1cab820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:39.809887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:39.826118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-317442fe-009e-4c4c-b168-16f0dfc646ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.404122 Oct 04 18:07:39.826724 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1869/3869] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.131911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cdeb9ab-655e-409f-8390-75a6c2c12dae tempest-ComputeTenantNetworksTest-2055511800 tempest-ComputeTenantNetworksTest-2055511800-project] Calling method '.version_select at 0x7fbdbc91eaf0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.471384 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cdeb9ab-655e-409f-8390-75a6c2c12dae tempest-ComputeTenantNetworksTest-2055511800 tempest-ComputeTenantNetworksTest-2055511800-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.643597 Oct 04 18:07:40.476575 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1870/3870] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:40.487105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.490496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.527875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.528730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.529393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.530342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.530984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.533898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.659394 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4bf86e05-a189-460a-b193-e6b2fe2f2c01 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 1.162332 Oct 04 18:07:40.665641 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2001/3871] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:39 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:40.680891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc90b57d-c224-4872-81c2-00c11feaf9b3 tempest-ComputeTenantNetworksTest-2055511800 tempest-ComputeTenantNetworksTest-2055511800-project] Calling method '.version_select at 0x7fbdbd21eaf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.866481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc90b57d-c224-4872-81c2-00c11feaf9b3 tempest-ComputeTenantNetworksTest-2055511800 tempest-ComputeTenantNetworksTest-2055511800-project] 10.222.0.42 "GET /compute/v2.1/os-tenant-networks/2e1045d4-415c-44c8-8b37-556a3e999bc5" status: 200 len: 140 microversion: 2.1 time: 0.199354 Oct 04 18:07:40.867834 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2002/3872] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/os-tenant-networks/2e1045d4-415c-44c8-8b37-556a3e999bc5 => generated 140 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:40.884155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:40.884933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:40.904638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.907393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.907903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:40.909195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:40.913131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:40.913660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:41.129534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.141611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4b83d6a-9e7f-4061-a4db-754b25165fe2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.660839 Oct 04 18:07:41.144952 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1871/3873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.346886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:41.367228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5340aadb-679f-4594-b55a-ec61bbc8f611 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.497591 Oct 04 18:07:41.370913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2003/3874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:40 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:41.679563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04b33042-fc4a-479b-b7b7-64ae67b0f59f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99cd30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:41.817689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04b33042-fc4a-479b-b7b7-64ae67b0f59f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.143695 Oct 04 18:07:41.818495 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1872/3875] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:41 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.169655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.170384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.193257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.194274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.199075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.200408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.202081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.204082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.394719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:42.395343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:42.413278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.413922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.421090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.422350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.423089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.425317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.687866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:42.703526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f61dc89e-18e7-4d3d-9751-11d811dc56b9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.538794 Oct 04 18:07:42.704133 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2004/3876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:42.769821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-plugged", "status": "completed", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:42.793002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:42.793511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:42.796121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:42.827272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] Creating event network-vif-plugged:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:07:42.843498 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-24ba8210-f52a-4781-a42c-33e8f8e5aa8a req-741dd709-7888-4ada-b309-44d5e9095109 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074807 Oct 04 18:07:42.844372 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2005/3877] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:42.863793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c1b9cd9-70c3-4b4a-bfc8-fe2ae41d6e92 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd29c160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.006377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c1b9cd9-70c3-4b4a-bfc8-fe2ae41d6e92 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.158336 Oct 04 18:07:43.016195 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2006/3878] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:43.730263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:43.731020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:43.741802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.759663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.763514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.768489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:43.770067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:43.770952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:43.913865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:43.933483 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0106f80c-6574-4b8b-bf7f-dd83615f9264 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.540050 Oct 04 18:07:43.936780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1873/3879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:42 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.027275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3e8b5e7-5fe6-4da8-8c73-67b7d1875aaf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc8d23a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.167238 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3e8b5e7-5fe6-4da8-8c73-67b7d1875aaf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.146384 Oct 04 18:07:44.170543 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1874/3880] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:44.277939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:44.290407 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6f8d093f-617f-46d3-a446-717a66600800 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1312 microversion: 2.1 time: 0.565490 Oct 04 18:07:44.295760 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2007/3881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:43 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1312 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:44.966555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:44.967779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.000912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.002633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.003890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.006002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.009881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.010950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.186883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a3739cc0-d795-47af-b4ec-28622073029d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd29c4c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.300280 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a3739cc0-d795-47af-b4ec-28622073029d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.117246 Oct 04 18:07:45.309776 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2008/3882] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:45.331553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.333164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.348421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.349381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.350086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.351354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.353527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.354534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.442253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:45.797252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:45.807704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bec1317b-b1e3-403e-bddc-14407b21c1cc tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1461 microversion: 2.1 time: 0.479175 Oct 04 18:07:45.824017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2009/3883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1461 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:45.840575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:45.841430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:45.852588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.853397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.854093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:45.855073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:45.855729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:45.856390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.104062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:46.124245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-88157712-463b-47b7-9b88-87f31e098462 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 1.157985 Oct 04 18:07:46.124901 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1875/3884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:44 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:46.228811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce335b0b-2688-48ff-9171-5f7a1e63232c tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1614 microversion: 2.1 time: 0.389719 Oct 04 18:07:46.235683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2010/3885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:45 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1614 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:46.260005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:46.260741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:46.272011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.272690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.273235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.278895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:46.279559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:46.280089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:46.316408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3b77996-fed6-4f87-9210-d937a98bedf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd29c550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:46.401558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3b77996-fed6-4f87-9210-d937a98bedf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.088753 Oct 04 18:07:46.402573 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2011/3886] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:46 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:47.157980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.158800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:47.174300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.176557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.177400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.179041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.181525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.185022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:47.362393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8ed0f8ba9714428ea8ea710356a42cfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb22f70dbad4d27a225050db6de2d97', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.363074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] flavor_id is None. Assuming migration. {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:07:47.363521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:07:47.749649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:47.759413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f19d2ce-4d58-48dc-af8b-792dbc433d77 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.609935 Oct 04 18:07:47.776418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2012/3887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:07:47.781855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-074ff4db-6732-4995-a431-369202403018 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd160310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:47.899820 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-074ff4db-6732-4995-a431-369202403018 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.121639 Oct 04 18:07:47.909377 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2013/3888] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:47 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:47.922856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "name": "network-vif-plugged", "status": "completed", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:47.973689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:47.988147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=44 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:47.988713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:47.989349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.044176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] Creating event network-vif-plugged:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h2-831194-21 Oct 04 18:07:48.084961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e7804215-05ab-4b2b-8d0b-0c2ffa46f5df req-8128c6b9-97f8-4c1a-bc65-5753060b0cde service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168683 Oct 04 18:07:48.089987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2014/3889] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:48.381344 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf713dd1-acc4-46b0-8495-6faa1c507371 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb/action" status: 202 len: 0 microversion: 2.1 time: 2.126088 Oct 04 18:07:48.387617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1876/3890] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:46 2022] POST /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb/action => generated 0 bytes in 2133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:07:48.402872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.410912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.435133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.435637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.436081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.439060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.439543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.439992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.724465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:48.725084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:48.737144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.738157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.738865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.739780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:48.740404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:48.741358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:48.796588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:07:49.186325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52159d1e-ab5a-41cc-8c5f-2df9837bc3ac tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 204 len: 0 microversion: 2.42 time: 1.084368 Oct 04 18:07:49.191417 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2015/3891] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:07:48 2022] DELETE /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:07:49.212650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.214953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.236467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.236971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.237419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.253599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.261631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.262429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.455459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.471462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb751e4c-dae1-4c6b-9cd3-d58ccde86a8b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1470 microversion: 2.1 time: 1.079448 Oct 04 18:07:49.481895 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1877/3892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:48 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1470 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.487965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fcc3eb40-bfbf-4e1e-a180-7b7b69d07b20 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc931ca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.622496 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fcc3eb40-bfbf-4e1e-a180-7b7b69d07b20 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.137894 Oct 04 18:07:49.637026 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1878/3893] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:49.647029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:49.648105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:49.664617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.665609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.667479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.669336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:49.672046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:49.673658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:49.865325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:49.874109 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1438322b-f9a2-42cc-b390-9ce0ecacfdb3 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.680685 Oct 04 18:07:49.879306 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2016/3894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:50.520843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:50.521484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:50.545044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.545566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.546078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:50.556614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:50.559751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:50.563400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.251667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.265193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07020cf5-2946-4861-afcc-00a39d859335 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1470 microversion: 2.1 time: 0.756132 Oct 04 18:07:51.268375 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2017/3895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:50 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1470 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:51.294499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1953ea9b-c108-4d09-8076-b072439360ce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd20f670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.348950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.411212 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1953ea9b-c108-4d09-8076-b072439360ce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.141398 Oct 04 18:07:51.416935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.420591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2018/3896] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:51.424919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:51.435909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82c336e5-76b8-4d67-86d3-f23e51679a23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2960 microversion: 2.42 time: 1.797001 Oct 04 18:07:51.447576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1879/3897] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:49 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2960 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:51.450655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:51.454962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:51.496378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.496889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.497448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:51.505968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:51.506657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:51.513172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.282890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:52.293440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:52.296692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:52.308605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f93a7b1-1e09-4506-bdb7-be8e4b8abb94 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1518 microversion: 2.1 time: 0.886566 Oct 04 18:07:52.319015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2019/3898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:51 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1518 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:52.323697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.331740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.334392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.335307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:52.336047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:52.340243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:52.441469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9eb7ff1-a1e3-472d-97cc-5ce858afc2a8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd2734c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.558233 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9eb7ff1-a1e3-472d-97cc-5ce858afc2a8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 2.122767 Oct 04 18:07:54.564396 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2020/3899] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:54.595060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.599063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.608256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.609165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.609805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.623892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.624817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.626742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.807787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:54.829908 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-faebf869-d0fc-4620-b026-43c8ac0b904d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1470 microversion: 2.1 time: 2.539790 Oct 04 18:07:54.829908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1880/3900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:52 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1470 bytes in 2541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:54.832952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:54.841027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:54.868402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.871038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.873779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:54.875741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:54.877484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:54.879934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.740396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.756284 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-175b3dd3-0ef6-4baa-98ec-6d16df53491b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.927197 Oct 04 18:07:55.756893 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1881/3901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:55.771418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a2f8dd19-ed34-4a31-90d2-26a82a09b9bb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:55.815667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:55.818002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:55.829444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:55.853204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.877201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] Creating event network-vif-unplugged:a2f8dd19-ed34-4a31-90d2-26a82a09b9bb for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:07:55.895123 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-30505a6f-e388-4af8-a0f6-b4ac30d8879b req-73362aa4-75fd-4bee-822b-2a530715f73b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135270 Oct 04 18:07:55.895731 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1882/3902] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:55.897769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.909579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:55.919900 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33c49a3d-8b8c-4dde-a540-44ab4b86c8fc tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2960 microversion: 2.42 time: 1.345356 Oct 04 18:07:55.920592 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2021/3903] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:54 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2960 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:55.930744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef4911a3-b89d-48a0-9671-5cf78d2cfc55 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc8bedc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.966317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:55.975533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.029047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.031147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.034317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.036775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.037349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.037819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.054909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef4911a3-b89d-48a0-9671-5cf78d2cfc55 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.147019 Oct 04 18:07:56.058182 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1883/3904] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:56.070025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:56.070025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:56.099766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.102653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.104492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.106053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:56.107869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:56.111719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:56.170921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:07:57.419672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:57.467790 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-258d2e9d-41b9-480f-9667-32b80db27313 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1470 microversion: 2.1 time: 1.397092 Oct 04 18:07:57.473172 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1884/3905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:56 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1470 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:57.502809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:57.504113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:57.533092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.537379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.538269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:57.548413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:57.552871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:57.562360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.006626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:58.030363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c808d31d-ce15-4b30-b75d-be0dd533672b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 2.093176 Oct 04 18:07:58.046781 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2022/3906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:55 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.106086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-805ce74c-a58b-4a43-8279-da2837b2896c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7d5670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.236709 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-805ce74c-a58b-4a43-8279-da2837b2896c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.184676 Oct 04 18:07:58.242297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2023/3907] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:58.262832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "92dfa124-5ad1-4328-b6e5-27dcb4998361"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:58.278487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.279354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.280038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.307009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] Creating event network-vif-unplugged:92dfa124-5ad1-4328-b6e5-27dcb4998361 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:07:58.325581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-75803c15-0cbc-432c-9d47-d2b27486e406 req-7a80267b-a1f2-4d2b-9904-8c1f195dacfb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076309 Oct 04 18:07:58.329323 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2024/3908] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:07:58.348184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:58.349153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:58.372740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.391606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.393861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:58.394948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:58.398033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:58.400133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.069141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.098088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.121104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.123697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:07:59.124256 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94de3e8c-eccb-43d9-a5cb-77b22accf7ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.782972 Oct 04 18:07:59.125714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c393b91d-b232-4786-9f47-0bc0a83ff0ba tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2960 microversion: 2.42 time: 1.650243 Oct 04 18:07:59.127296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1885/3909] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:07:57 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2960 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:07:59.131051 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2025/3910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:58 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:59.134060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.146333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.166273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.167322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.168061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.169742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.170611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.171291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.189806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5f268b4-040f-4821-8851-dca083de0718 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:07:59.233726 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f5f268b4-040f-4821-8851-dca083de0718 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5f268b4-040f-4821-8851-dca083de0718 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/c1253d2c-cf05-4482-a2ba-af3defc42d90/action HTTP/1.1 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: {"os-stop": {}} Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c1253d2c-cf05-4482-a2ba-af3defc42d90', 'body': {'os-stop': {}}} Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:07:59.257808 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. Oct 04 18:07:59.262514 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:07:59.267084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5f268b4-040f-4821-8851-dca083de0718 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance c1253d2c-cf05-4482-a2ba-af3defc42d90 has no mapping to a cell. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:07:59.269783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f5f268b4-040f-4821-8851-dca083de0718 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/c1253d2c-cf05-4482-a2ba-af3defc42d90/action" status: 404 len: 117 microversion: 2.1 time: 0.101652 Oct 04 18:07:59.275559 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2026/3911] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:07:59 2022] POST /compute/v2.1/servers/c1253d2c-cf05-4482-a2ba-af3defc42d90/action => generated 117 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:07:59.283028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e5d6c94-1a82-40ba-8139-42daba20d335 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd20f310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.418546 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e5d6c94-1a82-40ba-8139-42daba20d335 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.138245 Oct 04 18:07:59.420345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2027/3912] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:07:59.427839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:07:59.431865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:07:59.461447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.464895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.468729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:07:59.470473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:07:59.472147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:07:59.473160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.206380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.218042 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22f393d9-00f5-4b09-b7cb-a650f2f94858 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 1.088927 Oct 04 18:08:00.235007 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1886/3913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:00.245504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.246420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.277472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.278610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.280895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.282212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.283083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.289799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.531037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:00.539734 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-61b8a0f3-a20c-4fcd-a808-94a7338d1d82 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.117547 Oct 04 18:08:00.546651 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2028/3914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:07:59 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:00.566514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be9c3218-a132-48ca-bdc7-85ee30f42f79 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd19cca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.696085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be9c3218-a132-48ca-bdc7-85ee30f42f79 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.148034 Oct 04 18:08:00.696786 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2029/3915] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:00.721163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "c76c890b-2bc2-43f9-bb54-90bda2d549c7"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "59eb436f-b38a-4fd4-8470-fd6e976515df"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:00.770893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.774152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.775192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.815996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Creating event network-vif-unplugged:c76c890b-2bc2-43f9-bb54-90bda2d549c7 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:00.816510 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] Creating event network-vif-unplugged:59eb436f-b38a-4fd4-8470-fd6e976515df for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:00.849954 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-449b240a-b0e2-4343-bb91-ae3829b10c00 req-a56cb824-7c86-4784-b75e-80b7d050e0e9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.149092 Oct 04 18:08:00.860545 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2030/3916] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:00.874417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:00.888796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:00.932151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.933655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.937134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:00.938448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:00.941621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:00.946569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.316940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.370703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.373576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.403219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a875f24-4791-414d-ac27-f75b8e10154f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2939 microversion: 2.42 time: 1.151682 Oct 04 18:08:01.405078 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1887/3917] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2939 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:01.426602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.434259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.469370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.472203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.473730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.478596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:01.484878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:01.486039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:01.737110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:01.755283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-310264d8-a89e-46e8-b06f-d22c2d1f26fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.891556 Oct 04 18:08:01.769867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2031/3918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:00 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.784653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-252830b2-4dd6-4138-99d9-c6610038cf3d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc71a550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:01.895382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-252830b2-4dd6-4138-99d9-c6610038cf3d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.129628 Oct 04 18:08:01.896180 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2032/3919] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:01.920740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:01.931544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82f3b42d-60f9-4f19-8564-36a91fcf3b6d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:01.955905 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82f3b42d-60f9-4f19-8564-36a91fcf3b6d/action HTTP/1.1 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: {"suspend": {}} Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82f3b42d-60f9-4f19-8564-36a91fcf3b6d', 'body': {'suspend': {}}} Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:01.966623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:01.970889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:01.970889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:01.970889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. Oct 04 18:08:01.970889 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:01.974633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 82f3b42d-60f9-4f19-8564-36a91fcf3b6d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:01.979040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1ab485c-2284-4761-85e0-0d84d8ddf470 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82f3b42d-60f9-4f19-8564-36a91fcf3b6d/action" status: 404 len: 111 microversion: 2.1 time: 0.078623 Oct 04 18:08:01.985961 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2033/3920] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:01 2022] POST /compute/v2.1/servers/82f3b42d-60f9-4f19-8564-36a91fcf3b6d/action => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:01.998024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.009755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.038180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.044221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.058310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.063124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.066378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.069638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.618393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:02.636546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea878722-349a-4c97-a105-685f7e7d12f3 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 1.227442 Oct 04 18:08:02.646907 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1888/3921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:02.710202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:02.718652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:02.742855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.743561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.744025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:02.744785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:02.745256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:02.745706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.326293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.328557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.362427 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd0d6ccc-0465-40c8-b1d8-122d2136e7b2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.372585 Oct 04 18:08:03.370770 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2034/3922] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:01 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.373467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.375348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:03.380988 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4a0aac4b-c85f-4266-90cf-a4ec3810ded7 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2939 microversion: 2.42 time: 0.731613 Oct 04 18:08:03.381556 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1889/3923] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:02 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2939 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:03.393995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53e319a4-e4c8-44cc-911a-91651e6183bd tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd20fdc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.430784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "87cc0608-a9ad-4830-ae2d-83cab81d2099"}, {"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-unplugged", "status": "completed", "tag": "2cbf1a8a-abbc-4246-b544-2a63d42f5947"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:03.473347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.473495 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53e319a4-e4c8-44cc-911a-91651e6183bd tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.100865 Oct 04 18:08:03.474363 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2035/3924] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:03.479256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.479887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.480393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.481104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.521566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.522113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.522573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.524057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.524629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.525070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.527192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Creating event network-vif-unplugged:87cc0608-a9ad-4830-ae2d-83cab81d2099 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:03.530673 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] Creating event network-vif-unplugged:2cbf1a8a-abbc-4246-b544-2a63d42f5947 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:03.564133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3d448aa4-1594-4537-9af7-e1331d4dd489 req-4490b22d-112a-4385-bc47-2ab880f054dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.139046 Oct 04 18:08:03.565584 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1890/3925] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:03.676368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:03.677108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:03.687379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.702488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.707751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:03.709127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:03.711485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:03.712643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.865130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:04.880591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1077c83e-b999-4b9f-aeaa-588faaedfc40 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 1.207231 Oct 04 18:08:04.883073 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1891/3926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:04.912722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:04.913460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:04.939716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.940590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.941281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:04.942450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:04.944715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:04.946177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.451469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:05.505907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-230879ef-57a5-433a-9c86-92b9d328ecba tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 2.022617 Oct 04 18:08:05.514185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2036/3927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:03 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:05.525539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-912e75e8-93e1-4a07-aac0-944074021bcf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd33fee0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.673415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-912e75e8-93e1-4a07-aac0-944074021bcf tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.156410 Oct 04 18:08:05.684206 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2037/3928] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:05.698546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:05.699452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.714019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.718660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.720563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.723674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.727660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.728704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.797920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:05.817598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lazy-loading 'flavor' on Instance uuid 82709aba-62fd-4fbe-87c8-b951080fdd93 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:05.949360 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ef23769-822f-4590-8213-732a044c37ef tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.262838 Oct 04 18:08:05.954584 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2038/3929] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:05 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:05.961347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:05.962337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:05.979217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.980301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.981636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:05.983187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:05.984823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:05.985584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.179373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.190819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.194036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.204191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e28a4697-f338-4afc-ae02-f290b07d9a9b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2918 microversion: 2.42 time: 1.315631 Oct 04 18:08:06.229685 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1892/3930] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:04 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2918 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:06.236865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:06.247082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:06.255426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.255930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.256379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.257176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:06.258292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:06.258738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:06.894924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:06.931026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c30b2a9a-f793-478a-b68b-7e5e790be639 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 0.975213 Oct 04 18:08:06.975159 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2039/3931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:05 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:06.991912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4afbebaf-3a01-47f7-9af0-e18ece24646e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd239e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.123745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:07.150706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7453b410-5f6a-4d73-b365-2c5d3ad9369d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1513 microversion: 2.1 time: 0.916548 Oct 04 18:08:07.151727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1893/3932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:06 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1513 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:07.211582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4afbebaf-3a01-47f7-9af0-e18ece24646e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.233302 Oct 04 18:08:07.219066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2040/3933] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:06 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:07.239183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.240114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.260461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.260970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.261537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.262315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:07.262780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:07.274432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:07.983061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:07.984076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:07.985964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:08.021642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.030706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.042616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.046909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.050337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.055280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.600228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.626764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.644557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.646663 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5724bbf8-f810-4b00-aa79-dc121217311c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2871 microversion: 2.42 time: 1.414499 Oct 04 18:08:08.685739 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1894/3934] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2871 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:08.709458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:08.711180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:08.751117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.751117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.751569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.763833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:08.764428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:08.778044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:08.787394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:08.805515 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31a1c74a-80db-45e5-b8e7-d1811cf5013a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 0.821061 Oct 04 18:08:08.808394 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2041/3935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:07 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:08.827892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d908009-8095-4c1b-95f7-b2bfdd670504 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd239e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:08.967818 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d908009-8095-4c1b-95f7-b2bfdd670504 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.153194 Oct 04 18:08:08.983216 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2042/3936] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:08 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:08.996430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-deleted", "tag": "59eb436f-b38a-4fd4-8470-fd6e976515df"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:09.027123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.027604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.028052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.057416 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] Creating event network-vif-deleted:59eb436f-b38a-4fd4-8470-fd6e976515df for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:09.073385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8d562dfe-e701-46be-89b6-25e35dbf592e req-b09be0cc-79c8-4a2a-90f1-57f8c51e2137 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087967 Oct 04 18:08:09.076951 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2043/3937] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:09.096566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:09.112056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29e2b11d-21ed-4072-b3cc-a4548898d134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1496 microversion: 2.1 time: 0.425008 Oct 04 18:08:09.131768 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1895/3938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:08 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1496 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:09.137758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:09.138515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.159395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.160554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.161212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.163254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.166587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.168592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.242634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lazy-loading 'flavor' on Instance uuid 82709aba-62fd-4fbe-87c8-b951080fdd93 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:08:09.271311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'suspend' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state suspended Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: {"suspend": {}} Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'suspend' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state suspended Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'suspend': {}}} Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state suspended. Cannot suspend while the instance is in this state. Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 04 18:08:09.277738 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state suspended Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state suspended Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'suspend' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state suspended {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:09.285247 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-187c0287-e99a-464e-9054-dc1bbb22e1f4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 148 microversion: 2.1 time: 0.153476 Oct 04 18:08:09.291950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2044/3939] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:09 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 148 bytes in 161 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:08:09.314896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:09.316460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.325165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.325901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.334555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.336614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.341249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.342046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.565361 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e76fe994-5a98-483e-88ae-fd18638dadd7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 202 len: 0 microversion: 2.1 time: 0.257921 Oct 04 18:08:09.569249 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1896/3940] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:09 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:09.577739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.578687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.648417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.654780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.658918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.664945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.669469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.674926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.682038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:09.683045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:09.707649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.713350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.715870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:09.716903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:09.720546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:09.729741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.447153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:10.458930 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01408664-87a8-4b2b-9411-d9ba3efdc630 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1502 microversion: 2.1 time: 0.884933 Oct 04 18:08:10.463576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2045/3941] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1502 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:10.508093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:10.509380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:10.541943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.542459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.547191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:10.548058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:10.548552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:10.549076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.196032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.252545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.268549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.276075 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5f564b3-85cc-4eef-8efe-c5527643562a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2757 microversion: 2.42 time: 1.594383 Oct 04 18:08:11.294328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1897/3942] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:09 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2757 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:11.312437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b7056bf-a2a2-458c-90fa-1d170589f772 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc96e430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.370896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:11.388567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dba65ae7-0ca9-411a-a95b-a72a92e2aa63 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 0.921913 Oct 04 18:08:11.402317 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2046/3943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:10 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:11.498323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:11.499032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:11.532901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.534126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.535176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.540898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.541784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.542522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.559400 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b7056bf-a2a2-458c-90fa-1d170589f772 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.241201 Oct 04 18:08:11.576317 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1898/3944] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:11.593723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-deleted", "tag": "a2f8dd19-ed34-4a31-90d2-26a82a09b9bb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:11.682227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:11.685323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:11.686331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:11.769336 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] Creating event network-vif-deleted:a2f8dd19-ed34-4a31-90d2-26a82a09b9bb for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:11.817550 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-37173c4e-e302-446a-bba5-d8e8f22aa3d5 req-a42ec3ea-545b-4c95-854c-fae86608d619 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237466 Oct 04 18:08:11.821443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1899/3945] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:12.315039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:12.325930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:12.365723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.368406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.369304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.375191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.376031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.376977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.727249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:12.752423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bcd275cd-4834-4baf-a171-486cc7480d65 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1502 microversion: 2.1 time: 1.261592 Oct 04 18:08:12.770562 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2047/3946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:11 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1502 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:12.784883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:12.785595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:12.801141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.801580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.803606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:12.807044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:12.808637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:12.809925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.355209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.368086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.370974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:14.373319 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4bf29571-9691-4635-8d2a-d57bcb56db67 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2552 microversion: 2.42 time: 2.066279 Oct 04 18:08:14.375291 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1900/3947] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:12 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2552 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:14.383388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6d1c3363-eda7-43b2-9ddb-4113763e5afb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92fb80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.482015 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6d1c3363-eda7-43b2-9ddb-4113763e5afb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1454 microversion: 2.1 time: 0.105217 Oct 04 18:08:14.485819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1901/3948] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:14 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1454 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:14.514292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:14.515076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:14.537460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.549217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.549924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:14.550715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:14.551230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:14.551650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.264706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.282807 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f06185a4-4066-4a60-8df0-81d2090d6d17 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1475 microversion: 2.1 time: 2.510730 Oct 04 18:08:15.283424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2048/3949] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:12 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1475 bytes in 2512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.407055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.408182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:15.423922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.424721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.425400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.426364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.427020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.427848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.509243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:15.524373 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9dfd50a-0317-4328-8504-431b717d91e9 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1502 microversion: 2.1 time: 1.032741 Oct 04 18:08:15.526184 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1902/3950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:14 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1502 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.539247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abec3c0d-4d50-4067-be8e-ecb989f36e40 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc96e790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.637598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-abec3c0d-4d50-4067-be8e-ecb989f36e40 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1463 microversion: 2.1 time: 0.102529 Oct 04 18:08:15.638737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1903/3951] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1463 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.650403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-deleted", "tag": "2cbf1a8a-abbc-4246-b544-2a63d42f5947"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:15.676663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.677542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.678233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.708450 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] Creating event network-vif-deleted:2cbf1a8a-abbc-4246-b544-2a63d42f5947 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:15.728487 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8a97c0fb-d037-41cd-a109-bccbd46b2ca0 req-d06e3898-3835-4753-8cb0-1e786522936e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087614 Oct 04 18:08:15.729982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1904/3952] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:15.750262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4873fca5-6276-4ee4-9197-d04eba57bb8a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc978d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.860938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4873fca5-6276-4ee4-9197-d04eba57bb8a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 200 len: 1463 microversion: 2.1 time: 0.128972 Oct 04 18:08:15.867912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1905/3953] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 1463 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:15.878807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:15.890988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:15.899604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.900456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.901369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.902370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:15.903083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:15.903872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:15.909027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:16.509439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.512965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.547321 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a48c60c-40d8-4456-81c7-21e71cd4dce9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1468 microversion: 2.1 time: 0.672209 Oct 04 18:08:16.550613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.552349 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1906/3954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1468 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:16.556590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:16.560077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33fecc84-42ad-4c99-957e-2daf91529649 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2505 microversion: 2.42 time: 1.157422 Oct 04 18:08:16.561094 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2049/3955] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:15 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2505 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:16.578612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.579904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.589076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:16.590176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:16.609089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.609596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.610088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.610803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.611458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.612033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.622267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.627608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.628638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:16.629595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:16.630258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:16.632999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.364851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:17.379061 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27ff75e6-e309-43d7-98e8-8a58109188c8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1474 microversion: 2.1 time: 0.824926 Oct 04 18:08:17.380027 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1907/3956] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:16 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1474 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:17.401880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-40061780"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:17.404732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.423793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.426441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.427124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.428405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.435234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.436028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.857253 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3830d9b-f855-43b5-b202-3d9e6f657cf4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "POST /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a/action" status: 202 len: 0 microversion: 2.1 time: 0.464797 Oct 04 18:08:17.860280 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1908/3957] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:17 2022] POST /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:08:17.874891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:17.876194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:17.895759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.896514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.897192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:17.898943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:17.899764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:17.900414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.174565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.197696 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8885bd14-24f2-4ed3-9412-4563e9ace43c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.626255 Oct 04 18:08:18.199930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2050/3958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:16 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.210154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:18.246982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.247729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.248361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.281722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Creating event network-vif-unplugged:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h1-831194-21 Oct 04 18:08:18.298146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] Instance d3a8168a-f444-4bd8-b068-118303ac33fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:08:18.330402 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3ae5775c-ac70-4a79-925c-e4b4a0bf3068 req-8fc055fa-020e-4b99-b664-d2513569cca2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126901 Oct 04 18:08:18.343951 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2051/3959] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:18.361458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6958e4e7-98e4-419d-8c0a-d9b5e8cff5fb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd273280>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.436418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6958e4e7-98e4-419d-8c0a-d9b5e8cff5fb tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.091143 Oct 04 18:08:18.437416 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2052/3960] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:18 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:18.443321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.444255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:18.452293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.452952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.453557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.454445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:18.455066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:18.455642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:18.937699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.965397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.971198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:18.972531 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f31957d0-c482-4004-8e29-c84542f23737 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2391 microversion: 2.42 time: 1.110616 Oct 04 18:08:18.973129 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1909/3961] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:17 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2391 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:18.985156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:18.985710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.007618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=56 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:19.010357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.010868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.013985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.014768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.015540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.018132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.392695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:19.407287 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d0d8dc6-a9a7-4edb-ac4b-1ae10d3d181e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.968535 Oct 04 18:08:19.444611 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2053/3962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:18 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:19.451698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64e5a4a1-ada0-4382-85be-87cdf6626f14 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd79faf0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:19.552260 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64e5a4a1-ada0-4382-85be-87cdf6626f14 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.104311 Oct 04 18:08:19.557065 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2054/3963] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:19.562510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:19.570809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 8ea29349-53b9-40d6-94a7-eabdbed33cff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.591147 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/8ea29349-53b9-40d6-94a7-eabdbed33cff/action HTTP/1.1 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: {"unpause": {}} Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8ea29349-53b9-40d6-94a7-eabdbed33cff', 'body': {'unpause': {}}} Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:19.596286 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:19.600358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:19.600358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:19.600358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. Oct 04 18:08:19.600358 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:19.613130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 8ea29349-53b9-40d6-94a7-eabdbed33cff could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:19.614283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b309837-8808-4476-afdf-b507f3955f73 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/8ea29349-53b9-40d6-94a7-eabdbed33cff/action" status: 404 len: 111 microversion: 2.1 time: 0.055998 Oct 04 18:08:19.620123 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2055/3964] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:19 2022] POST /compute/v2.1/servers/8ea29349-53b9-40d6-94a7-eabdbed33cff/action => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:19.625755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf515d2-c200-4b22-a08c-19590990b35a", "name": "network-vif-unplugged", "status": "completed", "tag": "a49b44e1-f245-4953-b88f-ad51c81241d6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:19.666533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.670267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.671066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.691179 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] Creating event network-vif-unplugged:a49b44e1-f245-4953-b88f-ad51c81241d6 for instance daf515d2-c200-4b22-a08c-19590990b35a on n-h2-831194-21 Oct 04 18:08:19.727646 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-562416fa-5756-4cf0-a758-34c94b8b11c2 req-ceec2edc-ef76-4334-b242-54afc9fadbd3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103446 Oct 04 18:08:19.730059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2056/3965] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:19.736698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:19.739536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:19.753728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.771084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.772069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:19.775414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:19.786019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:19.789053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.278612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.295363 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e9eba54-3ed2-413b-a55c-4da744f5c707 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1474 microversion: 2.1 time: 1.314193 Oct 04 18:08:20.296049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1910/3966] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:18 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1474 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.324387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.325664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.364506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.365024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.365481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.373999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.374804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.377411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.612777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:20.630097 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8e5c702-9f84-4cc0-b7e0-12757d88a58e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.898025 Oct 04 18:08:20.630653 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2057/3967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:19 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.655061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-deleted", "tag": "c76c890b-2bc2-43f9-bb54-90bda2d549c7"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:20.695217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.698338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.700580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.765483 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] Creating event network-vif-deleted:c76c890b-2bc2-43f9-bb54-90bda2d549c7 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:20.777649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ffc09d93-0c89-4eb9-b451-ac96651afdcf req-640b785f-56a7-4626-9ce4-7db57fc6245d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142170 Oct 04 18:08:20.780849 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2058/3968] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:20.798669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f1122ed-5656-46c4-bf82-1e2e995fd252 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd7a2430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.921990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f1122ed-5656-46c4-bf82-1e2e995fd252 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.138881 Oct 04 18:08:20.923234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2059/3969] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:20.932528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:20.934123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:20.942967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.945256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.946914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:20.947897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:20.948678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:20.949552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.634701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.649178 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6060c87-2761-44a4-934f-48cdc5da216c tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.723741 Oct 04 18:08:21.666282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.680502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.685985 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2060/3970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:21.689819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:21.691383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-273ca0e0-a30b-490f-8543-66140c1d044b tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 2344 microversion: 2.42 time: 1.391619 Oct 04 18:08:21.698053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1911/3971] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:20 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 2344 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:21.710671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:21.717464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:21.718674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.735472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.738056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.739728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.742061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.742574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.743286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.744204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.745952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.748018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.782041 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Creating event network-changed:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h1-831194-21 Oct 04 18:08:21.791394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] Instance d3a8168a-f444-4bd8-b068-118303ac33fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:08:21.805362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2dd47d56-61b3-4a7e-abf7-4e55f57d3c5d req-ca461fac-a2ea-4eba-84eb-f08950f7328c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117667 Oct 04 18:08:21.807793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2061/3972] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:21.815716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:21.817598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:21.829225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.830191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.831728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.832691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:21.833351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:21.844431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:21.852163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:21.934282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'unpause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 15 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: {"unpause": {}} Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'unpause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'unpause': {}}} Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state active. Cannot unpause while the instance is in this state. Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:21.940159 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:21.945394 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:21.945394 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:21.945394 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:21.945394 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:21.945394 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:21.950263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'unpause' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:21.951435 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55a75384-9779-4292-8d68-2c7704c68ca2 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 145 microversion: 2.1 time: 0.142307 Oct 04 18:08:21.952951 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2062/3973] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:21 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 145 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:21.963103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d3451be-78f9-4bd1-84ad-3a52f5adaae6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd29c0d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.135557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d3451be-78f9-4bd1-84ad-3a52f5adaae6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.177439 Oct 04 18:08:22.142348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2063/3974] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:22.173226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:22.173864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:22.231060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.232907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.233400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:22.234197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:22.234681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:22.235122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.329393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.343061 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad29e4f0-8705-4c0e-bc4f-f242e6237dd9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1474 microversion: 2.1 time: 1.642470 Oct 04 18:08:23.344052 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1912/3975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:21 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1474 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.353933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.354525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.377477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.389210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.390519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.395209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.396362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.400012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.587554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.597314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.599196 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bac355d9-0d91-460d-b9d8-53f7835e14d4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.453284 Oct 04 18:08:23.610099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2064/3976] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:22 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.615937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.621981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:23.623958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19f4059b-6f00-49b9-a28c-9e67c69bfa1d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.278624 Oct 04 18:08:23.642777 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1913/3977] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:23.652453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04a2c927-a236-4ac4-8028-e8cd0d19c0ae tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd79f4c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.667389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a304726-e396-4ecc-818c-6725af5143e7", "name": "network-vif-deleted", "tag": "87cc0608-a9ad-4830-ae2d-83cab81d2099"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:23.687458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.691011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.691633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.733360 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] Creating event network-vif-deleted:87cc0608-a9ad-4830-ae2d-83cab81d2099 for instance 0a304726-e396-4ecc-818c-6725af5143e7 on n-h2-831194-21 Oct 04 18:08:23.749356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3c426bf7-0356-4136-8bdb-92ece82cac88 req-97132a52-8d03-4ccc-b84c-2e1552cc054b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105011 Oct 04 18:08:23.764109 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1914/3978] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:23.796414 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04a2c927-a236-4ac4-8028-e8cd0d19c0ae tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.165636 Oct 04 18:08:23.797001 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2065/3979] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:23.797728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:23.798664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:23.818686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.826767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.833225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:23.838625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:23.842071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:23.842807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.374325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:24.375664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:24.427200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.430705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.431177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:24.435374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:24.437929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:24.438388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.061372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.090123 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18f73f84-de03-4ccb-b42a-41e55c8228eb tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.324451 Oct 04 18:08:25.096199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1915/3980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:23 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.119935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.120903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.151785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.152605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.153506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.155729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.160001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.160979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.447111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.473957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.481717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.484770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d4b6f2ce-235d-40e2-b55e-98c7c528e5b4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1472 microversion: 2.1 time: 1.118414 Oct 04 18:08:25.486505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:25.489483 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9f0490d-6190-41d3-bf0d-1db5576f26e0 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.388312 Oct 04 18:08:25.492420 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1916/3981] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:25.517884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2066/3982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:24 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1472 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:25.519440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-plugged", "status": "completed", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:25.531612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a675c60-d7ac-49f9-be4e-03e36712a79f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd273550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.560738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.561227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.561656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.603965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] Creating event network-vif-plugged:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:08:25.630100 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-546d2f5e-abde-4ad5-8a17-bb1b45396213 req-097554ba-4be1-4fad-8d7f-30908c5d7de1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134201 Oct 04 18:08:25.635069 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1917/3983] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:25.642261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:25.642674 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a675c60-d7ac-49f9-be4e-03e36712a79f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.132701 Oct 04 18:08:25.642995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 6d746db5-f16a-4529-9120-8f8e4f493eee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.643262 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2067/3984] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:25.669252 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/6d746db5-f16a-4529-9120-8f8e4f493eee/action HTTP/1.1 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 18 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: {"unshelve": null} Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6d746db5-f16a-4529-9120-8f8e4f493eee', 'body': {'unshelve': None}} Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:25.679552 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 6d746db5-f16a-4529-9120-8f8e4f493eee could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a698414f-f13c-45f1-afa8-52985dffe53b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/6d746db5-f16a-4529-9120-8f8e4f493eee/action" status: 404 len: 111 microversion: 2.1 time: 0.045146 Oct 04 18:08:25.684149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1918/3985] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:25 2022] POST /compute/v2.1/servers/6d746db5-f16a-4529-9120-8f8e4f493eee/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:25.697335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:25.698009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:25.712020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.712553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.713041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:25.713774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:25.714273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:25.714705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.296344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.314688 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-285b7233-474c-42af-98b1-9d558225e5ee tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.622146 Oct 04 18:08:26.323952 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2068/3986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:25 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:26.353806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.354509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.371598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.372387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.374725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.378269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.380368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.382612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.526931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:26.527977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:26.551506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.556691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.560001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.564332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:26.567103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:26.567570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:26.711821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.733177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.736748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:26.739267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d439e31b-d9a6-493f-bbd2-cf69ba3ccae2 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.220222 Oct 04 18:08:26.742565 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2069/3987] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:27.209430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.210651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.224233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.232701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.233721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.235100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.237796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.242757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.607191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.630076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:27.636520 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79543da9-04f4-4b73-8e60-ee8f9fc53929 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1469 microversion: 2.1 time: 0.892268 Oct 04 18:08:27.638046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2070/3988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1469 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.655230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c150e249-00db-4ce5-977f-f53b934669be tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbda5ae50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.669367 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ada0d4d-6788-48db-9aac-82fe9f93d309 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.320939 Oct 04 18:08:27.674438 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1919/3989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:26 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.687031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:27.702228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.727277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.728715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.729703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.731306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.735862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.736763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.776208 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c150e249-00db-4ce5-977f-f53b934669be tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.136341 Oct 04 18:08:27.780998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2071/3990] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:27.789427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:27.790594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.804181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.805494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.806418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.810088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.811044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.812074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.895138 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Cannot 'unshelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action HTTP/1.1 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 18 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: {"unshelve": null} Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'unshelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'unshelve': None}} Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 in vm_state active. Cannot unshelve while the instance is in this state. Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:08:27.900274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active Oct 04 18:08:27.906687 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:27.910193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 409 to user: Cannot 'unshelve' instance 82709aba-62fd-4fbe-87c8-b951080fdd93 while it is in vm_state active {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:27.911534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ab2ef197-8f89-4ef6-a75a-f0c0159f5d58 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action" status: 409 len: 146 microversion: 2.1 time: 0.128939 Oct 04 18:08:27.912599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2072/3991] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:27 2022] POST /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93/action => generated 146 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:08:27.920099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:27.920962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:27.935909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.936807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.937409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:27.938674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:27.940988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:27.942081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.075196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-775c6e10-f8e2-4860-b8b3-2099b256cfc2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "POST /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb/action" status: 202 len: 0 microversion: 2.1 time: 0.399247 Oct 04 18:08:28.078486 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1920/3992] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:08:27 2022] POST /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:08:28.081611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.099389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.110855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.112997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.115824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.117586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-921dc463-b0ad-4679-93f3-94da86156b41 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.203108 Oct 04 18:08:28.133944 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2073/3993] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:27 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:28.135860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.136998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:28.138845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.139731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.140193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.140958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.146645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.147015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.169005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.175198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.176426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.181411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:28.182499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:28.183151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:28.586083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:28.601142 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-038d80a5-dc1b-425b-9cbb-7bd5861fbef6 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 0.474575 Oct 04 18:08:28.602469 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2074/3994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:28.798070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53149be4-2cad-484c-a4b4-146a2506e785 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd743820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:28.904671 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53149be4-2cad-484c-a4b4-146a2506e785 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.106311 Oct 04 18:08:28.906002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2075/3995] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:29.155031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.156141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.177299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.178890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.179961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.180878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.181501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.185969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.289914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.307344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.309938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.311676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b215e30-6391-4878-beb5-d8684d6ed823 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.160799 Oct 04 18:08:29.313642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2076/3996] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:29.445411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:29.455881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ce8e3af-ff7c-47d9-927d-4e995c58984e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.372701 Oct 04 18:08:29.465974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1921/3997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:28 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:29.489986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.490850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.518855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.519618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.520679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.521110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.524039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.533519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.628779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:29.629695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:29.646901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.657661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.661969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.674452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:29.680006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:29.682072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:29.710907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:30.713458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:30.734802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79949415-b7ed-4f99-91c8-4bf8a73c13a9 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 1.109033 Oct 04 18:08:30.749866 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1922/3998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:30.749866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6920e0a-787a-470a-8916-0a6f81ba64d8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99c4c0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:30.841489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6920e0a-787a-470a-8916-0a6f81ba64d8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.102060 Oct 04 18:08:30.845390 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1923/3999] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:30.860493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-plugged", "status": "completed", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:30.896708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:30.898350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:30.899073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:30.934440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Creating event network-vif-plugged:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h1-831194-21 Oct 04 18:08:30.959342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] Instance d3a8168a-f444-4bd8-b068-118303ac33fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:08:30.980949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1f4109dd-dd53-4e65-a5ff-a3dca0e20da4 req-c3124881-fc4b-48c5-b0e3-637219ad2fa8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132430 Oct 04 18:08:30.994805 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1924/4000] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:31.004370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.014487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.034333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.037352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.041885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.043325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.051630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.054632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.226869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.268254 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-edc50723-0e81-4f67-9ebe-673383471e7e tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.784852 Oct 04 18:08:31.272780 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2077/4001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:29 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:31.320867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-550101147_updated"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:31.324252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: b6613981-fc37-4856-97cb-a3ac7e150ac5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.342981 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/servers/b6613981-fc37-4856-97cb-a3ac7e150ac5 HTTP/1.1 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 80 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-550101147_updated"}} Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b6613981-fc37-4856-97cb-a3ac7e150ac5', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-550101147_updated'}}} Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 04 18:08:31.370225 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. Oct 04 18:08:31.374028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:31.382677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance b6613981-fc37-4856-97cb-a3ac7e150ac5 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:31.384500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac6ae8d6-8aad-477f-8c12-afd089a435fc tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "PUT /compute/v2.1/servers/b6613981-fc37-4856-97cb-a3ac7e150ac5" status: 404 len: 111 microversion: 2.1 time: 0.069918 Oct 04 18:08:31.392099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2078/4002] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:08:31 2022] PUT /compute/v2.1/servers/b6613981-fc37-4856-97cb-a3ac7e150ac5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:31.404609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.433294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.464741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.484475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.488357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.495980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.501688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.506042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.507324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.508443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.518473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:31.519755 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30004fb4-c253-4f4c-bf14-c4c1f0e6ab83 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.522993 Oct 04 18:08:31.520339 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1925/4003] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:30 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:31.765101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:31.765735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:31.783762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.795495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.796202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:31.797119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:31.797877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:31.798595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.160385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.180828 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e0b4403-8945-4c4a-af56-01541390ef27 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.782333 Oct 04 18:08:32.184685 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2079/4004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.198710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f557e2f8-a30f-43a6-9e68-71faa568fbc7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7c71f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.287775 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f557e2f8-a30f-43a6-9e68-71faa568fbc7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.100780 Oct 04 18:08:32.306495 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2080/4005] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.317238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.322476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:32.353690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.355774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.358161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.359182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:32.362695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:32.363367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:32.959622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:32.969220 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58f4cd17-fb22-4cdd-bf5d-07b1cbcb2887 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.661103 Oct 04 18:08:32.978809 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2081/4006] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:32.988798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:32.998742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.025425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.037126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.038132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.039163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.045543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.046279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.403828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.415917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.432074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:33.433601 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf023e11-7192-46a5-aec1-3d3de03b5804 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.453482 Oct 04 18:08:33.436650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2082/4007] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:32 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:33.454608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9089d91a-392a-4a8f-bd85-c35636e743b7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9089d91a-392a-4a8f-bd85-c35636e743b7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: request: PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 HTTP/1.1 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 280 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.470106 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 04 18:08:33.473095 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:08:33.477918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9089d91a-392a-4a8f-bd85-c35636e743b7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:33.481413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9089d91a-392a-4a8f-bd85-c35636e743b7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 400 len: 619 microversion: 2.1 time: 0.043340 Oct 04 18:08:33.487799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2083/4008] 10.222.0.42 () {60 vars in 1257 bytes} [Tue Oct 4 18:08:33 2022] PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:33.494786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf9c40a9-2400-4605-9b9e-7dd60e87aed6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd79f3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.604524 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf9c40a9-2400-4605-9b9e-7dd60e87aed6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.115284 Oct 04 18:08:33.605756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2084/4009] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:33.627622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:33.631335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:33.656803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.657481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.658074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:33.659085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:33.662617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:33.663967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.037191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.056287 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-767a41ea-5794-4687-82d4-9326b6a62db1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 2.295331 Oct 04 18:08:34.056928 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1926/4010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:31 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:34.258462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.267839 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0519c54-5e7e-4750-b306-b1ed6ddbd3c4 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.652840 Oct 04 18:08:34.278822 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2085/4011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:33 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:34.313188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.313857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.333875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.340288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.343792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.348639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.349142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.356615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.473942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.474578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:34.488513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.492766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.493455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.494919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:34.495574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:34.496175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:34.638059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.655544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.658092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:34.660174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b42ec44-64a3-4ab7-8a5b-492f5b459af9 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.190439 Oct 04 18:08:34.670892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2086/4012] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:34.714038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-690ad459-dade-48d1-8891-c4a1d80e7c6b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd39a550>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:34.824831 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-690ad459-dade-48d1-8891-c4a1d80e7c6b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.128814 Oct 04 18:08:34.833274 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2087/4013] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:35.081324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.082006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.110467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.110997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.114236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.115190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.123793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:35.124323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:35.867893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:35.904038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5de371e4-7627-454a-888c-7b55ea7fb362 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 1.589068 Oct 04 18:08:35.909654 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1927/4014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:34 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:35.940342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:35.940975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:35.994591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:35.999665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.000262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.001118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.002268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.003083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.307573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.331263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.349884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.351745 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2af2a243-1042-4515-9824-6cd5e2c9d69e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.436203 Oct 04 18:08:36.354070 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1928/4015] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:36.380602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef0789b2-2890-4fc8-8b03-4cc749350712 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90fdc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.520152 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef0789b2-2890-4fc8-8b03-4cc749350712 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.164118 Oct 04 18:08:36.520982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1929/4016] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:36.543337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d543eabd-7b3e-424a-9b49-4b0f37e94d5d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d543eabd-7b3e-424a-9b49-4b0f37e94d5d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: request: PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 HTTP/1.1 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 24 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: {"server": {"name": ""}} Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93', 'body': {'server': {'name': ''}}} Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '' Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:08:36.568525 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d543eabd-7b3e-424a-9b49-4b0f37e94d5d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d543eabd-7b3e-424a-9b49-4b0f37e94d5d tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 400 len: 108 microversion: 2.1 time: 0.035249 Oct 04 18:08:36.575157 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1930/4017] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:08:36 2022] PUT /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 108 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:08:36.593022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:36.593661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:36.610064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.612409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.612876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.613627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:36.614124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:36.618274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:36.620142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:36.640779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14b82667-caf1-4052-b329-d8228f0fc17e tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 1.561601 Oct 04 18:08:36.643408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2088/4018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:35 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:36.971386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:37.008202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b77f9f0-2f0c-4d9e-8e11-c02369ddfca0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1505 microversion: 2.1 time: 0.428848 Oct 04 18:08:37.025952 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1931/4019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:36 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.385966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.386851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.418219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.419625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.420531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.423199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.428154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.431218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.519138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:37.537240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b151d8c-ffe2-4298-b6b4-1de747853080 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90ff70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.697315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b151d8c-ffe2-4298-b6b4-1de747853080 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.164555 Oct 04 18:08:37.706099 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1932/4020] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:37.716044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:37.716705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:37.773048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.780304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.781026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.785133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:37.796282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:37.801125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:37.996305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.030490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.041289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.050852 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b880e27-be11-48eb-b066-8b439ec8f766 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.666606 Oct 04 18:08:38.055903 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2089/4021] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:38.713623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3399cc4b-1be8-463e-8d9d-992ac1d5034a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd694d30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:38.846899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:38.861301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3399cc4b-1be8-463e-8d9d-992ac1d5034a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.151612 Oct 04 18:08:38.862881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2090/4022] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:38 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:38.871936 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b64300b1-b0c3-43e2-b85f-902da4fafdad tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 1.168333 Oct 04 18:08:38.878683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1933/4023] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:37 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.081294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.082221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.100733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=72 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:39.109884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.111815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.114381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.119232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.120411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.122876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:39.353669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.363888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.382351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:39.383767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6573aa0d-aaa4-45a0-8a06-961ac82be4fd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.306863 Oct 04 18:08:39.384372 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2091/4024] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:39.883102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8034be4f-f96d-4631-b21c-863773f5bca2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92ff70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.911729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:39.912436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:39.982423 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8034be4f-f96d-4631-b21c-863773f5bca2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.103051 Oct 04 18:08:39.983477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:39.986880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:39.987333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1934/4025] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:39.991957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.003185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.006374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.010753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.417998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:40.419341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:40.453790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.460917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.466443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.467252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.467727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.468172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.616765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.658395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.663953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:40.682739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96fa2fb0-bc30-43eb-a2b0-3858a0c4c437 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.270725 Oct 04 18:08:40.688497 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1935/4026] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:40 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:40.713994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-unplugged", "status": "completed", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:40.789944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:40.794025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:40.794520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:40.856223 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Creating event network-vif-unplugged:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:08:40.911379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] Instance d3a8168a-f444-4bd8-b068-118303ac33fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:08:40.973648 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-15fcb948-feb9-43c2-ac09-816c7081b869 req-1a8de89d-0310-465b-9429-99f08d1bfb3b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.277457 Oct 04 18:08:40.977608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1936/4027] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:41.011421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a41a142c-9de7-49b1-9855-534fde0eccf2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92fb80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.159267 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a41a142c-9de7-49b1-9855-534fde0eccf2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.154011 Oct 04 18:08:41.160448 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1937/4028] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:41.731826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:41.732600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:41.773375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.773927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.774504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:41.780387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:41.786536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:41.791035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:42.017215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.072666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.110822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.113464 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df396e87-f88c-4c64-b01d-dc44b9b8c7bd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.395281 Oct 04 18:08:42.134617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1938/4029] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:41 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:42.177713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6922fe1d-0199-4854-ae49-7b9e73478328 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92ff70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:42.183226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:42.194642 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-601bb273-0506-4f9b-a6d1-33721d2e7297 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 2.290095 Oct 04 18:08:42.210837 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2092/4030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:39 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 2307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:42.370234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6922fe1d-0199-4854-ae49-7b9e73478328 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.192587 Oct 04 18:08:42.388906 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1939/4031] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:42 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:43.143924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:43.176781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.178924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.196491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.197922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.199006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.200559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.201632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.202594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.211047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.227094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.228193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.314189 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Creating event network-changed:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:08:43.337414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] Instance d3a8168a-f444-4bd8-b068-118303ac33fb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:08:43.394020 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-62f6ade2-7212-4c17-bad2-210dd00bb6e4 req-1c9d7cc9-5008-46b8-bf91-ae31c72b48d4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265194 Oct 04 18:08:43.394384 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2093/4032] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:43.410250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.423022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:43.445366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.479900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.480698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.481485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.485431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.489285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:43.505030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:43.523076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:43.527049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:43.534837 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be627f75-2719-43ea-aeb7-31f843b0bf2d tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.377809 Oct 04 18:08:43.539695 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1940/4033] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:43.572312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-08611d4d-e612-4468-ac89-94b8cbb5e63f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc978c10>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:43.769961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-08611d4d-e612-4468-ac89-94b8cbb5e63f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.225910 Oct 04 18:08:43.770651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1941/4034] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:44.575283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:44.576330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:44.632939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.642187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.642866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:44.651966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:44.655882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:44.656878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:45.083880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.154714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.176407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.189742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac4a8c94-89bf-428c-985a-d5bc2528f228 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.623585 Oct 04 18:08:45.199469 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1942/4035] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:44 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:45.235532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e9c274d-41ad-4dbd-a0bb-1414ab69c59f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc9e0af0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:45.353562 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e9c274d-41ad-4dbd-a0bb-1414ab69c59f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.147818 Oct 04 18:08:45.354639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1943/4036] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:45 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:45.403316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:45.417642 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c18c18ef-6d57-4a81-89a1-9984d027ce27 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 2.020149 Oct 04 18:08:45.420681 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2094/4037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:43 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:46.223147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.223774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.239663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.250090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.250735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.251904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.252247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.252720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.369972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d41b905-18ad-4bc3-87d0-7eb2f7701918 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd1b51f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.472002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d41b905-18ad-4bc3-87d0-7eb2f7701918 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.105905 Oct 04 18:08:46.472649 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2095/4038] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:08:46.510123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:46.516239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:46.559331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.565011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.572376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:46.577075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:46.586395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:46.587592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:47.069086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.157276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.180423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:47.181718 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a12008c-71c4-4edb-8331-e3998d1e93ee tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.962980 Oct 04 18:08:47.182321 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1944/4039] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:47.496321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b30beb7-c945-4b11-bd5d-5eabe5bf4fd9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc9e0b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:47.683977 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b30beb7-c945-4b11-bd5d-5eabe5bf4fd9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.193437 Oct 04 18:08:47.714233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1945/4040] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:47 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:47.986839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.040637 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08a97505-0ab3-4228-ac42-169c310067a1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 1.555221 Oct 04 18:08:48.070044 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2096/4041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:46 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:48.249739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.256917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:48.322370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.325370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.332270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.335490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:48.357132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:48.360634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:48.719978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d9e593f-e0ef-4fa1-bebf-783ed12ddb12 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd2395e0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:48.809746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.837483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.847097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:48.851111 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-66405905-a35c-4723-acc2-a170e9c04b9e tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.625452 Oct 04 18:08:48.854274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1946/4042] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:48.962442 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d9e593f-e0ef-4fa1-bebf-783ed12ddb12 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.251965 Oct 04 18:08:48.975004 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2097/4043] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:48 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:49.088886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.100031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:49.119124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:49.122978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.132087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.133339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.135077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:49.139837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:49.141125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:49.908934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:49.910854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:50.025609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.039252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.040041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.040976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:50.041499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:50.056703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:50.758867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.806947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.830698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:50.845763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4fc263a-795b-4258-8f46-421db3f5effd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.943032 Oct 04 18:08:50.855080 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2098/4044] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:50.902092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26733940-6dd0-4ea9-a63a-64fa7a54d549 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd023430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.156594 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26733940-6dd0-4ea9-a63a-64fa7a54d549 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.298483 Oct 04 18:08:51.171854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2099/4045] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:50 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:51.913668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:51.914614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:51.938965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.940703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.944146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:51.946333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:51.949929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:51.955488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:52.389857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.417866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.419745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.429188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2d02d03-08e6-4cb8-af95-d9867efc81a5 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.522988 Oct 04 18:08:52.450226 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2100/4046] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:51 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:52.480515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-462e532b-81e7-47f4-8ff8-c206e5eb1f4a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd023160>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:52.565085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:52.641274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1afde970-ec45-4f03-957b-fbad4616db78 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1468 microversion: 2.1 time: 3.554334 Oct 04 18:08:52.643703 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1947/4047] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:49 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1468 bytes in 3564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:52.682513 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-462e532b-81e7-47f4-8ff8-c206e5eb1f4a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.213409 Oct 04 18:08:52.683232 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2101/4048] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:52 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:53.444938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.445892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.463478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.470915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.471745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.473412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.477560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.478310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.486504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.487529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.523544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.524742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.531370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.536739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.538991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.540390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 HTTP/1.1 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e027e87e-91c7-43d2-b904-d227fa91c486'} Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:53.543184 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.550126 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.558548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.559462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:53.565644 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40ccd6d6-d86d-4df1-a2d5-ba81f76a25a7 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 404 len: 111 microversion: 2.1 time: 0.125127 Oct 04 18:08:53.567269 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1948/4049] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:53 2022] DELETE /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:08:53.585060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.589963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: e027e87e-91c7-43d2-b904-d227fa91c486] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.612237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.614592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.617584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.618928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.622808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.623563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.705630 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 HTTP/1.1 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e027e87e-91c7-43d2-b904-d227fa91c486'} Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:08:53.755319 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. Oct 04 18:08:53.759728 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:08:53.762701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance e027e87e-91c7-43d2-b904-d227fa91c486 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:08:53.768427 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b10eebc9-2703-4e5c-a0ba-25c589901287 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486" status: 404 len: 111 microversion: 2.1 time: 0.196535 Oct 04 18:08:53.797478 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1949/4050] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/e027e87e-91c7-43d2-b904-d227fa91c486 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:08:53.828588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.838390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:53.841660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:53.888760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.890547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:53.892587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.894344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.895765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.897811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:53.901135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:53.902006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:53.909635 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-384a3d18-51e2-421b-a9ee-46a44939d8aa tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.441170 Oct 04 18:08:53.910809 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2102/4051] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:53.950264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19076a41-8295-4ab4-b291-441ead08bfc1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd023af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.080931 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19076a41-8295-4ab4-b291-441ead08bfc1 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.156619 Oct 04 18:08:54.083342 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2103/4052] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:54.159077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.159862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.179807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.186969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.191647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.196350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.199665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.202218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.353705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:54.698410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ec9657c-c201-4f69-910e-388f71ba31c0 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 204 len: 0 microversion: 2.1 time: 0.611990 Oct 04 18:08:54.699118 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2104/4053] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:54 2022] DELETE /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:54.717708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:54.722722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:54.756157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.761302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.761798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:54.765554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:54.768129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:54.769549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.218215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.228735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:08:55.237134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4e5bc57-c0b9-42f9-9e5f-8ba65f8d47c5 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1461 microversion: 2.1 time: 1.426465 Oct 04 18:08:55.240915 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1950/4054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:53 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1461 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.264307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.265779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.295198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.298938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.301526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.302806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:55.304830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:55.307602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:55.636891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.691763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.701054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.711324 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-35ad9580-a1c4-4a27-89f9-a279766b8938 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.466821 Oct 04 18:08:55.712056 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1951/4055] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:08:55.742747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bcd997c2-fdf5-41a8-914a-9441b722d639 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1ed2dc0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.958950 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bcd997c2-fdf5-41a8-914a-9441b722d639 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.244575 Oct 04 18:08:55.959733 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1952/4056] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:55.970419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:55.985263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:55.985263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:55.992759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3fc1de2c-4cb6-4375-9e89-5b0ff0495b53 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 1.285661 Oct 04 18:08:55.994128 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2105/4057] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:54 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:56.014675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-plugged", "status": "completed", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:56.042097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.048419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.050213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.055537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.056365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.056921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.057530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.057725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.059999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.121722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] Creating event network-vif-plugged:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:08:56.137893 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3e382db9-9513-4d6e-ba0f-df2edef278c9 req-b696bcd3-1d62-44a9-a617-55f97b79ed81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141939 Oct 04 18:08:56.142482 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2106/4058] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:56.756040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:56.758253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:56.786379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.787889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.788859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:56.790183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:56.799105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:56.803734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.086137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.123278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.142668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:57.154036 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e205560-7862-44e0-93d5-038d17881cdd tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.399632 Oct 04 18:08:57.170546 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2107/4059] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:56 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:57.192824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1531c79d-046f-4e5b-89ed-2ea4466f2667 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd273790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.345634 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1531c79d-046f-4e5b-89ed-2ea4466f2667 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.186006 Oct 04 18:08:57.356617 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2108/4060] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.404865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.406005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.430772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.434542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.435412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.439201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.440037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.440705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.460763 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b77b9afd-09f5-4a3f-8d9b-7366d36921a5 tempest-MigrationsAdminTest-492694866 tempest-MigrationsAdminTest-492694866-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1614 microversion: 2.1 time: 1.488235 Oct 04 18:08:57.481742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1953/4061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:55 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1614 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:57.516196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.516721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.547550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.548376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.549163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.557494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.558044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.558658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.671237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:08:57.903122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-240ea51d-6b3e-49e0-9f38-7de9bccf79ce tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 204 len: 0 microversion: 2.1 time: 0.391118 Oct 04 18:08:57.906977 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1954/4062] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:08:57 2022] DELETE /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:08:57.918127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:57.919112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:57.938447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.939454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.941204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:57.945616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:57.947030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:57.949264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.150580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.165244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7c228ef-9521-48af-a681-eb67710d345b tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1511 microversion: 2.1 time: 0.789109 Oct 04 18:08:58.176203 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2109/4063] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1511 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:58.196084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.201982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:58.221978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.222326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.225221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.227610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:58.229279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:58.231376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:58.441237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.456443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.460652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:58.466158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a62013d0-e5c8-4920-9b1a-7be7bfeb99f3 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.276443 Oct 04 18:08:58.486556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2110/4064] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:08:58.498137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03edf167-4f9b-43a0-8515-1c4ff0866999 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd0504c0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:58.705054 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03edf167-4f9b-43a0-8515-1c4ff0866999 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.216874 Oct 04 18:08:58.720448 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2111/4065] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:08:58 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.003794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82709aba-62fd-4fbe-87c8-b951080fdd93", "name": "network-vif-deleted", "tag": "75b04188-e152-4092-8938-03bc6d1fb1ab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:08:59.075050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.080017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.080799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.139445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] Creating event network-vif-deleted:75b04188-e152-4092-8938-03bc6d1fb1ab for instance 82709aba-62fd-4fbe-87c8-b951080fdd93 on n-h2-831194-21 Oct 04 18:08:59.157116 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4d8a6c1a-c3d5-434b-9aa7-c2a6c2655b85 req-99a75d15-201b-4494-a6f1-60d04dafea10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159616 Oct 04 18:08:59.172085 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2112/4066] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:08:59.228345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.243846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.283412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.293540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.295685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.298141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.309053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.310618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.845808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e80d42b030426285611aaa3a9afcaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15d29c28abc34938be5033a142af8e29', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:08:59.873454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-673b199f-83a3-45f9-aa8d-05792d7374b8 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 200 len: 1301 microversion: 2.1 time: 0.656252 Oct 04 18:08:59.891298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2113/4067] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 1301 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:08:59.903580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:08:59.904210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:08:59.932494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.933007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.933461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.934216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:08:59.934683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:08:59.935121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:08:59.954068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:00.161676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.195251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.229594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.242324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3506abd2-9e33-4dfd-b155-346d823d337c tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.349741 Oct 04 18:09:00.249185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2114/4068] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:08:59 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:00.258965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf9716d9-f976-4314-ab21-42c72d8e88b7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd2acca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.401019 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf9716d9-f976-4314-ab21-42c72d8e88b7 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.150317 Oct 04 18:09:00.401672 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2115/4069] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.601195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:00.615241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98a7ed01-d028-48e8-b1c8-bd8a0acb53d1 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1467 microversion: 2.1 time: 2.704442 Oct 04 18:09:00.617578 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1955/4070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:08:57 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1467 bytes in 2710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:00.907216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:00.907774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] [instance: 82709aba-62fd-4fbe-87c8-b951080fdd93] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:00.921246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.921246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.921246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.921986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:00.922457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:00.922894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:00.954644 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] HTTP exception thrown: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Request method failure captured: Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 HTTP/1.1 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHWq1Nkk9OUI3ZUevzWIdsVTa1vBpdnlgAtA87DbwhiNXC1PbhN3A-mdpqMt-1xgldRAvyD7iVE1MWoci0FvfaddmEqA41mSX69D--u5OMeTF-EIEE_Ty5ZvU0ueZoUqmrGxHi14Z4Cx-7Z9-SGdbjNwrtcpNxP-ViJ3n64a2sP_yz0 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/15d29c28abc34938be5033a142af8e29"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/15d29c28abc34938be5033a142af8e29"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_15d29c28abc34938be5033a142af8e29"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 15d29c28abc34938be5033a142af8e29 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-487942230 Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 61e80d42b030426285611aaa3a9afcaf Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-487942230-project Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '82709aba-62fd-4fbe-87c8-b951080fdd93'} Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:00.957122 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. Oct 04 18:09:00.963340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:00.966984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] Returning 404 to user: Instance 82709aba-62fd-4fbe-87c8-b951080fdd93 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:00.968234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5568cbc-c4a3-47f8-88cf-fbc973ea0134 tempest-ServersNegativeTestJSON-487942230 tempest-ServersNegativeTestJSON-487942230-project] 10.222.0.42 "GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93" status: 404 len: 111 microversion: 2.1 time: 0.065762 Oct 04 18:09:00.969399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2116/4071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:00 2022] GET /compute/v2.1/servers/82709aba-62fd-4fbe-87c8-b951080fdd93 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:01.306622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.316883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.338098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.339032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.339821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.350897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.353358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.355773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.422617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4a6c73bc-10e5-43da-ac1b-e2b93e6df5c4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1e780d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.591971 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4a6c73bc-10e5-43da-ac1b-e2b93e6df5c4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.176397 Oct 04 18:09:01.599604 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2117/4072] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:01.644050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:01.644955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:01.681777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.688067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.689699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.691010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:01.697595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:01.698561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:01.796845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.856147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.862069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:01.872142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4d052ba-5dba-4ed9-8bb3-3ad4930a7b02 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.573796 Oct 04 18:09:01.877064 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1956/4073] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:02.006006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:02.020420 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a86f4f32-27a4-4e32-bb69-71537d8f7251 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1425 microversion: 2.1 time: 0.378775 Oct 04 18:09:02.023202 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2118/4074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:01 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1425 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.148839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3a8168a-f444-4bd8-b068-118303ac33fb", "name": "network-vif-deleted", "tag": "d02b05e0-f5f0-4fd5-93e6-b0565929cbea"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:02.268085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.271652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.273187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.344549 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] Creating event network-vif-deleted:d02b05e0-f5f0-4fd5-93e6-b0565929cbea for instance d3a8168a-f444-4bd8-b068-118303ac33fb on n-h2-831194-21 Oct 04 18:09:02.375432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1bc6c976-2746-4b3e-8185-8a97448dc5d9 req-d15b5edd-ceba-4c17-b9df-4b5be0e45ae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242791 Oct 04 18:09:02.380820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1957/4075] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:02.619043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb3c40b1-f9d4-40e2-8280-a5fc4ae0d59e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd0508b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.796202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb3c40b1-f9d4-40e2-8280-a5fc4ae0d59e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.184057 Oct 04 18:09:02.796880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2119/4076] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:02.907842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:02.910059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:02.920447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.921225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.921896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:02.922825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:02.923462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:02.924726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.064628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.065650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:03.086792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.087601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.088409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.090907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.098864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.100914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.203380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.226554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:03.228445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:03.228915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.230662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:03.231757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lazy-loading 'fault' on Instance uuid d3a8168a-f444-4bd8-b068-118303ac33fb {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:03.233791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.242748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da27bf5d-2dd5-4863-ba00-1fcd1cf8a885 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.338199 Oct 04 18:09:03.271570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1958/4077] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:02 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:03.564230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:03.576664 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f52ad479-43da-4a84-9e54-d44cf24d3844 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 200 len: 1302 microversion: 2.1 time: 0.516841 Oct 04 18:09:03.581131 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2120/4078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 1302 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:03.814352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea0e2729-2636-4de7-9590-f6b27cbbad6d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc9e0e50>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:03.929542 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea0e2729-2636-4de7-9590-f6b27cbbad6d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1453 microversion: 2.1 time: 0.116714 Oct 04 18:09:03.942089 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1959/4079] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:03 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:04.278088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.279377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.293724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.294613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.298545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.299593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.300280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.300952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.620581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.621218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: d3a8168a-f444-4bd8-b068-118303ac33fb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.683169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.691607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.698858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.705668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.709489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.710167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.745755 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] HTTP exception thrown: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Request method failure captured: Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb HTTP/1.1 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHVq7gI9NyobXNnFpCiKtrNVwjJhm889GS0_b2GY6N--rywe2tSrJ3aSKcd2Pup-i4sjH7FkioEAj6QseRjHEfw9o0yQsBlRSc7cg9_r7GucncOSGXqsLN903Ltu6EVcumh3SxCxrajrbBcTJ2uU_pUaDDtrn-8HRnfp46icIm4koIM Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e701576afd70420c8f2e7a970fb33920 Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd3a8168a-f444-4bd8-b068-118303ac33fb'} Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:04.759889 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. Oct 04 18:09:04.765714 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:04.768148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Returning 404 to user: Instance d3a8168a-f444-4bd8-b068-118303ac33fb could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:04.778781 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83712001-0233-43e5-a4b4-4d9703fd139b tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb" status: 404 len: 111 microversion: 2.1 time: 0.154866 Oct 04 18:09:04.779887 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1960/4080] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/d3a8168a-f444-4bd8-b068-118303ac33fb => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:04.796462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:04.797484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:04.816644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.820258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.820880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.830188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:04.831584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:04.832939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:04.962949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:05.238016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-203eb973-fc69-42b2-8dfb-54912cddcf1c tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "DELETE /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 204 len: 0 microversion: 2.1 time: 0.449153 Oct 04 18:09:05.244052 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1961/4081] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:04 2022] DELETE /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:05.257188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ceb04db8-b483-4b1c-be10-0ec15fe3222d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc9e00d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.373696 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ceb04db8-b483-4b1c-be10-0ec15fe3222d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1462 microversion: 2.1 time: 0.127969 Oct 04 18:09:05.375634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1962/4082] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1462 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:05.393448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.394723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:05.415004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.415848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.416839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.419047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:05.419881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:05.420884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:05.760635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.779364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.783808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:05.793309 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d1bf520-8e33-46f4-9dae-5c56c03b112f tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 1.519863 Oct 04 18:09:05.794391 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2121/4083] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:04 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:05.805683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b62c623-afe1-40a1-9cba-529637cc6b79 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1e78c10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.920127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b62c623-afe1-40a1-9cba-529637cc6b79 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 200 len: 1462 microversion: 2.1 time: 0.123989 Oct 04 18:09:05.925711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2122/4084] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 1462 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:05.975479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:05.988138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.015209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.016577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.021122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.023088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.029436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.030288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.233656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:06.267987 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0fe0469-f7c2-4ba4-a0ff-abb7ba2e1dc8 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1533 microversion: 2.1 time: 0.887955 Oct 04 18:09:06.277871 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1963/4085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1533 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:06.828768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:06.829396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:06.839575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.840068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.842509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:06.843367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:06.843737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:06.844193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.099403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.127336 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68b837e2-70c7-4a7d-b83d-344b93067ac2 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1480 microversion: 2.1 time: 1.168388 Oct 04 18:09:07.134749 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2123/4086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:05 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1480 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:07.250123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.266680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.269321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.275223 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6439cc85-70e9-4da2-a127-7bcfbe2ef3ef tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.449997 Oct 04 18:09:07.276758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1964/4087] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:06 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:07.313048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:07.313786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:07.326998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.331518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.332063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.333405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:07.334103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:07.334967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:07.818174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:07.841592 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca2c000a-5bcc-4fac-a01c-43743bafbff2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1533 microversion: 2.1 time: 0.532978 Oct 04 18:09:07.842230 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2124/4088] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:07 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1533 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:08.158847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:08.159632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.176620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.177334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.186761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.187560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.188156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.188735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.309218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:08.310486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:08.339341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.340107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.340710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.349513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.353036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.358850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:08.746897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:08.773550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:08.782901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:08.784273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65f256ac-a17b-4fd8-b5c8-0f998e34da23 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1604 microversion: 2.42 time: 0.481856 Oct 04 18:09:08.809235 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2125/4089] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:08 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1604 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:08.842151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97c18298-ed37-4ee9-a242-cd7d4f326deb", "name": "network-vif-deleted", "tag": "c9520fc7-9033-4cab-9c7f-5a3528015c49"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:08.920438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:08.921037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:08.921468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.018848 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] Creating event network-vif-deleted:c9520fc7-9033-4cab-9c7f-5a3528015c49 for instance 97c18298-ed37-4ee9-a242-cd7d4f326deb on n-h1-831194-21 Oct 04 18:09:09.026828 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d525269b-3864-4173-8854-2b57d7b7ac09 req-f90ae8fc-e40d-4be1-8298-375217fc3530 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200392 Oct 04 18:09:09.028010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2126/4090] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:09.093084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.094299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.127534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.128032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.128472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.132577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.133666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.134501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.217100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:09.240968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b32283d9-e50d-4da1-9d99-fd2aaea5b1a6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1467 microversion: 2.1 time: 1.086339 Oct 04 18:09:09.249540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:09.250585 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1965/4091] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:08 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1467 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:09.270371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.271676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.272279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.272894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lazy-loading 'fault' on Instance uuid 97c18298-ed37-4ee9-a242-cd7d4f326deb {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:09.305083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18ce08ac-74f3-4bd4-aa82-6cdc9433483c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92f8b0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.527506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:09.540402 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42f80dcd-7b08-4459-b9e4-1e9d0e455f20 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 200 len: 1367 microversion: 2.1 time: 0.508624 Oct 04 18:09:09.546224 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2127/4092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:09.612674 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18ce08ac-74f3-4bd4-aa82-6cdc9433483c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?changes-since=2022-10-04T18%3A06%3A28Z" status: 200 len: 1901 microversion: 2.1 time: 0.318940 Oct 04 18:09:09.613966 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1966/4093] 10.222.0.42 () {58 vars in 1199 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/images?changes-since=2022-10-04T18%3A06%3A28Z => generated 1901 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:09.631468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca8664ff-4090-4537-8d24-eed6bb196c20 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd1b5ca0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.746454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca8664ff-4090-4537-8d24-eed6bb196c20 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-328277204" status: 200 len: 484 microversion: 2.1 time: 0.121361 Oct 04 18:09:09.747030 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2128/4094] 10.222.0.42 () {58 vars in 1229 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-328277204 => generated 484 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:09.761594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4abc5624-c523-4124-90ad-14a1e86c7354 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1e0f040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.826964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:09.828315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:09.841498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.844004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.846290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.849328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.850118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.850860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.957559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:09.962610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:09.963499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:09.967232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lazy-loading 'fault' on Instance uuid 0a304726-e396-4ecc-818c-6725af5143e7 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:09.996946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4abc5624-c523-4124-90ad-14a1e86c7354 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?server=5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 956 microversion: 2.1 time: 0.239223 Oct 04 18:09:09.997581 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1967/4095] 10.222.0.42 () {58 vars in 1209 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/images?server=5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 956 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.013671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b3d4707-72a4-4474-a7fe-3c098d5defd4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd16cca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.114828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.130980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.139633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6c75c3c7449f4d95a28773bf57343f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9df5d1f7410c469d900ada1ba30419df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:10.146363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d556f6c1-3f5c-4bd5-ab1e-c033891a7c05 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 200 len: 1609 microversion: 2.42 time: 0.322397 Oct 04 18:09:10.147585 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2129/4096] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:09 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 1609 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:10.164315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-unplugged", "status": "completed", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:10.180962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.183270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b3d4707-72a4-4474-a7fe-3c098d5defd4 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 484 microversion: 2.1 time: 0.174119 Oct 04 18:09:10.184218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.185347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.198667 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1968/4097] 10.222.0.42 () {58 vars in 1317 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a => generated 484 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.219662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] Creating event network-vif-unplugged:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:09:10.231248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90ecb891-444b-4c99-96c9-e735590b99f9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd0f9670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.235735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f78f9569-89e3-4b1d-8eb7-9795c19bb3a1 req-26386906-dc71-4aee-9129-a1a2850f34ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086520 Oct 04 18:09:10.236609 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2130/4098] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.314739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90ecb891-444b-4c99-96c9-e735590b99f9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 484 microversion: 2.1 time: 0.108312 Oct 04 18:09:10.326886 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1969/4099] 10.222.0.42 () {58 vars in 1303 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a => generated 484 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:10.333687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-41218160-76fe-4e4f-a4ec-041cbecd670e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc7d5670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.515026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-41218160-76fe-4e4f-a4ec-041cbecd670e tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.186391 Oct 04 18:09:10.519248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2131/4100] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.534491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-07455dbe-f573-4815-b64e-92b6286b5f16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90f550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.569169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.570293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 97c18298-ed37-4ee9-a242-cd7d4f326deb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:10.606436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.607261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.608029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.609262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:10.610010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:10.610870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:10.661892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] HTTP exception thrown: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Request method failure captured: Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb HTTP/1.1 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVq7gI9NyobXNnFpCiKtrNVwjJhm889GS0_b2GY6N--rywe2tSrJ3aSKcd2Pup-i4sjH7FkioEAj6QseRjHEfw9o0yQsBlRSc7cg9_r7GucncOSGXqsLN903Ltu6EVcumh3SxCxrajrbBcTJ2uU_pUaDDtrn-8HRnfp46icIm4koIM Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e701576afd70420c8f2e7a970fb33920 Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '97c18298-ed37-4ee9-a242-cd7d4f326deb'} Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:10.664396 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. Oct 04 18:09:10.668955 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:10.670272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Returning 404 to user: Instance 97c18298-ed37-4ee9-a242-cd7d4f326deb could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:10.675033 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a4aa50e-cf3c-497b-83ff-63466d2e53a4 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb" status: 404 len: 111 microversion: 2.1 time: 0.112034 Oct 04 18:09:10.679646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2132/4101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/servers/97c18298-ed37-4ee9-a242-cd7d4f326deb => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:10.684797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27cb9d09-2da4-4914-b0b4-d8c086bdf231 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '.version_select at 0x7fbdbc7c7790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.685224 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-07455dbe-f573-4815-b64e-92b6286b5f16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.149388 Oct 04 18:09:10.686171 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1970/4102] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:10.702686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ee2b653-86d1-46b0-abe7-8a63307a1dce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd16c790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.703167 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [None req-27cb9d09-2da4-4914-b0b4-d8c086bdf231 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [c81e575a-72f6-4afe-a58d-12c39df547b8] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:09:10.767610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ee2b653-86d1-46b0-abe7-8a63307a1dce tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.068714 Oct 04 18:09:10.773841 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1971/4103] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:10.789266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15fdd8b2-b5e7-4d24-a80b-5413adcef603 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1ed28b0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:10.962557 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15fdd8b2-b5e7-4d24-a80b-5413adcef603 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A06%3A24Z" status: 200 len: 6332 microversion: 2.1 time: 0.177241 Oct 04 18:09:10.963879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1972/4104] 10.222.0.42 () {58 vars in 1220 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-04T18%3A06%3A24Z => generated 6332 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:10.990452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef989c61-305c-4840-807b-285d586dfb4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd16c3a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.055588 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef989c61-305c-4840-807b-285d586dfb4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-328277204" status: 200 len: 664 microversion: 2.1 time: 0.069100 Oct 04 18:09:11.056447 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1973/4105] 10.222.0.42 () {58 vars in 1250 bytes} [Tue Oct 4 18:09:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-328277204 => generated 664 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:11.086857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91401492-9c61-4891-9706-d4c81cc5f732 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90f550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.246443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91401492-9c61-4891-9706-d4c81cc5f732 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1466 microversion: 2.1 time: 0.163722 Oct 04 18:09:11.247307 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1974/4106] 10.222.0.42 () {58 vars in 1338 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fv2.1%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a => generated 1466 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:11.262001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.262638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:11.281415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.281943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.282391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.283111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:11.283567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:11.283992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:11.315201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] HTTP exception thrown: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Request method failure captured: Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 HTTP/1.1 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTZvARTIaV3ecPHVF1f4fwOnMvcJaSRwypZMv-KQyxJrOZ_vEmW4Bc-bjUhYiR5lx28N266d5mLnYGu-3wSRxFENGI_JCq1a-CTJ7dLKqL2L9k0deRQN3Jr3pDHchvtHCBsU2RKY9i1MlFbOhrUw5QsQPMjs0BJk7gHGisfzQ9tV14 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6c75c3c7449f4d95a28773bf57343f2d Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0a304726-e396-4ecc-818c-6725af5143e7'} Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:11.324262 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:11.327939 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:11.330073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Returning 404 to user: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:11.334061 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18783dd8-89eb-4ed1-bfde-009ef67cf24a tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 404 len: 111 microversion: 2.42 time: 0.085551 Oct 04 18:09:11.340044 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1975/4107] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:11.350226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e786dea6-d70f-46b7-9d21-10bb41b6f922 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90f550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.435956 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e786dea6-d70f-46b7-9d21-10bb41b6f922 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1466 microversion: 2.1 time: 0.094510 Oct 04 18:09:11.441097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1976/4108] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.42%2Fcompute%2Fservers%2Fdaf515d2-c200-4b22-a08c-19590990b35a => generated 1466 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.457119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d628e77e-55cc-4311-bf18-cd253235dd32 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '.version_select at 0x7fbdc1ed2790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.515887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d628e77e-55cc-4311-bf18-cd253235dd32 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-738137624" status: 204 len: 0 microversion: 2.42 time: 0.072271 Oct 04 18:09:11.516894 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1977/4109] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 18:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-738137624 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:09:11.540490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c99dba16-cfbd-40cf-b7a1-aae47b261030 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc90f430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:11.714175 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [None req-27cb9d09-2da4-4914-b0b4-d8c086bdf231 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [c81e575a-72f6-4afe-a58d-12c39df547b8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 54964. Oct 04 18:09:11.758022 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27cb9d09-2da4-4914-b0b4-d8c086bdf231 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682318482" status: 202 len: 0 microversion: 2.1 time: 1.076641 Oct 04 18:09:11.760263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2133/4110] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682318482 => generated 0 bytes in 1080 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:09:11.807165 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c99dba16-cfbd-40cf-b7a1-aae47b261030 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.288574 Oct 04 18:09:11.812170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1978/4111] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:11.858282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7f351f10-833a-4324-8ae5-2880e04d710c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1e5e820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.068602 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7f351f10-833a-4324-8ae5-2880e04d710c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.215945 Oct 04 18:09:12.069401 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2134/4112] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 18:09:11 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.103690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50bdcc08-c330-4254-83f9-b7f2d44da9d5 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc92f550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.301548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50bdcc08-c330-4254-83f9-b7f2d44da9d5 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1" status: 200 len: 784 microversion: 2.1 time: 0.208263 Oct 04 18:09:12.310854 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1979/4113] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/images/e1023401-e1c5-4082-870f-0d68a62149b1 => generated 784 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:12.326279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4e467e6-6b36-41b7-a588-a417b21f50d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd7a2af0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:12.580250 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4e467e6-6b36-41b7-a588-a417b21f50d3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.260486 Oct 04 18:09:12.580768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2135/4114] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 18:09:12 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:12.613175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0bc7b091-f5a6-4914-a142-0f9f89a7856d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd0f9160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:13.859274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0bc7b091-f5a6-4914-a142-0f9f89a7856d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128" status: 204 len: 0 microversion: 2.1 time: 1.255207 Oct 04 18:09:13.859274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1980/4115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:12 2022] DELETE /compute/v2.1/images/6890b096-30a9-4213-8c2f-d59181f68128 => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:13.868255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a368d99-ea4f-4200-b352-08fa21638378 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1e5edc0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:14.764487 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a368d99-ea4f-4200-b352-08fa21638378 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd" status: 204 len: 0 microversion: 2.1 time: 0.901755 Oct 04 18:09:14.768806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2136/4116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:13 2022] DELETE /compute/v2.1/images/c4d51194-179a-42ca-abfa-d2edc8a75afd => generated 0 bytes in 904 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:14.778994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2d9e713-b875-4189-92c2-355774cf4e8b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbc99caf0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.383722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.384618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.417244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.420031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.420807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.423959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.424927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.425611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.534974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:15.704668 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f72c1d6-d601-480a-9801-8354c4db47be tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 204 len: 0 microversion: 2.1 time: 0.328830 Oct 04 18:09:15.719195 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2137/4117] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:15 2022] DELETE /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:15.735243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.736271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.747981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.749351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.750360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.752532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.753612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.754508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.854421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2d9e713-b875-4189-92c2-355774cf4e8b tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d" status: 204 len: 0 microversion: 2.1 time: 1.082992 Oct 04 18:09:15.856005 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1981/4118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:14 2022] DELETE /compute/v2.1/images/05f1b2f5-beda-406e-8762-c3ebbd7aa30d => generated 0 bytes in 1086 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:09:15.870882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:15.871411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:15.891215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.892555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.896917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.898566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:15.901116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:15.902005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:15.966213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:16.081343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:16.153029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8429c9fd-065f-4935-a682-51a6277cb4c3 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 204 len: 0 microversion: 2.1 time: 0.291848 Oct 04 18:09:16.154282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1982/4119] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:15 2022] DELETE /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:16.167921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:16.168928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:16.179306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.179868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.181241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.182951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:16.183483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:16.184207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:16.257279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.267552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af3967cd-64f7-4333-898b-1477bd4e965a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1468 microversion: 2.1 time: 0.542135 Oct 04 18:09:16.268658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2138/4120] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:15 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1468 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:16.779784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:16.791248 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02741938-093c-408d-8bfd-330bea141a4f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1474 microversion: 2.1 time: 0.631872 Oct 04 18:09:16.792188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1983/4121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:16 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1474 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.293974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.295348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.306212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.311849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.312489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.313415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.314349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.314799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.740697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:17.770618 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b8d50fd-bfd4-4165-8e8d-d96cc632a21d tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1468 microversion: 2.1 time: 0.468019 Oct 04 18:09:17.779208 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2139/4122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1468 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:17.831050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:17.831689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:17.859149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.859661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.860280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:17.860833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:17.861289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:17.875159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.698620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:18.715603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bc3bb2d3-ff54-45fe-adad-256775768bca tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1474 microversion: 2.1 time: 0.888466 Oct 04 18:09:18.716496 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1984/4123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:17 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1474 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:18.792403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:18.793346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:18.820551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.821891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.822784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:18.823685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:18.824276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:18.824948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.260181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:19.268574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:19.282833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-38f97d08-4a54-4d85-973e-3f3282e5bbf2 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1468 microversion: 2.1 time: 0.500697 Oct 04 18:09:19.283492 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2140/4124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:18 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1468 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:19.744544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:19.745178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:19.748092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:19.767013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.767792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.768467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:19.769345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:19.769994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:19.771420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.032180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8ca415-2151-4ac4-a246-9fe38706fce2", "name": "network-vif-deleted", "tag": "cfd5e7ae-0dce-4f3b-857e-757cac25b3e1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:20.050157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.054439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.054913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.100155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] Creating event network-vif-deleted:cfd5e7ae-0dce-4f3b-857e-757cac25b3e1 for instance fb8ca415-2151-4ac4-a246-9fe38706fce2 on n-h2-831194-21 Oct 04 18:09:20.114727 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ca5cd03c-83ac-415c-b39f-5b4d987e2f99 req-3d562376-7591-47f7-932c-433a225b0694 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085294 Oct 04 18:09:20.115748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2141/4125] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:20.309728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:20.310577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:20.328113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.330692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.332237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.337330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.337956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.340743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.417091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:20.419495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:20.422384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:20.423206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lazy-loading 'fault' on Instance uuid fb8ca415-2151-4ac4-a246-9fe38706fce2 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:20.564480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:20.583018 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d97cef5-a246-4495-a157-85512cbc7b71 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 200 len: 1302 microversion: 2.1 time: 0.277735 Oct 04 18:09:20.583945 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2142/4126] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:20 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 1302 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:21.120796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:21.142497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7960b5d-dc9d-40d8-b2de-0c769c1d6e74 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1474 microversion: 2.1 time: 1.401451 Oct 04 18:09:21.151553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1985/4127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:19 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1474 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:21.609134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.610591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: fb8ca415-2151-4ac4-a246-9fe38706fce2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.627905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.628495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.628962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.630330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.630808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.633908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.667044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] HTTP exception thrown: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Request method failure captured: Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 HTTP/1.1 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVq7gI9NyobXNnFpCiKtrNVwjJhm889GS0_b2GY6N--rywe2tSrJ3aSKcd2Pup-i4sjH7FkioEAj6QseRjHEfw9o0yQsBlRSc7cg9_r7GucncOSGXqsLN903Ltu6EVcumh3SxCxrajrbBcTJ2uU_pUaDDtrn-8HRnfp46icIm4koIM Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e701576afd70420c8f2e7a970fb33920 Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'fb8ca415-2151-4ac4-a246-9fe38706fce2'} Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:21.668918 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:21.674592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Returning 404 to user: Instance fb8ca415-2151-4ac4-a246-9fe38706fce2 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:21.679120 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc4f89e5-0315-4d6e-b100-a9b5b8f9de0a tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2" status: 404 len: 111 microversion: 2.1 time: 0.065249 Oct 04 18:09:21.679797 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2143/4128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/fb8ca415-2151-4ac4-a246-9fe38706fce2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:09:21.688049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.688807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.699933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.700438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.700882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.701594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.702814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.703403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.737041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:21.888088 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf3f3ecc-d0eb-4471-9ab7-b9617dba115f tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "DELETE /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 204 len: 0 microversion: 2.1 time: 0.203667 Oct 04 18:09:21.892955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1986/4129] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:21 2022] DELETE /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:21.899713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:21.900610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:21.911533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.915853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.916516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:21.917429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:21.918666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:21.919285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.124312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf515d2-c200-4b22-a08c-19590990b35a", "name": "network-vif-deleted", "tag": "a49b44e1-f245-4953-b88f-ad51c81241d6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:22.174467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.174967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.175437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.238468 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] Creating event network-vif-deleted:a49b44e1-f245-4953-b88f-ad51c81241d6 for instance daf515d2-c200-4b22-a08c-19590990b35a on n-h2-831194-21 Oct 04 18:09:22.268533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ad3ed082-ca6e-4b52-a831-fbc3f72bdd73 req-dbd7e9f5-3636-472b-93e7-bc57c4fa5594 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141108 Oct 04 18:09:22.271229 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1987/4130] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:09:22.289446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:22.300732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:22.335356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.336048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.336437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.337233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:22.337780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:22.354817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:22.786202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:22.804633 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-10665e4e-cae5-4185-95eb-d2f0c911dad9 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 200 len: 1303 microversion: 2.1 time: 0.531661 Oct 04 18:09:22.810092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1988/4131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:22 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 1303 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:23.016366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:23.049065 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f7864f0-623b-47fb-827e-5cbbbfcd2600 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1467 microversion: 2.1 time: 1.154291 Oct 04 18:09:23.055371 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2144/4132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:21 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1467 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:23.840720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.841540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: daf515d2-c200-4b22-a08c-19590990b35a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.854278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.861670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.865549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.867925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.869436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.871498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.920950 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] HTTP exception thrown: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Request method failure captured: Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a HTTP/1.1 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHYf996H-0Z1jTVnxNiwKDwANCUkTakd08VXm7Ch3qBtp0HYyucgthL5Bkk_FGfsGRSkP9_f31Gcpy-YNk8ykfv-OZDkY46EYv2RKyj2aZKuBF310XHGA7fJVxxFKicVwTemsV__JJSlPVlVcuB2Z4e2xuo5ZJ-Z8ZnUMYrsdAWoDGk Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4c016f78a35d468289072287c86aa591 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c016f78a35d468289072287c86aa591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c016f78a35d468289072287c86aa591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c016f78a35d468289072287c86aa591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c016f78a35d468289072287c86aa591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4c016f78a35d468289072287c86aa591 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListImageFiltersTestJSON-1459186756-project Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: aa6904ce795943c98f374398064d0328 Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListImageFiltersTestJSON-1459186756-project Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'daf515d2-c200-4b22-a08c-19590990b35a'} Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:23.922896 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. Oct 04 18:09:23.927705 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:23.929533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Returning 404 to user: Instance daf515d2-c200-4b22-a08c-19590990b35a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:23.930649 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c4543e2-9cba-4f5c-8422-17cf0560590d tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a" status: 404 len: 111 microversion: 2.1 time: 0.095041 Oct 04 18:09:23.931781 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1989/4133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:23 2022] GET /compute/v2.1/servers/daf515d2-c200-4b22-a08c-19590990b35a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:23.939902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:23.940471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:23.965490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.966264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.966828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:23.967762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:23.971269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:23.972473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.057520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:09:24.124688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.125320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.138457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.138959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.139409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.143657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.143657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.143852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.342660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1da921de-f6eb-467d-9013-8f303f0ee52c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 204 len: 0 microversion: 2.1 time: 0.406573 Oct 04 18:09:24.343296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2145/4134] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:09:23 2022] DELETE /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:24.353783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:24.360516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:24.372664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.373181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.373635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.379436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:24.380144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:24.380613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:24.613985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:24.636705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f96e4332-9cda-4826-98f3-cc0345f29158 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1467 microversion: 2.1 time: 0.516059 Oct 04 18:09:24.650887 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1990/4135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1467 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:25.031890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.052548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55618057-a288-46c7-94e9-7ec69422ca0f tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1473 microversion: 2.1 time: 0.700672 Oct 04 18:09:25.054708 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2146/4136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:24 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1473 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:25.378251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c6a8a1-361e-479d-a571-8be0b4ca8b39", "name": "network-vif-deleted", "tag": "2c474687-9727-4065-82be-e6d305876062"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:25.399178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.400116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.400710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.434177 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] Creating event network-vif-deleted:2c474687-9727-4065-82be-e6d305876062 for instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 on n-h1-831194-21 Oct 04 18:09:25.447596 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a83d0278-7a4b-4317-8154-ccc94599dd74 req-e977d33b-4fc9-463a-ad70-e70f5b00a3a3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072273 Oct 04 18:09:25.448405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1991/4137] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:25.677449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.678112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.688491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.688995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.689433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.698975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:25.699740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:25.700356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:25.956974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e701576afd70420c8f2e7a970fb33920', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffcaedcfb5954419a573f58488eca4e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:25.968019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:25.976806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:25.996133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17762bb9-025d-44c9-a6a5-361a399b6318 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 200 len: 1425 microversion: 2.1 time: 0.319852 Oct 04 18:09:25.999767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2147/4138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:25 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 1425 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:26.005123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.005881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.006337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.007136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.007665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.008303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.045334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] HTTP exception thrown: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Request method failure captured: Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 HTTP/1.1 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHTZvARTIaV3ecPHVF1f4fwOnMvcJaSRwypZMv-KQyxJrOZ_vEmW4Bc-bjUhYiR5lx28N266d5mLnYGu-3wSRxFENGI_JCq1a-CTJ7dLKqL2L9k0deRQN3Jr3pDHchvtHCBsU2RKY9i1MlFbOhrUw5QsQPMjs0BJk7gHGisfzQ9tV14 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6c75c3c7449f4d95a28773bf57343f2d Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '0a304726-e396-4ecc-818c-6725af5143e7'} Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:26.048639 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Returning 404 to user: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:26.053685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-411450c4-aaf6-49b4-82ee-17a772285c13 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 404 len: 111 microversion: 2.42 time: 0.090853 Oct 04 18:09:26.060173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.060798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] [instance: 0a304726-e396-4ecc-818c-6725af5143e7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.064553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1992/4139] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:09:25 2022] DELETE /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:26.077138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:26.079095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.083595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.084637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:26.085258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.086198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.090315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.091431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.099468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.101880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.107957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.109282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:26.109969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:26.110596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:26.117378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] HTTP exception thrown: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Request method failure captured: Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 HTTP/1.1 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHTZvARTIaV3ecPHVF1f4fwOnMvcJaSRwypZMv-KQyxJrOZ_vEmW4Bc-bjUhYiR5lx28N266d5mLnYGu-3wSRxFENGI_JCq1a-CTJ7dLKqL2L9k0deRQN3Jr3pDHchvtHCBsU2RKY9i1MlFbOhrUw5QsQPMjs0BJk7gHGisfzQ9tV14 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.42 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9df5d1f7410c469d900ada1ba30419df"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 9df5d1f7410c469d900ada1ba30419df Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1801901660 Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6c75c3c7449f4d95a28773bf57343f2d Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1801901660-project Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0a304726-e396-4ecc-818c-6725af5143e7'} Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.122315 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. Oct 04 18:09:26.127064 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:26.128663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] Returning 404 to user: Instance 0a304726-e396-4ecc-818c-6725af5143e7 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:26.130578 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c7e43f7-f8c4-41c9-aeee-f9304418b924 tempest-TaggedBootDevicesTest_v242-1801901660 tempest-TaggedBootDevicesTest_v242-1801901660-project] 10.222.0.42 "GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7" status: 404 len: 111 microversion: 2.42 time: 0.074786 Oct 04 18:09:26.145984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2148/4140] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/0a304726-e396-4ecc-818c-6725af5143e7 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:09:26.835462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:26.844560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfb44593-4a7f-4cac-8758-e2860b2ed4c8 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1473 microversion: 2.1 time: 0.771203 Oct 04 18:09:26.868273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1993/4141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:26 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1473 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:27.041614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.043193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] [instance: 25c6a8a1-361e-479d-a571-8be0b4ca8b39] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.051318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.052168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.052822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.053751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.054447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.055087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.088478 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] HTTP exception thrown: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Request method failure captured: Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 HTTP/1.1 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHVq7gI9NyobXNnFpCiKtrNVwjJhm889GS0_b2GY6N--rywe2tSrJ3aSKcd2Pup-i4sjH7FkioEAj6QseRjHEfw9o0yQsBlRSc7cg9_r7GucncOSGXqsLN903Ltu6EVcumh3SxCxrajrbBcTJ2uU_pUaDDtrn-8HRnfp46icIm4koIM Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_ffcaedcfb5954419a573f58488eca4e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: ffcaedcfb5954419a573f58488eca4e2 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-MigrationsAdminTest-798983155 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e701576afd70420c8f2e7a970fb33920 Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-MigrationsAdminTest-798983155-project Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '25c6a8a1-361e-479d-a571-8be0b4ca8b39'} Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:27.090333 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. Oct 04 18:09:27.094003 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:09:27.095780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] Returning 404 to user: Instance 25c6a8a1-361e-479d-a571-8be0b4ca8b39 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:27.096864 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4975f1df-77f6-450f-b9c9-48db141a5539 tempest-MigrationsAdminTest-798983155 tempest-MigrationsAdminTest-798983155-project] 10.222.0.42 "GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39" status: 404 len: 111 microversion: 2.1 time: 0.072836 Oct 04 18:09:27.100519 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2149/4142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:27 2022] GET /compute/v2.1/servers/25c6a8a1-361e-479d-a571-8be0b4ca8b39 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:27.875693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:27.877243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:27.896474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.897257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.898313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:27.899338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:27.900142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:27.900828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.579191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6904ce795943c98f374398064d0328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c016f78a35d468289072287c86aa591', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:28.593584 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6224fb68-590d-4b2b-b763-922892c1d268 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 200 len: 1431 microversion: 2.1 time: 0.721810 Oct 04 18:09:28.594755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1994/4143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:27 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 1431 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:09:28.822274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bc822f9-9d28-49dc-8b3b-8fcae990b22a", "name": "network-vif-deleted", "tag": "0dcd791b-87d2-48d5-925c-999e57956359"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:28.874143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:28.874902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:28.875607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:28.908737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] Creating event network-vif-deleted:0dcd791b-87d2-48d5-925c-999e57956359 for instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a on n-h1-831194-21 Oct 04 18:09:28.949675 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-72d8f4ca-7c2e-4179-8f5f-abd860f22a88 req-f7c951b1-00b3-4f53-9f8e-ea5e14f1c9fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138770 Oct 04 18:09:28.958931 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2150/4144] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:09:29.621747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:29.622550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] [instance: 5bc822f9-9d28-49dc-8b3b-8fcae990b22a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:29.649371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.654747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.657964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.661575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:29.663033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:29.664456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:29.701561 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] HTTP exception thrown: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Request method failure captured: Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a HTTP/1.1 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHYf996H-0Z1jTVnxNiwKDwANCUkTakd08VXm7Ch3qBtp0HYyucgthL5Bkk_FGfsGRSkP9_f31Gcpy-YNk8ykfv-OZDkY46EYv2RKyj2aZKuBF310XHGA7fJVxxFKicVwTemsV__JJSlPVlVcuB2Z4e2xuo5ZJ-Z8ZnUMYrsdAWoDGk Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 4c016f78a35d468289072287c86aa591 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4c016f78a35d468289072287c86aa591"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c016f78a35d468289072287c86aa591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4c016f78a35d468289072287c86aa591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4c016f78a35d468289072287c86aa591"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 4c016f78a35d468289072287c86aa591 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1459186756 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListImageFiltersTestJSON-1459186756-project Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: aa6904ce795943c98f374398064d0328 Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListImageFiltersTestJSON-1459186756-project Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5bc822f9-9d28-49dc-8b3b-8fcae990b22a'} Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:09:29.704289 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. Oct 04 18:09:29.708802 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:09:29.714692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Returning 404 to user: Instance 5bc822f9-9d28-49dc-8b3b-8fcae990b22a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:09:29.716684 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12185b47-e474-444b-8143-db6a2b64ef16 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a" status: 404 len: 111 microversion: 2.1 time: 0.099725 Oct 04 18:09:29.717679 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1995/4145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:29 2022] GET /compute/v2.1/servers/5bc822f9-9d28-49dc-8b3b-8fcae990b22a => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:09:29.726722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd255864-d3ea-4906-b7aa-3b694ab30fb6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd2ac820>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:29.839696 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:09:29.840363 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:09:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387 (ip 10.222.0.42) !!! Oct 04 18:09:30.723520 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd255864-d3ea-4906-b7aa-3b694ab30fb6 tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387" status: 204 len: 0 microversion: 2.1 time: 1.001749 Oct 04 18:09:30.724559 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2151/4146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:29 2022] DELETE /compute/v2.1/images/f69c68ab-649b-4da4-9437-00a874717387 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:30.735653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86705a40-843b-4a00-b7e1-c9fa3072ec9a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdc1d5dd30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:32.518444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86705a40-843b-4a00-b7e1-c9fa3072ec9a tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883" status: 204 len: 0 microversion: 2.1 time: 1.788335 Oct 04 18:09:32.521307 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1996/4147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:30 2022] DELETE /compute/v2.1/images/e77dd074-f3a6-44c2-abbc-b1d4e7862883 => generated 0 bytes in 1793 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:32.531086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1005b19c-4259-4931-b032-a74e818c3f4c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] Calling method '.version_select at 0x7fbdbd023310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:33.952786 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1005b19c-4259-4931-b032-a74e818c3f4c tempest-ListImageFiltersTestJSON-1459186756 tempest-ListImageFiltersTestJSON-1459186756-project] 10.222.0.42 "DELETE /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291" status: 204 len: 0 microversion: 2.1 time: 1.425485 Oct 04 18:09:33.959352 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2152/4148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:32 2022] DELETE /compute/v2.1/images/032bb379-ac27-4f2c-8aa0-8bdcc0863291 => generated 0 bytes in 1429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:39.362233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1403078026", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:39.707293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=68,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:40.090740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:40.091700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:40.092565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:40.093133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:40.093699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:40.134298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.134792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.140218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.142751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:40.144124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:40.148532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:40.230478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Getting quotas for project 1c09e803f31b46119808db064f6a414d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:40.281121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Getting quotas for user 1998c08071e143489872cd9edc7be4c0 and project 1c09e803f31b46119808db064f6a414d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:40.341817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:40.355841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:40.491488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:40.492330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:40.505781 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a98566fc-6671-4032-9c38-fbbd6446ca39 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 1.976551 Oct 04 18:09:40.516792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1997/4149] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1988 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:09:40.543554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:40.545496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:40.911290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.927477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.931454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:40.945038 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf254d13-47b2-49c0-9578-476e562bbf95 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1454 microversion: 2.91 time: 0.420373 Oct 04 18:09:40.948852 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1998/4150] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:40 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1454 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:41.012226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be20e31a-b921-4b81-a6f0-ba4f417bff20 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: .version_select at 0x7fbdc1dd21f0>, body: {"keypair": {"name": "tempest-keypair-706694044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsyJbECaH4QfXaVEt6spz2Fs6/+ZIv5ot9hy3W3aWK87ZWXVI4TFAZGIBJ/lXN4nOsEl8VOvEIKdcP+Yh1akatHa3IOwbA/7E8uiFlhX42UC8MWkPx028PWp1qDSN594g=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:41.061236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-be20e31a-b921-4b81-a6f0-ba4f417bff20 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:41.093713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-be20e31a-b921-4b81-a6f0-ba4f417bff20 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for user ec0e669bee9d4d949510d5a0c6576b70 and project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:41.183408 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be20e31a-b921-4b81-a6f0-ba4f417bff20 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.694566 Oct 04 18:09:41.184024 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2153/4151] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 18:09:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 696 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:09:41.980544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:41.982168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:42.009338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.010936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.014499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.018873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:42.020098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:42.021145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:42.404543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:42.422817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:42.424777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:42.443691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7f3fa5d-1952-48a3-a51c-84f975fb0f11 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1458 microversion: 2.91 time: 0.467879 Oct 04 18:09:42.444539 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 1999/4152] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:41 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1458 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:43.493719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:43.496018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:43.524706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.530747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.534667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:43.536185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:43.536828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:43.537432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:44.308157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.319636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.323180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:44.339777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e4caaaf-f449-4115-88fa-704fb6d90f16 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1512 microversion: 2.91 time: 0.855028 Oct 04 18:09:44.355010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2154/4153] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:43 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1512 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:45.387644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:45.388279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:45.413401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.413856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.414321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:45.415050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:45.415529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:45.424318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:46.215000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.245400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.251845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:46.270564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da047ef8-f072-4ce5-b24f-64da4b28f589 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1512 microversion: 2.91 time: 0.883881 Oct 04 18:09:46.272227 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2000/4154] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:45 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1512 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:47.308581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:47.309650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:47.347395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.357265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.362180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.366050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:47.366566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:47.367024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:47.683311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-390122964", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "359b4a6c-4fe0-44a5-bb2b-09235a9c6692"}], "security_groups": [{"name": "tempest-securitygroup--2088913169"}], "key_name": "tempest-keypair-706694044", "user_data": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:47.969485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.033597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.041364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:48.134210 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b3d4c4a-b8f6-4413-9d3c-b3bfb6a8d8be tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1533 microversion: 2.91 time: 0.832172 Oct 04 18:09:48.136510 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2155/4155] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:47 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1533 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:48.662791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] validate_networks() for [('359b4a6c-4fe0-44a5-bb2b-09235a9c6692', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:49.128485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.130385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:49.152105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.152893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.153599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.158424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:49.159335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:49.160313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:49.841980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lazy-loading 'services' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:49.928045 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e727b3d-a825-4549-9b01-b52c553515e4 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1940 microversion: 2.91 time: 1.761454 Oct 04 18:09:49.931613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2156/4156] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:48 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1940 bytes in 1770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:49.978374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:49.979460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.001569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.003022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.006170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.008558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.012909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.013638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.084470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:50.196591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:50.360417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lazy-loading 'services' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:50.392481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53ee2407-2a95-4cb0-a8f6-dfcb646b92aa tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1940 microversion: 2.91 time: 0.424692 Oct 04 18:09:50.418666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2157/4157] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:49 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1940 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:50.424771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:50.436345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.438524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.439386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.442172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.445151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.446004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.495696 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-397cd46c-3b15-4c8c-8a78-9429d9d3f89f tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.074929 Oct 04 18:09:50.505512 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2158/4158] 10.222.0.42 () {60 vars in 1217 bytes} [Tue Oct 4 18:09:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:09:50.512413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:50.513329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:50.521352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.522288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.523527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.524537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:50.525318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:50.526734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:50.562306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lazy-loading 'flavor' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:09:50.917282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:51.122882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:09:51.191175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae81157d-e782-4c14-822f-bf13c18cdde0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action" status: 202 len: 0 microversion: 2.91 time: 0.683733 Oct 04 18:09:51.192714 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2159/4159] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:09:50 2022] POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:09:51.218226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:51.234382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:51.257312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.258210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.259827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.263593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.264348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.266228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.764246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:51.765055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:51.765906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:51.766339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:51.766870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:51.781276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.783473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.784182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.787382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:51.788116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:51.788745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:51.873312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:51.886373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for user ec0e669bee9d4d949510d5a0c6576b70 and project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:51.915681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:51.918604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:51.918748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.935590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.938045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:51.952553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-86064836-d2cd-43b8-9a7d-c6d53b89a10a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.747610 Oct 04 18:09:51.953276 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2160/4160] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:51 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:52.073024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6420819d-d49f-464f-9d55-a347a45d670d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.396212 Oct 04 18:09:52.073687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2001/4161] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:09:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 4398 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:09:52.097280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.098862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:52.218973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.236953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.240998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:52.242323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4118a9bb-b127-4804-9e72-2903fe2824e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1280 microversion: 2.20 time: 0.150168 Oct 04 18:09:52.243006 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2161/4162] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:52.986869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:52.989049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.002184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.004913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.006217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.007168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.007790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.008405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.228222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.254521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.260792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.282631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:53.283342 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5afa1f5-bbe9-44a6-8f41-0b05cf2646b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.300383 Oct 04 18:09:53.284252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:53.286767 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2002/4163] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:52 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:53.325547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.326801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.327720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.329068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:53.329903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:53.330969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:53.548008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.559610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.567552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:53.569093 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebf14d81-1a45-4075-b1e1-3dc591059651 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1284 microversion: 2.20 time: 0.293526 Oct 04 18:09:53.573108 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2162/4164] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:53 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1284 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:54.318885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.319508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.344037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.344550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.344990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.346184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.348633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.350433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.699894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.715134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.716972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.734563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02b1b8f0-c0fa-49db-b9c6-2d87750ae807 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.419729 Oct 04 18:09:54.739821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2003/4165] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:54.745553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:54.746382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:54.754314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.755824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.756478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.757725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:54.758586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:54.759228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:54.903013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.913070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.927328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:54.928560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc02d0b9-9765-4470-b07b-af121fd1d4d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1350 microversion: 2.20 time: 0.187345 Oct 04 18:09:54.929127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2004/4166] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:54 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1350 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:55.191582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2038454046", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:09:55.305058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:09:55.772332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:55.772956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:55.789332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.790112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.792433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:55.793377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:55.794037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:55.799898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.046620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.056560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.058325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.084813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c5a638f-ff82-4146-8526-2139a061a5ad tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.316839 Oct 04 18:09:56.085335 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2005/4167] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:55 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:56.090324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:56.096467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:56.123039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.123666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.124222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.127599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:56.129953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:56.132549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:56.335436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.354058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.366032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:56.369659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df5eca8e-0ce0-4d56-8c25-616e3db96848 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1338 microversion: 2.20 time: 0.283128 Oct 04 18:09:56.371672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2006/4168] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:56 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1338 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:57.122882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.124729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.162602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.203561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.203561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.203561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.203561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.203561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.788017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.797454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:09:57.800864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:09:57.800864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:09:57.800864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:09:57.800864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:09:57.807473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.808987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:57.820048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.820548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.827886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.829949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.830151 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b429b54-1904-4dea-8ac7-e071774e4201 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.718298 Oct 04 18:09:57.830461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.834582 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2007/4169] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:09:57.840020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:57.850855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:57.851285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.862268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.870686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.871161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.871927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:57.872404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:57.872847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:57.881173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:09:57.889516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:09:57.918292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:09:57.920610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:09:58.087667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6991b7ed-0c8b-460d-830f-406026bd670f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.563502 Oct 04 18:09:58.093041 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2163/4170] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:09:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 3569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:09:58.102240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0592d45-96ce-4871-86bc-1f48cccdc2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.104375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0592d45-96ce-4871-86bc-1f48cccdc2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.292482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0592d45-96ce-4871-86bc-1f48cccdc2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:58.311290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0592d45-96ce-4871-86bc-1f48cccdc2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1215 microversion: 2.1 time: 0.215591 Oct 04 18:09:58.312514 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2164/4171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1215 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:09:58.865246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:58.865922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:09:58.890875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.892714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.893250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:58.894810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:09:58.906569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:09:58.908998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:09:59.112339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.123019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.132836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:09:59.158084 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87b50a59-f9ac-4de4-863b-6dce087aa773 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.291050 Oct 04 18:09:59.183209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2165/4172] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:58 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:09:59.350379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0b5f54d-10eb-4378-b73d-788063a3f5d7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:09:59.351022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0b5f54d-10eb-4378-b73d-788063a3f5d7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.314175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.376416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.387976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.389621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f411fbd5-a84d-45fc-9b65-cc12e0064597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 2.553812 Oct 04 18:10:00.390255 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2008/4173] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:09:57 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 2555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:00.439068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:00.439781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:00.507880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.508896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.509713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.520266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:00.528082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:00.528950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:00.817437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.864306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.866751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:00.896233 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b394cca-cc4e-4316-b3d5-1b602621746c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.469012 Oct 04 18:10:00.936534 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2009/4174] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:00 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:01.022333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0b5f54d-10eb-4378-b73d-788063a3f5d7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:01.033102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0b5f54d-10eb-4378-b73d-788063a3f5d7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1215 microversion: 2.1 time: 1.691100 Oct 04 18:10:01.034071 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2166/4175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:09:59 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1215 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:01.428896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.430709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.457869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.458843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.462308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.474623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.475458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.475731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.734836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:01.771819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.772312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.772751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.813677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] Creating event network-changed:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h2-831194-21 Oct 04 18:10:01.832709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:01.835812 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6581d7fc-6de6-4481-9e47-53ab32cf186f req-777012b5-be95-4c21-9b03-005abdc76e84 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.603118 Oct 04 18:10:01.837164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2010/4176] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:01.933285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:01.944397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:01.946115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:01.971299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.972212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.972850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:01.974157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:01.976578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:01.983383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.227418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.246991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.250642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.254609 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28b8ae17-b852-4240-b8ba-f00a7d386d04 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 0.828649 Oct 04 18:10:02.255234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2167/4177] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:02.267736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:02.277773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:02.287812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.288625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.289305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.294687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:02.295227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:02.295649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:02.443631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.454890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30c5c3c9-2fd3-4451-b1b2-0dd379851afe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1273 microversion: 2.1 time: 0.198557 Oct 04 18:10:02.470982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2168/4178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:02 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1273 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:02.541028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.551624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.558917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:02.573749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0dcbfc55-bf93-4d8a-8b51-0e039afe9719 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.641276 Oct 04 18:10:02.579022 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2011/4179] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:01 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:03.287958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.288751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.304461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.304988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.305449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.309205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.309714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.310199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.486756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.489215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.503752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.503752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.504099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.505010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.508065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.508714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.638280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.650986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.652908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.660127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-575cf07a-6abb-45be-be0d-a59d8b9e0042 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 0.378261 Oct 04 18:10:03.661185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2169/4180] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:03.699126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:03.702782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:03.719980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.720882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.722494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.726068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:03.726957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:03.730258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:03.937742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.962140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.963625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:03.992314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a29b718c-af74-4bad-b843-360ca34c13e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.314405 Oct 04 18:10:04.002180 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2170/4181] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:04.318872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:04.353058 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b37192fd-ded9-48ef-9215-90bfe8fdf1b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1273 microversion: 2.1 time: 0.861401 Oct 04 18:10:04.356369 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2012/4182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:03 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1273 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:04.695616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:04.696433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:04.732927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.736811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.737765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:04.742530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:04.744402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:04.748245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.050236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.050950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.067916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.068744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.069369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.070304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.070927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.071715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.480742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.519616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.523192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.547405 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae3eafa0-6984-446a-a196-6124fe33ecd4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.501182 Oct 04 18:10:05.548494 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2013/4183] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:05.564420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:05.566223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:05.575857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.578178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.583209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.584008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:05.584969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:05.585589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:05.746545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:05.755218 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d01be39a-b38a-4b28-91fa-ee4c3d80bdc1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1273 microversion: 2.1 time: 0.205456 Oct 04 18:10:05.756428 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2014/4184] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:05 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:06.322203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.341429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.345600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:06.351426 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9fa4c61a-f33b-4a33-a696-128eb3cfaca5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 1.664533 Oct 04 18:10:06.356790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2171/4185] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:04 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:06.585592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.586487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.618651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.619103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.619411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.620334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.620814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.634934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.787990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:06.789110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:06.810089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.810930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.811716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.812966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:06.813847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:06.823168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:06.835653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:07.470024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.507156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.510011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.526744 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-822f25b2-596c-4010-bac2-b5a3f9746edb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.946149 Oct 04 18:10:07.528247 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2015/4186] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:07.533661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:07.535242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:07.561178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.565971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.568521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.570433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:07.571072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:07.571733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:07.606456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:07.727893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:07.766193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-631dbedc-cbd5-47b0-95c5-e6b211095acf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.985655 Oct 04 18:10:07.788485 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2172/4187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:06 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:08.559165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.559802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.562547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:08.580799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.581316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.581795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.582500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.582981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.583405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.752377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.767051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.772599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:08.788461 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9101390f-0a99-449f-9f16-42ff2d3f053f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.233726 Oct 04 18:10:08.789142 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2173/4188] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:08.816606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:08.818191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:08.841731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.842303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.842759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:08.843494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:08.843960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:08.844396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.281329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.307481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-02de6e42-3125-43d7-8623-362df60a74f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.502165 Oct 04 18:10:09.308577 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2174/4189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:08 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:09.430842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.459493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.477557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:09.483137 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f77370d-8aef-42fd-948a-de2ca645f6e4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 1.953260 Oct 04 18:10:09.485502 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2016/4190] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:07 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:09.823821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:09.831493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:09.858203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.859592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.860571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:09.862124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:09.863126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:09.864310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.047098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.064570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.068009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:10.085783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d071c60a-683a-42f7-875f-090ad47a5915 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.268833 Oct 04 18:10:10.087163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2175/4191] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:09 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:10.335903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.337609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.355628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.356198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.356652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.357428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.357901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.361485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.512141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:10.513026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:10.535239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:10.537132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.550782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.575489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:10.580380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:10.586673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:10.588698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.030148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:11.087187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.097862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.105968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.109040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2cf106b-1e5a-40e5-869f-b340280c72e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 0.599127 Oct 04 18:10:11.126303 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2176/4192] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:11.142033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2009726466", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "f6cbfb0b-9b0a-4b13-8edd-4bbe94a86bbf"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:11.246381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] validate_networks() for [('f6cbfb0b-9b0a-4b13-8edd-4bbe94a86bbf', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:11.332336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.348613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1c95ae8-96bf-42cf-9dae-324ef1c6a242 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 1.018745 Oct 04 18:10:11.365391 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2017/4193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:10 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:11.371896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:11.372411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:11.398194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.398694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.399431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.400353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:11.400982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:11.401584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:11.585606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.610928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.613941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:11.635910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e840ddaf-6352-4a30-bb16-a49d6a8962eb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.268124 Oct 04 18:10:11.636811 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2018/4194] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:11 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:12.139658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.140499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.154153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.154874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.156522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.157748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.161749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.164910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.434092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:12.436099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:12.437974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:12.438911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:12.441009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:12.461437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.462434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.463349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.464589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.465314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.466383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.505521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Getting quotas for project a3706a13ef744582bc31cafd160cb982. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:12.516693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Getting quotas for user eb1b1bf1d54240339e6eca8fb18c593f and project a3706a13ef744582bc31cafd160cb982. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:12.551186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:12.565873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:12.723752 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25868278-ed11-44b5-87e8-e10d4b493fc8 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.596148 Oct 04 18:10:12.725741 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2177/4195] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:12.732283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:12.733099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:12.750211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.754417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.770206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:12.772826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:12.774174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:12.775511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.056524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.069339 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5da187d8-8453-49ce-8c88-e1b758464438 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.342317 Oct 04 18:10:13.070881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2178/4196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.080195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.083472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.110558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.111141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.113050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.113823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:13.114329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:13.118835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:13.224323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.261243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.271958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.278656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7e1bce0-d4b3-49f5-8047-24b794416479 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.206578 Oct 04 18:10:13.284918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2179/4197] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:13.290049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5bb14afe-6ad2-46e5-9948-0d7762977c43 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:13.294489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5bb14afe-6ad2-46e5-9948-0d7762977c43 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:13.437438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5bb14afe-6ad2-46e5-9948-0d7762977c43 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.453815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5bb14afe-6ad2-46e5-9948-0d7762977c43 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1219 microversion: 2.1 time: 0.167472 Oct 04 18:10:13.454759 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2180/4198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:13 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1219 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:13.806929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.820017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.825843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:13.834590 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e866e419-1a9b-4b69-9820-becdf5b2334c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 1.699094 Oct 04 18:10:13.844936 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2019/4199] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:12 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:13.990853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "name": "network-vif-plugged", "status": "completed", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:14.038541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.039121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.039642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.063221 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] Creating event network-vif-plugged:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h2-831194-21 Oct 04 18:10:14.077467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ddbd075d-f748-401e-91b1-ee653ac3f600 req-4998b71d-0292-4b15-a7e9-00e0397dbd39 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.620121 Oct 04 18:10:14.081217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2181/4200] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:14.101597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.102531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.115111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.119330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.122337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.126554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.133291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.134473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.347646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:14.348994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:14.392835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.393580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.394552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:14.395585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:14.428707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:14.440058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.384343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.400945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.409182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.431157 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93d71e5b-4cce-4592-9aff-ccb65c36f9b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 1.087155 Oct 04 18:10:15.438141 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2182/4201] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:15.452493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.459198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.475384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.476014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.477247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.478397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.479335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.480130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.804459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.816310 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6b5a1a5-540d-4723-a9a0-101e4ec98cb1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1279 microversion: 2.1 time: 0.374204 Oct 04 18:10:15.817778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2183/4202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1279 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.829424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:15.832429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:15.836195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:15.846896 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a8ce849-05af-4ab7-88f7-3022cea67100 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 1.752171 Oct 04 18:10:15.849140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.849717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.851866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.852840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.865862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2020/4203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:14 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:15.865862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c546d831-d1dc-4f64-ab14-64628bed90fd", "tag": "6e7f74e4-cd3e-4abd-b2be-8238c1f05997"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:15.868413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.868877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.895874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:15.896521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:15.898887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:15.918894 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] Creating event network-changed:6e7f74e4-cd3e-4abd-b2be-8238c1f05997 for instance c546d831-d1dc-4f64-ab14-64628bed90fd on n-h1-831194-21 Oct 04 18:10:15.925713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ce8ef94e-5660-4299-97d1-f59a2220b23c req-80dcc50e-ce21-4a6e-bb2f-cb493fe704bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068541 Oct 04 18:10:15.926832 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2021/4204] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:16.406660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.432929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.435781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.437025 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb95539f-1a09-41c2-ad7e-86111f863147 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1406 microversion: 2.20 time: 0.617804 Oct 04 18:10:16.438064 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2184/4205] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:15 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1406 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:16.475442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.476459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.500440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.501495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.502720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.503855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.504980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.506286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.688935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.710501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.716174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:16.734592 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee941aed-455f-4ff4-91ea-16acaa499c2a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.265180 Oct 04 18:10:16.776113 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2022/4206] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:16.841344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.842475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.849908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.850411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.850855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.856381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.857487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.858345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.881898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:16.883134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:16.894019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.898857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.900410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:16.902694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:16.907097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:16.907987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.045057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.061967 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e494a6df-41d2-4635-8325-5128f2a0b2ba tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1277 microversion: 2.1 time: 0.224123 Oct 04 18:10:17.063156 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2185/4207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.473192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.474546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.510389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.512192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.512990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.514860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.515546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.516360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.729050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:17.772590 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4602eea5-8986-449c-b481-63854afffc6b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.895110 Oct 04 18:10:17.782984 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2023/4208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:16 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:17.813406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:17.814409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:17.832195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.832709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.833164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:17.836670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:17.837142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:17.837582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.178521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.195264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.200139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.218976 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a33754f4-0b8a-4a66-82bb-8f3cda2e4f2f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.433998 Oct 04 18:10:18.219894 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2024/4209] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:18.229705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.233777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.251675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.252240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.259712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.261754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.264569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.267528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.468206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.481988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.483798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.491297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ae1de4f-74c5-412b-9881-d38f69fc4fcb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1598 microversion: 2.20 time: 1.027648 Oct 04 18:10:18.495646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2186/4210] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:17 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1598 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:18.528494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.529002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.562315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.562819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.563268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.564006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.564462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.565463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.634516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:18.652340 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-262a8fe5-37ff-4e78-be59-bd09009f5de1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 0.428582 Oct 04 18:10:18.672839 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2025/4211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:18.810752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:18.811631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:18.828282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.829040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.829646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.830693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:18.831441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:18.832146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:18.941662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2554e2f5-62fd-4023-a3d6-78b7c00f4bfe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.420234 Oct 04 18:10:18.942934 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2187/4212] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-interface => generated 285 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:10:19.255524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.256151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.266167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.270143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.270624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.271381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.271858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.274377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.411658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.427201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d585caa-67ca-4b92-a0ce-dceaa6886b23 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.620287 Oct 04 18:10:19.431071 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2026/4213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:18 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:19.446196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.460527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.462630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:19.486660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2d60a30-9291-439f-a46b-bc8b62564f41 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.227118 Oct 04 18:10:19.508106 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2188/4214] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:19.684054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:19.685609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:19.699572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.702425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.703592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:19.706015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:19.708311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:19.708894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.456745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:20.457395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:20.474507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.483379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.484692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:20.490375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:20.494231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:20.497561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.445595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.459445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b11d820-4772-4384-bb3d-21dbb6df7706 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 1.007193 Oct 04 18:10:21.462618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2189/4215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:20 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:21.472351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:21.474482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:21.491691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.493302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.494300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.496791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:21.501600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:21.504060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:21.791514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:21.802797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1332c290-b712-4717-ba6d-cb9583a44696 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 2.124497 Oct 04 18:10:21.824856 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2027/4216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:19 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 2148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:22.384707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.407010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.437216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:22.474998 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9f76caa-5d1b-4483-a984-264b6d56e31d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 1.004656 Oct 04 18:10:22.479354 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2190/4217] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:21 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:22.494908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.495543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.499559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:22.517363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.520042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.520508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.521275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.521735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.528226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.836191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:22.836821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:22.849731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:22.866438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.869093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.869570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.871169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:22.873013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:22.874011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:22.945087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:23.240843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.249742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57ed13ef-ec8a-4988-b061-5b2713c11697 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.763393 Oct 04 18:10:23.256969 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2028/4218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:23.265848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76480cd4-7c3e-456d-808b-51d47529efff", "tag": "2407bf7a-52fc-448d-baae-9ebf047682a0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:23.307661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.308156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.308601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.369437 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] Creating event network-changed:2407bf7a-52fc-448d-baae-9ebf047682a0 for instance 76480cd4-7c3e-456d-808b-51d47529efff on n-h2-831194-21 Oct 04 18:10:23.386800 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-55e89adf-eb58-4163-8a62-631cd0edf6b3 req-69c60b57-bf1a-4b6d-a2a8-69922cfc8640 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128510 Oct 04 18:10:23.389152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2029/4219] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:23.442300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:23.477700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:23.511150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.513138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.515617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.534813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] Creating event network-changed:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h2-831194-21 Oct 04 18:10:23.541626 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bbc6eff1-c2ed-4736-ab46-1e1d3226ea86 req-196531d4-2001-4216-9582-8f0eb8deec0b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067995 Oct 04 18:10:23.543199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2030/4220] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:23.551540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:23.552613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:23.565473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.567136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.567766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.569678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:23.570349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:23.571002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:23.729003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.746558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.751625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:23.767158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1be6073c-ec63-43f2-a69a-21559b54b4e3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.220733 Oct 04 18:10:23.770815 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2031/4221] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:23 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:24.149722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.158454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88a996e4-4a34-47fb-a7cb-f5e53f717763 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 1.329548 Oct 04 18:10:24.165882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2191/4222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:22 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.288565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.291135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.316866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.330758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.330758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.330758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.330758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.330758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.607582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c546d831-d1dc-4f64-ab14-64628bed90fd", "name": "network-vif-plugged", "status": "completed", "tag": "6e7f74e4-cd3e-4abd-b2be-8238c1f05997"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:24.640005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.643270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.645765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.684868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] Creating event network-vif-plugged:6e7f74e4-cd3e-4abd-b2be-8238c1f05997 for instance c546d831-d1dc-4f64-ab14-64628bed90fd on n-h1-831194-21 Oct 04 18:10:24.701233 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ae9a66a0-50d9-4367-9995-b401ffee4e8d req-3b2ffb0c-c210-4044-abfe-a0f75ef4a626 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101906 Oct 04 18:10:24.704023 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2192/4223] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:24.756498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:24.772521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54b6c600-1bb2-48df-881c-4be6cb3d95c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 0.492281 Oct 04 18:10:24.777861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2032/4224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:24.804605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:24.805702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:24.821056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.825138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.830862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:24.834594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:24.836797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:24.842562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.124806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.139706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.145402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.159907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b08b7090-ee93-4265-bf0e-e887d2ea2144 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.361746 Oct 04 18:10:25.176675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2193/4225] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:24 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:25.191740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:25.192374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:25.203267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.203773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.204223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.205517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.214354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.214961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.572147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:25.581875 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5c3eaf2-7ad7-4985-8c6b-d869a9893b57 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 0.394324 Oct 04 18:10:25.582487 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2033/4226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:25 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:25.801802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:25.802851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:25.820048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.822050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.822508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:25.823279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:25.823712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:25.824252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.194229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.194917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.211676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.212284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.212640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.213321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.216040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.216596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.636377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.648428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.653930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.667629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68a79833-5389-4dad-9c65-4c91893a7d62 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.477502 Oct 04 18:10:26.678239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2034/4227] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:26.683690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:26.684951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:26.696780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.697564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.702253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.703385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:26.704085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:26.704763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:26.710999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:26.820684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:26.840823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df9a5a42-48ad-4d10-93bf-8b8433d2c8c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1315 microversion: 2.1 time: 1.043905 Oct 04 18:10:26.841691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2194/4228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:25 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1315 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.228596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:27.243893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf9801bb-52a8-462d-a88d-d1ea7d6f4a04 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 0.564043 Oct 04 18:10:27.249083 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2035/4229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:26 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:27.701935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.702569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.720271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.730491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.731308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.732101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.732586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.733024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.872591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:27.874112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:27.886055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.886819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.887421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:27.891770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:27.892260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:27.896627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.281209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.296817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.309900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.317063 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad9bb652-e19a-4ffe-ab06-604d7b1773f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.619586 Oct 04 18:10:28.326391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.331712 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2195/4230] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:28.346155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1adf1af0-e3af-4d0e-9206-4dab8aadb7c1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1502 microversion: 2.1 time: 0.477195 Oct 04 18:10:28.347552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.348976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.351982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2036/4231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:27 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1502 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:28.356475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.357287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.357979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.358952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.359621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.360273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.387798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.388303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.399055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.399572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.400011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.400794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.401252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.401685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.489408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:10:28.705773 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c1fc776-5e1d-4654-b135-b14245721f2e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 204 len: 0 microversion: 2.1 time: 0.321859 Oct 04 18:10:28.708379 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2037/4232] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:10:28 2022] DELETE /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:10:28.722840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:28.724849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:28.745949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.751561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.752268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.753039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:28.756964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:28.757507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:28.839794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:28.851855 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-29d06a8f-dff0-4cc0-990e-dc2048139e0d tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 0.518325 Oct 04 18:10:28.875625 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2196/4233] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.349592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.350279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.358983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.359495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.359948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.360682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.361220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.361658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.575891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.585815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.603874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.621209 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c626ae7-8268-4c0b-bcdc-9f69f4c433fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.276288 Oct 04 18:10:29.636937 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2197/4234] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:29.685712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:29.707808 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fdae2f01-2edc-4267-a2a2-304a68ef8a88 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1508 microversion: 2.1 time: 0.993430 Oct 04 18:10:29.709949 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2038/4235] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:28 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1508 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:29.885030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:29.885700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:29.902536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.903255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.906434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:29.908019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:29.908019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:29.909295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.669052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:30.670119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:30.692245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.693154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.693630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:30.694504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:30.695011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:30.695456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.000046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.015610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.022835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.037741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2687e1f0-146a-4d01-babc-18750874f5bb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.373452 Oct 04 18:10:31.039256 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2039/4236] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:30 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:31.062783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:31.064115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:31.085429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.090354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.101934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.107336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:31.118722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:31.122165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:31.809569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.832480 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92e33a0e-0af0-4126-9a9e-99d5fc045a8c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1508 microversion: 2.1 time: 0.780638 Oct 04 18:10:31.835419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2040/4237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:31 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1508 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:31.963980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:31.996815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-85b0c3a1-9b41-47cc-884e-6850156f5c27 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 2.112437 Oct 04 18:10:32.016605 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2198/4238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:29 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 2135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:32.081175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.081798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.098238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.098737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.107841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.109166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.113477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.117823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.592444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.643267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.658679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:32.679791 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae8b37ca-3b36-4552-a807-9e4778a99482 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.602353 Oct 04 18:10:32.681729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2041/4239] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:32.826499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c546d831-d1dc-4f64-ab14-64628bed90fd", "name": "network-vif-deleted", "tag": "6e7f74e4-cd3e-4abd-b2be-8238c1f05997"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:32.861672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:32.862758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:32.862916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.863310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.863719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.882456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.884772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.885244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.886042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:32.893937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:32.899057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:32.923789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] Creating event network-vif-deleted:6e7f74e4-cd3e-4abd-b2be-8238c1f05997 for instance c546d831-d1dc-4f64-ab14-64628bed90fd on n-h1-831194-21 Oct 04 18:10:32.952093 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d00dc535-f554-4993-9d7a-70cbc88c9fc4 req-f14e66f5-8710-47b4-94d5-9f3dcf038cea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124274 Oct 04 18:10:32.954055 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2199/4240] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:33.031388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.032284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.057655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.067684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.068806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.073288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.075908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.080184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.200843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:33.229016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2626fa96-45ba-476e-bbcd-39986bb14afc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 200 len: 1300 microversion: 2.1 time: 0.371826 Oct 04 18:10:33.249498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2042/4241] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:32 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 1300 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:33.712612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:33.716007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:33.743362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.748502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.753253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:33.754617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:33.763558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:33.764382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.141406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.155156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cfc10167-0dc1-4007-813c-050e97f9658a tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 1.128397 Oct 04 18:10:34.164773 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2200/4242] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:34.175554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76480cd4-7c3e-456d-808b-51d47529efff", "name": "network-vif-plugged", "status": "completed", "tag": "2407bf7a-52fc-448d-baae-9ebf047682a0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:34.201798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.202327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.202770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.228553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] Creating event network-vif-plugged:2407bf7a-52fc-448d-baae-9ebf047682a0 for instance 76480cd4-7c3e-456d-808b-51d47529efff on n-h2-831194-21 Oct 04 18:10:34.242549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.243175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-9b86ff9d-f713-4282-8597-fe938f2c3546 req-12c62569-8ee4-48c1-840c-6d9419b0fb93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076969 Oct 04 18:10:34.244305 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2201/4243] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:34.257409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:34.258596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:34.279566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.280081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.280554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.281257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:34.286007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:34.288233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.291917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:34.292707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:34.316375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be1976bf-d92a-49f6-9652-a7776383e5c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.610054 Oct 04 18:10:34.321323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2043/4244] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:33 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:34.331823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd HTTP/1.1 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c546d831-d1dc-4f64-ab14-64628bed90fd'} Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:10:34.337698 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:10:34.344928 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:10:34.351340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:10:34.352467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e25bdf55-6e5a-4ffa-9871-f9cdcc02186a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 404 len: 111 microversion: 2.1 time: 0.099360 Oct 04 18:10:34.353752 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2202/4245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:34 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:10:34.636814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1220128999", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:34.727925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:10:35.188196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.189968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.197736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.198735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.200185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.201973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.202612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.203225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.404653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.413229 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a70bf54a-bc4c-499c-8adb-9c1d4109b231 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1319 microversion: 2.1 time: 0.228776 Oct 04 18:10:35.413844 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2203/4246] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:35.418930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:35.419909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:35.427285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.428334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.429008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.430175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:35.430812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:35.431328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:35.509115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.518831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.520801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:35.526616 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66862a8b-440c-423e-ab1a-ef0b6a396288 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1537 microversion: 2.91 time: 0.111342 Oct 04 18:10:35.527337 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2204/4247] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:35 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1537 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:36.349816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:10:36.350551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:10:36.350955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:10:36.351519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:10:36.352014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:10:36.372472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.373047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.373578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.374488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.375028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.378275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.434421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:36.453505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.457912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:36.464519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.484440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.489181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.493172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.494867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.498929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.499184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:10:36.504178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.506271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:10:36.632072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8a4d7a9-aaec-4cf1-b5dd-8b29d65549c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.997527 Oct 04 18:10:36.633185 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2044/4248] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:10:36.644135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.645267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:36.655129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.655961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.657338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.658545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:36.659464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:36.660224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:36.889555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.903104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.905188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:36.916998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36ccf6a1-6063-4ac4-9505-23ea30b50a9b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1537 microversion: 2.91 time: 0.280992 Oct 04 18:10:36.920038 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2045/4249] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1537 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:36.927824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96d6a065-7b64-40d4-a917-3f84ec0e788e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:36.929847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96d6a065-7b64-40d4-a917-3f84ec0e788e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.109814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96d6a065-7b64-40d4-a917-3f84ec0e788e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.122148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96d6a065-7b64-40d4-a917-3f84ec0e788e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1215 microversion: 2.1 time: 0.200075 Oct 04 18:10:37.124183 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2046/4250] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1215 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.143986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:37.162655 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0565cf49-98de-4df6-b98b-9c99b7b25479 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1508 microversion: 2.1 time: 0.727830 Oct 04 18:10:37.163975 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2205/4251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:36 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1508 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:37.952588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:37.953914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:37.965221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.965722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.966195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:37.966912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:37.967372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:37.967806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.148695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.149327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.163743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.164256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.164897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.165787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.176703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.177189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.211462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.220559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.222142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.254431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-048f9a45-bc53-4414-a03c-fffdae2e9885 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1540 microversion: 2.91 time: 0.306520 Oct 04 18:10:38.270446 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2047/4252] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:37 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1540 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:38.285755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:38.288952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.297466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.299498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.300348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.301566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.302470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.303629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.416437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.433059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0acc1d7-5ef1-47d7-a7d5-a527397398e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1267 microversion: 2.1 time: 0.288083 Oct 04 18:10:38.434308 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2206/4253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1267 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:38.479433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-831194-21". {{(pid=128850) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:10:38.660197 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f27040be-99cf-49b9-a25f-35f815fc9e9c tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action" status: 202 len: 0 microversion: 2.91 time: 0.379083 Oct 04 18:10:38.661374 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2048/4254] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:10:38 2022] POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:10:38.670770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:38.673030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:38.683130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.684159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.684737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.685952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:38.686772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:38.687508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:38.808789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.827178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.833144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:38.848366 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16a7058d-4cc1-4a72-95e8-7af516699537 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1548 microversion: 2.91 time: 0.182253 Oct 04 18:10:38.878416 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2207/4255] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:38 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1548 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:39.462687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.464363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.482466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.495974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.496805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.498422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.509677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.510741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.779936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:39.790381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8bace96-9f68-4645-8dde-ba1bb4992bcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1273 microversion: 2.1 time: 0.332018 Oct 04 18:10:39.794159 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2049/4256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1273 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:39.920629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:39.924729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:39.971847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.972886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.975982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:39.980335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:39.980844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:39.983511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.272309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.291625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.301645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:40.313214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:40.335499 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8722732-1a96-42bd-b162-d254840d85f5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1488 microversion: 2.91 time: 0.425286 Oct 04 18:10:40.340364 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2208/4257] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:39 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1488 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:40.822786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:40.824116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:40.850600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.854612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.855087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.865731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:40.867180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:40.867659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:40.920749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:41.102505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.134161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac3ff02d-b7f0-4d4c-b21e-4bc71e338aa4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1273 microversion: 2.1 time: 0.312477 Oct 04 18:10:41.136014 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2050/4258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:40 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1273 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:41.375051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:41.375669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:41.388660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.390008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.390876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.392999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:41.393664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:41.394341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:41.521184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.533714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.535504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:41.545224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52d92521-b5bc-47eb-ab25-61c984941996 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.176037 Oct 04 18:10:41.546889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2209/4259] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:41 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:42.183542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.186120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.224617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.236823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.254178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.259568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.261505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.262616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.443017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:42.459056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c0be7cc0-276e-4ea6-a25c-92e3b8f43365 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1273 microversion: 2.1 time: 0.304336 Oct 04 18:10:42.490075 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2051/4260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:42.593422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:42.598259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:42.634924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.635450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.641417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:42.645345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:42.647779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:42.648808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.071372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:43.078716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:43.090084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:43.098717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:43.140230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b51e7805-3ce6-4b72-b6bd-e53a5012614c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.559902 Oct 04 18:10:43.143462 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2210/4261] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:42 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:43.493334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:43.494007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:43.508764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.515180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.515696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:43.516478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:43.517006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:43.517486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.172149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:44.174914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:44.196290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.196812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.197254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:44.198019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:44.202509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:44.204253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:45.088119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.121254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.122786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.132757 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a37059d-c6c2-47d7-b7a8-ed77a6a719f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 1.644429 Oct 04 18:10:45.133363 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2052/4262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:43 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 1646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:45.150955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:45.206373 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfff3e3d-b1c5-4a74-8033-e5001f569625 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 1.040941 Oct 04 18:10:45.209329 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2211/4263] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:44 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:46.174044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.174823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.203869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.205643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.205643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.210248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.211661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.212134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.242284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:46.242824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:46.263030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.268780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.275117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.277156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:46.284058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:46.285016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:46.408437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:46.706884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.738794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.740792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:46.761089 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65bebff3-9c55-436a-9e4e-523d348790aa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.517168 Oct 04 18:10:46.761672 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2212/4264] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:47.119074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:47.483450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:47.509113 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca7e6779-2761-4d09-a7b8-9a544b9ba5fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 1.346682 Oct 04 18:10:47.509796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2053/4265] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:46 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:47.796189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:47.797245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:47.821966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.823628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.826428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.831693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:47.833215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:47.834615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:47.965981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a445ae3-9b35-474e-853a-96d36b0a56a1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: .version_select at 0x7fbdc1c61550>, body: {"keypair": {"name": "tempest-keypair-1945524168", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoRxKzj/rGG8L5KK002ymgeXuisTU/aCsIbMVWl/1NmGszzliv5kCdA4Vpj109R2n9XNV2xiod9FAEHSfYNwoLJdbrHcXOcetqHq2ujwLDQLGKZh7nVsiGAhVYpnreJwQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:48.030663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3a445ae3-9b35-474e-853a-96d36b0a56a1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:10:48.059979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3a445ae3-9b35-474e-853a-96d36b0a56a1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:10:48.062118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.072807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.088018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:48.111943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f54daa9d-1f96-4ecd-9d31-7f4ccce3a771 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.321018 Oct 04 18:10:48.112934 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2054/4266] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:47 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:48.180445 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a445ae3-9b35-474e-853a-96d36b0a56a1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.699082 Oct 04 18:10:48.183579 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2213/4267] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:10:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:48.532683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:48.533310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:48.550440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.558911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.560197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.561206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.565113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.568001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.592821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc456396-c944-42e6-a70a-e8e92ea83ebc", "tag": "c2ffbefa-31d4-479b-8d7e-3084fe9be89d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:48.635032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:48.639939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:48.641359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:48.693723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] Creating event network-changed:c2ffbefa-31d4-479b-8d7e-3084fe9be89d for instance cc456396-c944-42e6-a70a-e8e92ea83ebc on n-h1-831194-21 Oct 04 18:10:48.716897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-47b26779-c2a5-44f8-8e4a-f2de56e5517b req-5cb12097-db96-4bf3-8f9e-dfec4ea5cd91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120291 Oct 04 18:10:48.719549 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2214/4268] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:10:49.147172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:49.147892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:49.181289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.188656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.189527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.190536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:49.198168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:49.199129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:49.678992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.688306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.699698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:49.716694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57f70583-1e95-4b13-8799-78d71a82bea0 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.576145 Oct 04 18:10:49.721233 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2215/4269] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:49 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:49.986239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:50.005814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5435cd0-5c2d-4fa2-8b88-cdcad7c9efe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 1.476500 Oct 04 18:10:50.024947 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2055/4270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:48 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:50.758762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:50.759402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:50.787040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.798131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.798755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:50.799541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:50.800027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:50.800469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.036894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:51.037653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:51.065304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:51.066596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.067099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.078635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.079861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:51.085980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:51.086550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:51.204103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:51.216864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:51.222623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:51.259685 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8aab1ad-f4d8-4b70-b5ae-6e05b144fb91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.505838 Oct 04 18:10:51.260810 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2216/4271] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:50 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:52.260685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:52.276918 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a9f1dc2-a3d7-4199-bdd8-c97eb989a55e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 1.244267 Oct 04 18:10:52.277988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2056/4272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:51 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:52.326735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:52.328461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:52.352502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.353623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.356215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.357248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:52.362473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:52.363230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:52.725241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:52.734565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:52.742132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:52.758444 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee875cf3-98ec-46c4-ac33-a7827d58e421 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.437473 Oct 04 18:10:52.774304 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2217/4273] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:52 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:53.309175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.311278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.351221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.351741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.352189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.355002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.363062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.363559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.800118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:53.800732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:53.844235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.849330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.850457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:53.855777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:53.859489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:53.860373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:54.196106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.214996 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d9b98c7-5663-45d0-9806-1c15d84ee144 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 0.909692 Oct 04 18:10:54.225122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2057/4274] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:54.295923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.307310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.338539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:54.355410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a10b4798-8a52-4e9a-a037-f7c8bf530cfa tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.560465 Oct 04 18:10:54.368161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2218/4275] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:53 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:55.254940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.256863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.278570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.278570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.278570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.278570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.281626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.310396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.391891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:55.394195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:55.434974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.447057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.448588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.450080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:55.451158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:55.454713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:55.793451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.811349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.822828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:55.849551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6a26a96-e495-4144-8ad8-a45655ecf718 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.465884 Oct 04 18:10:55.854913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2219/4276] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:56.178672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:56.181558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:56.224614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.225279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.228430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.230550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.231996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.232682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.248369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:56.257580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f87a6b30-3036-4b21-aa49-9d3ccc1244e6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 1.009632 Oct 04 18:10:56.270247 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2058/4277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:55 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:56.331130 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c6a34b8-ce2d-4ef2-9116-c4dfe6830cf4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/ips" status: 200 len: 151 microversion: 2.20 time: 0.164004 Oct 04 18:10:56.342666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2220/4278] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/ips => generated 151 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:10:56.892461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:56.898647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:56.919993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.920679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.929877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:56.963431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:56.966073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:56.966790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.048568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc456396-c944-42e6-a70a-e8e92ea83ebc", "name": "network-vif-plugged", "status": "completed", "tag": "c2ffbefa-31d4-479b-8d7e-3084fe9be89d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.101369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.102186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.102810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.178090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] Creating event network-vif-plugged:c2ffbefa-31d4-479b-8d7e-3084fe9be89d for instance cc456396-c944-42e6-a70a-e8e92ea83ebc on n-h1-831194-21 Oct 04 18:10:57.186061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-beaef037-a986-490b-88ef-20d806173824 req-dfb98aa7-b27b-45a6-bf92-9b6c68e94fe1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143819 Oct 04 18:10:57.188519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.189067 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2221/4279] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:10:57.198214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.198848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1731436159", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b05bd8e-240d-49e1-9616-3083c9ab006c"}], "security_groups": [{"name": "tempest-securitygroup--1241590372"}], "key_name": "tempest-keypair-1945524168", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:57.205309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.232865 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9836f08a-87ac-4e45-a007-1a7a0a95e32e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.348983 Oct 04 18:10:57.240555 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2059/4280] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:56 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:57.298461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:57.299318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:57.310116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.316382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.317165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.321042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:57.325868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:57.326572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:57.750203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:57.762117 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4c9a866-52cb-4d88-91ef-bd98b672a2b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 0.468233 Oct 04 18:10:57.769091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2060/4281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:57 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:10:58.098180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:10:58.293301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.302336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:58.327794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.328610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.329213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.330184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.330786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.331358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.426198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:58.436729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:58.440061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:58.451829 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dac3bb8b-741a-41e2-8af5-bc14659f7124 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.182407 Oct 04 18:10:58.462663 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2061/4282] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:58 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:10:58.796397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:58.797357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:58.825816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.829349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.830224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:58.832805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:58.833283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:58.836714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.253156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.263056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7a0886c-56e2-4804-b06e-d9b962d12384 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1315 microversion: 2.1 time: 0.470634 Oct 04 18:10:59.275129 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2062/4283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:10:58 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1315 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:10:59.482298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:10:59.483638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.498391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.505789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.507983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.509568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.512530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.522627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.663051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.677418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.680279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:10:59.692719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e762a45-f0fd-4bbe-b588-4b07a25a8adf tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.212921 Oct 04 18:10:59.698279 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2063/4284] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:10:59 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:10:59.874224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:10:59.875135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:10:59.887675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.890477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.894934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.896645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:10:59.897327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:10:59.898019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:10:59.967445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lazy-loading 'flavor' on Instance uuid cd46ae90-7c6a-4cbd-8fc3-df795d4f846e {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:00.372901 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a20de351-b64f-444d-87a6-8a5ff489d599 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/action" status: 202 len: 0 microversion: 2.20 time: 0.503908 Oct 04 18:11:00.381534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] validate_networks() for [('5b05bd8e-240d-49e1-9616-3083c9ab006c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:00.388372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2064/4285] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:10:59 2022] POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:11:00.402538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.404204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:00.419655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.421482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.423406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.426090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.427422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.441667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.451733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:00.780545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:00.791861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19edac0e-b51d-427c-86aa-63f1703a3a7f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1502 microversion: 2.1 time: 0.401044 Oct 04 18:11:00.792789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2065/4286] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1502 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:00.798857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:00.799828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:00.820592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.825682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.826427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:00.829854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:00.830724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:00.831177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.254373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.268827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.277956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.280987 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d539d1d-04ed-4776-b0ea-ccea49cab779 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 0.485612 Oct 04 18:11:01.306010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2066/4287] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:00 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:01.324103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.330198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:01.344693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.347776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.348242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.348983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.350904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.363829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.440941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.463724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.465213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.471976 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5fbf3f4-c720-4eba-a290-0c2241fe09a1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.161808 Oct 04 18:11:01.472581 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2067/4288] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:01.502791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:01.504110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:01.507605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:01.508399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:01.509024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:01.534131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:01.553490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:01.559716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:01.578304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:01.582558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:01.701018 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b08d06c-4c0e-4eda-8041-c5a911175c31 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 4.501162 Oct 04 18:11:01.706613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2222/4289] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:10:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 4517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:01.718933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4b61a49-e242-4ba2-89b4-b23af5002206 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:01.720733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4b61a49-e242-4ba2-89b4-b23af5002206 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:01.848141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4b61a49-e242-4ba2-89b4-b23af5002206 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:01.855837 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4b61a49-e242-4ba2-89b4-b23af5002206 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1239 microversion: 2.1 time: 0.141221 Oct 04 18:11:01.860309 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2068/4290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:01 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1239 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:02.313813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.314475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:02.356266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.356774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.357220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.369300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.370062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.370531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.503743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.509438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:02.534862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.545801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.548468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.553192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:02.559122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:02.560650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:02.916239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.930149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.942718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:02.975207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c198fdb-883d-4ab7-b232-b64aa7e97e6e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.478220 Oct 04 18:11:02.976363 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2069/4291] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:02 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:02.990529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:02.992272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:03.004648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:03.006624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:03.011382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:03.012702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:03.013508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:03.014309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:03.353933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:03.368802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:03.386417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26f22d0f-6393-47b0-ad6a-4d0c4af059b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1243 microversion: 2.1 time: 0.406595 Oct 04 18:11:03.394712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:03.394971 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2070/4292] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:02 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1243 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:03.402414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:03.404125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ba91c60-58f8-493a-8b03-65ce4ba03998 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 1.096170 Oct 04 18:11:03.434207 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2223/4293] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:02 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:04.005076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.005856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:04.025296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.034234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.034708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.035478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.044358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.044849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.225085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.235589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.249000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.261343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cccacef1-b157-4bf5-9b1e-264086632573 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.260447 Oct 04 18:11:04.288898 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2071/4294] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:03 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:04.418236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.419563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:04.430854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.435045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.436174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.437369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.448973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:04.450201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:04.458243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.460426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.469574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.472123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.474021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.480297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:04.484565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:04.488603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:04.913143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.930731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.944100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:04.945759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4f2b23a-fc60-43db-a913-dbc434001e33 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 0.503547 Oct 04 18:11:04.959049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2072/4295] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:04 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:05.047363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:05.059716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ba6558cf-f57a-4bb8-9c70-a699108ed7d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1299 microversion: 2.1 time: 0.647047 Oct 04 18:11:05.060322 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2224/4296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:04 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1299 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:05.136062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f6e5958-8938-4096-a521-c8a9ca86d787"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:05.138680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:05.160890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.161627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.162267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.163171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.163784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.164377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.296910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.298097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:05.315278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.318135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.318605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.319376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.319849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.320298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.486324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:05.499977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:05.507229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:05.524990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d207c3c6-ac62-4b58-a869-49e84c8a0eea tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1533 microversion: 2.91 time: 0.232040 Oct 04 18:11:05.525592 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2225/4297] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1533 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:05.577696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.580018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:05.596766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.597278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.597722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.600480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:05.601570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:05.602227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:05.676984 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5cfb397f-9461-416e-9f33-718e4164307a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.542232 Oct 04 18:11:05.677679 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2073/4298] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:11:05 2022] POST /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc/os-volume_attachments => generated 194 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:05.993696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:05.995624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lazy-loading 'services' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:05.996041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:06.019446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.020375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.021110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.022128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.022992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.023970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.064458 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65d794e2-8e5a-4eee-aa12-5507957c2a19 tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1940 microversion: 2.91 time: 0.488035 Oct 04 18:11:06.065642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2226/4299] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1940 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:06.087246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:06.087929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:06.117146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.120309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.122972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.127706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.128241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.128693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.241752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.258889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a2d16f8-42c9-4bae-962d-65bb89ccc907 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1297 microversion: 2.1 time: 0.174645 Oct 04 18:11:06.261748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2227/4300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:06 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1297 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:06.276903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:06.277472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:06.312468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.313050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.316500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.320527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:06.321090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:06.325784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:06.443610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lazy-loading 'flavor' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:06.590685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.621782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.643711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:06.644772 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b94b454f-eb52-491c-900c-89beb74f4313 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 0.669626 Oct 04 18:11:06.645926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2074/4301] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:05 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:06.713188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:07.030549 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6d7146a-19c9-4275-9ec1-530882c59a13 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action" status: 202 len: 0 microversion: 2.91 time: 0.766884 Oct 04 18:11:07.031795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2228/4302] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:11:06 2022] POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:07.040739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:07.041638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:07.061934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.062959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.063874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.064805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.065438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.066685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.288313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:07.289355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:07.300747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.304367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.306695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.307569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.310299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.310858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.414687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:07.423761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:07.425226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:07.444915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75ca392b-9778-45a4-994e-505b52ef2281 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.408319 Oct 04 18:11:07.446873 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2075/4303] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:07 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:07.702181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:07.705176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:07.741478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:07.745222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.745740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.746218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.747140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:07.747763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:07.748367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:07.757132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17b30c55-1850-4679-be06-1a5df03b84fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1297 microversion: 2.1 time: 0.473412 Oct 04 18:11:07.757845 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2229/4304] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:07 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1297 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:08.041760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.061889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.064175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.069441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c537cff-3547-4408-82b7-c56b645ff596 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 0.373665 Oct 04 18:11:08.070436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2076/4305] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:07 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:08.492358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:08.493256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:08.512834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.513630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.514389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.517958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.519941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.523409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.684733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.696281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.698143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:08.707066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c31daed8-8fe4-4b2c-be2b-d33ef7a9dbbc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.220901 Oct 04 18:11:08.723665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2230/4306] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:08 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:08.787701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:08.789921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:08.806807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.809855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.810679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:08.811876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:08.813994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:08.814639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.093899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:09.098320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:09.099554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:09.120395 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a33c0c3-f175-4e22-85d0-c19e1ac105cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.336055 Oct 04 18:11:09.122528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2077/4307] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:08 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:09.137908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.142515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.146415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.147435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.148231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.149558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.738473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:09.740287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:09.759320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.762261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.763144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.767976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:09.768949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:09.769800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:09.949973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:09.964711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:09.968041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:09.979968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30db6c6d-7642-4cbb-9d85-b7d293516e9d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.246184 Oct 04 18:11:09.985861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2078/4308] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:09 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:10.092589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:10.115792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:10.138594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:10.145855 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4168beef-24bb-4f87-bfec-bc77abac6021 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 1.047319 Oct 04 18:11:10.145855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2231/4309] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:09 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:10.177201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:10.177846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:10.190015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:10.192912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:10.194733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.196131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:10.196981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:10.211280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:10.746647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:10.755053 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1bc60024-0645-428b-96be-33d654e4c863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.599126 Oct 04 18:11:10.764062 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2079/4310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:10 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:11.025421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:11.026364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:11.045385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.058140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.059106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.060603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.061244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.069095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.176292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:11.177581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:11.191116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.191961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.192617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.193547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:11.196331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:11.201679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:11.540886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:11.570929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:11.614733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.632385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.637671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:11.647277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18f44f45-3978-40e5-9503-093a9622b9cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1743 microversion: 2.20 time: 0.476605 Oct 04 18:11:11.651419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2080/4311] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:11 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1743 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:11.857066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:12.191644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:12.224177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.225040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.226663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.256997 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] Creating event network-changed:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:11:12.263850 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-dcf0d7b6-fd4b-4d3b-be18-ee0c7b29def7 req-bf0cf3b6-fdbe-46ac-9c33-9ce8432f4a7e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.608929 Oct 04 18:11:12.264916 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2081/4312] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:12.273529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:12.274664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:12.300859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.302398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.303694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.306190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.306946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.308770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.325567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:12.410861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:12.428845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:12.435993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:12.448784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:12.451138 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15fca95b-096c-4c51-b353-4a3f22a9e0ba tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 1.431443 Oct 04 18:11:12.452029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2232/4313] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:11 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:12.691974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:12.693991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:12.708893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.713517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.714293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.718511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:12.723285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:12.723754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:12.792631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:12.806579 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-752aa589-b94b-4f5f-a04e-54e952b09238 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.539628 Oct 04 18:11:12.822346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2082/4314] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:12 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:13.489439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.490168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.508902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.512962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.513501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.514318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.515170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.515867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.631138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:13.647350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:13.659904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:13.661305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82d4217a-53d1-4062-8e7c-09321452be7a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1743 microversion: 2.20 time: 0.974372 Oct 04 18:11:13.664206 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2233/4315] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:12 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1743 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:13.838899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:13.840502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:13.855402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.860437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.868890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:13.870080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:13.871754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:13.873424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.691190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:14.702746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adf1d82c-6551-4513-82a2-73c79c603937 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.867994 Oct 04 18:11:14.704162 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2234/4316] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:13 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:14.725922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:14.726851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:14.733323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.734327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.735003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.735950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:14.736633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:14.737292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:14.766519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:14.789168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:14.793373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:14.807580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ae6023f-0a5a-46d4-b0c4-e548737c4989 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 1.323986 Oct 04 18:11:14.809526 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2083/4317] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:13 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:15.200472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:15.229144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:15.240172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:15.247830 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-22f9b1c5-ce5d-435b-9387-7b15f1c3766e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.528131 Oct 04 18:11:15.252243 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2235/4318] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:14 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:15.732695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:15.733319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:15.745642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.746179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.749017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.754165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.755176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.755790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.845186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:15.854341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:15.887735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.894458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.895087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:15.896121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:15.896721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:15.897370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:16.154441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:16.190168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:16.192188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:16.212475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a985f79d-4c73-4068-bebd-19a6af5f44a6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.375184 Oct 04 18:11:16.213576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2236/4319] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:16.281619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:16.282470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:16.304466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:16.305125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:16.306883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:16.307989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:16.312774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:16.313554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:16.704825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:16.742029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6899b0b6-2e99-4b1b-af25-4ad9284c7ca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 1.011758 Oct 04 18:11:16.744359 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2084/4320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:15 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:17.229639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.247771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.248733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.270268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.271120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.271817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.272795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.274200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.275243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.316015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.333620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.360725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e147b27-ffb9-4d07-8eea-8d61814a36eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.059519 Oct 04 18:11:17.362966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2237/4321] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:16 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:17.582466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.598753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.604612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:17.662653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ea71c8d-149c-454e-a263-c1d69dd47521 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.419692 Oct 04 18:11:17.702239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2085/4322] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:17 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:17.770108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:17.771034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:17.793390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.794915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.795394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:17.799948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:17.801504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:17.802751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.046990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "name": "network-vif-plugged", "status": "completed", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:18.073269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.074051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.075299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.106409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] Creating event network-vif-plugged:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h2-831194-21 Oct 04 18:11:18.126692 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2e8916bb-b29e-4471-b181-6a865768e0ee req-a3a5e6ed-55db-4b8a-a9fb-684332a74533 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081683 Oct 04 18:11:18.134244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2086/4323] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:18.399551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:18.400555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.428130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.430658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.431811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.434415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.438931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.441306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.598805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:18.616264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-73f4a9cf-846c-4167-bd86-4d5f643d393b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.851626 Oct 04 18:11:18.616885 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2238/4324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:17 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:18.706089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:18.706997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:18.720007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.720862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.726946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.728075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:18.728774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:18.729474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:18.900666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:18.913120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:18.919622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:18.941370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01f3e3f9-d2a3-4666-818b-ae7386a80992 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.240726 Oct 04 18:11:18.953451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2239/4325] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:18 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:19.116743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:19.142600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:19.144731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:19.153572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c46ca95-d7bd-42f4-8df1-486bd83caa5f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.760048 Oct 04 18:11:19.170229 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2087/4326] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:18 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:19.647952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:19.649965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:19.676521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.678428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.679828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.681305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:19.684126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:19.685044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:19.914279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:19.932253 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1be37b9-4605-49b1-84f1-b071af156b8f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.290889 Oct 04 18:11:19.932880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2240/4327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:19 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:19.982746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:19.983668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.000327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.001757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.002448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.003379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.003852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.008668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.186132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:20.186763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.193499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.211070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.214155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.219990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.223463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.227328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.228289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.232526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.237166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.257029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1093a9f6-5691-417c-8888-6d4f5ab249b3 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.280184 Oct 04 18:11:20.264729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2088/4328] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:19 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:20.278097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-plugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:20.291756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.292690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.293338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.316853 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] Creating event network-vif-plugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:11:20.329792 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-527f8364-b693-413e-8b5d-6032f631c837 req-8eecc1d2-ff1e-4edf-b731-e32fb84a2441 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061979 Oct 04 18:11:20.336510 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2089/4329] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:20.348936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53524cef-b3cd-48c5-8ee9-47085f4ec750", "device": "/dev/sdb"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:20.358103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.376355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.379671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.380391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.381530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:20.385200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:20.387169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:20.687394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.699553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.704207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:20.709760 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5dae913-baf5-4bb7-a734-67fa2eabd6e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.525976 Oct 04 18:11:20.711984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2241/4330] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:20 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:20.962897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:20.965543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:20.978135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-010f5427-9ead-4a95-a7b8-fd1ecfdbcdc2 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "POST /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.636521 Oct 04 18:11:20.982832 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2090/4331] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:11:20 2022] POST /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff/os-volume_attachments => generated 194 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:21.002297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.003435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.004244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.007854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.009539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.013219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.285369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.287744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.298123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=93 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:21.300152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.300824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.301471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.302541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.303207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.303833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.362974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.383989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08c92aa1-ddf6-4e40-8c60-87c09a21c536 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1365 microversion: 2.1 time: 0.427589 Oct 04 18:11:21.398190 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2242/4332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:20 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1365 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:21.652583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.680730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.682693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:21.692005 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-734b9122-cf20-4ae5-bcc2-ddac680a7012 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.410954 Oct 04 18:11:21.763437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:21.763437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:21.780096 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2091/4333] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:21.800144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.800786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.801555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:21.825337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:21.826025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:21.826410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.421684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.427075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:22.455132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.458905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.460854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.465256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.467936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.475981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:22.483479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.537466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:22.557332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:22.567871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d351d012-b25d-4d94-a08c-77b129bca7e6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.825745 Oct 04 18:11:22.585642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2243/4334] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:21 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:22.821053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:22.822022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:22.854352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.864950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.868321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:22.869844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:22.876895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:22.880106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.164927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.179176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.224583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.226232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:23.239938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ef69069-ab75-4c19-90cc-2738bdf3af36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1553 microversion: 2.1 time: 0.822678 Oct 04 18:11:23.244669 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2092/4335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:22 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1553 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:23.254326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa4c6698-eef8-4d4f-893a-a9ce92c3e42c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1560 microversion: 2.91 time: 0.442852 Oct 04 18:11:23.289380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:23.289656 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2244/4336] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:22 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1560 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:23.290744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:23.301904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.303030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.304020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.305709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.306773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.307740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.630263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:23.630881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:23.632407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9304cc1-ff8d-425f-a664-cd7292dfe277 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.349718 Oct 04 18:11:23.633661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2093/4337] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:11:23 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:11:23.639077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.639944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.642839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.643674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:23.644155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:23.644599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:23.665686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:24.194349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.195106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.202243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.203036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.203641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.204598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.205213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.205894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.246824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:24.463334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c8429b0-60a9-453b-8c93-5f5c1bb100c6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 204 len: 0 microversion: 2.1 time: 0.272600 Oct 04 18:11:24.464512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2094/4338] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:24 2022] DELETE /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:11:24.474491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.475654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.485068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.486205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.486858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.488487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.489116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.489768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.849630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:24.865939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:24.871316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:24.878411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2945de28-49bc-45a0-98bd-40ac9dbe1c0f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.252257 Oct 04 18:11:24.908157 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2245/4339] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:23 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:24.915141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:24.928585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:24.946678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.951632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.955630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:24.959226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:24.964366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:24.964914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.352788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:25.367391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17daf52d-ad2e-41d0-8f3f-de647b814a2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1554 microversion: 2.1 time: 0.457983 Oct 04 18:11:25.369758 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2246/4340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1554 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:25.914372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:25.915705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:25.935892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.936692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.938129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:25.939095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:25.939733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:25.940342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.374057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.396062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.397562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.432843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ce400b5-05eb-47de-9573-755783018562 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1560 microversion: 2.91 time: 1.964237 Oct 04 18:11:26.433724 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2095/4341] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:24 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1560 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:26.451443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:26.466820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:26.484556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.494739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.498391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.499576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:26.500088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:26.504260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:26.932043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.954282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.955790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:26.963988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc562b39-166e-4e80-a350-2b2e9c0bc7dd tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.053683 Oct 04 18:11:26.968848 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2247/4342] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:25 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:27.479266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:27.479879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:27.524562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.525710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.526713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.528138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:27.537043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:27.537952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:27.894083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:27.909586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:27.918241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:27.944892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7908d152-9259-4abb-b2e5-2ff7d75ca16f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.473580 Oct 04 18:11:27.956528 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2248/4343] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:28.005044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.011927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:28.068978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.069486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.069962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.070682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:28.071139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:28.071562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:28.464075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.514125 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77efaf97-5a12-4640-896d-34d71fdf0f87 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1554 microversion: 2.1 time: 2.047838 Oct 04 18:11:28.540467 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2096/4344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:26 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1554 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:28.769024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.794990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.821266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:28.828378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c99e67ef-ae1d-43b9-aa7e-a5f0f740c7c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.826514 Oct 04 18:11:28.832536 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2249/4345] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:27 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:28.991835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:28.992475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.017646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.018181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.023262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.043631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.044342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.053801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.158147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:29.403027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.424120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.426454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:29.441364 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa743df5-672c-40d3-9392-21c2088e79e5 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.453852 Oct 04 18:11:29.450100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2097/4346] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:28 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:29.543975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.544977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.598121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.606572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.607259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.608981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.609746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.610619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.864083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:29.866012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:29.892494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.908438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.910464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:29.912439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:29.915173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:29.916350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.864998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.875178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.887828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:30.889106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c375c5f-a95e-4179-8777-d889c46b1bfb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.033239 Oct 04 18:11:30.894905 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2098/4347] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:30.924509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc456396-c944-42e6-a70a-e8e92ea83ebc", "name": "network-vif-deleted", "tag": "c2ffbefa-31d4-479b-8d7e-3084fe9be89d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:30.954344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:30.955395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:30.957798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:30.990121 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] Creating event network-vif-deleted:c2ffbefa-31d4-479b-8d7e-3084fe9be89d for instance cc456396-c944-42e6-a70a-e8e92ea83ebc on n-h1-831194-21 Oct 04 18:11:31.005249 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ae877b2e-3685-49ce-a617-d423158d5c03 req-717b594e-1bc9-4249-b8a5-87bcb380f648 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108869 Oct 04 18:11:31.006087 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2099/4348] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:31.021960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.022918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.033784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.034335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.034785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.035508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.044221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:31.044947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:31.157751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:31.169922 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28e2296b-559c-4d58-baad-77aea8fbe558 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1554 microversion: 2.1 time: 1.627147 Oct 04 18:11:31.173922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2250/4349] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:29 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1554 bytes in 1633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:31.933546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:31.952665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:31.961424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:31.999310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:31.999794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.006945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.008083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.011512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.016537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.073569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.075214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.096008 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb93c8a6-4b69-4253-9633-9fc9d6817ea2 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 1.086362 Oct 04 18:11:32.101575 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2100/4350] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:32.203511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:32.204608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:32.211429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.212285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.212961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.213972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:32.214649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:32.226064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:32.577851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.641557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.659066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.661185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13e55652-dd3e-4abc-883e-d5f6b03620eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.738671 Oct 04 18:11:32.677012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2251/4351] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:31 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:32.822064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:32.836170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40c8d776-7cc5-4d5d-9f90-c18ee739a091 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.637021 Oct 04 18:11:32.850394 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2101/4352] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:32 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:33.136814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:33.145966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:33.166214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.167107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.167923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.169193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.193850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.198436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.263920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:33.284070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.294876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.297434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.346316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] Creating event network-changed:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:11:33.362874 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-40f55d0c-789c-4983-98da-4e39de9a591c req-82a4cdb3-1751-4a14-b1e3-9a8aec9e28f0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102401 Oct 04 18:11:33.374181 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2102/4353] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:33.595758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.647927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.650835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:33.679844 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66938767-e112-460d-ac76-23d8e1489dcd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.550261 Oct 04 18:11:33.680464 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2252/4354] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:33 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:33.727889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:33.729021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:33.742084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.743597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.746543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.757817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.759226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.760423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.874044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:33.875946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:33.912735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.926209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.927361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:33.931234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:33.932319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:33.936176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.223917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.239150 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af2a5352-9544-49e3-ab04-fc5a6e532838 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.372990 Oct 04 18:11:34.239746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2253/4355] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:33 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:34.703068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.730705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:34.732682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:34.739560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.746022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.746777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.749613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.751146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:34.754630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:34.756638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:34.772750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:34.774066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5cabe2a-1110-453f-b075-faec0b0f4aa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.052575 Oct 04 18:11:34.774657 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2103/4356] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:33 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:35.169173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.237644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.239345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.281404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63505d96-e62d-4486-84cc-3cd8b81be013 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.554729 Oct 04 18:11:35.287927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2254/4357] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:34 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:35.290477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:35.291256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:35.325238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.333219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.336049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.337619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.338554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.339599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.560109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:35.570393 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efdd15df-e417-4d2c-8359-4ef8bc29f0f0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.306442 Oct 04 18:11:35.587550 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2104/4358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:35 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:35.821385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:35.823473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:35.838050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.841632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.844367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:35.845731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:35.847267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:35.848296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.318746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.320335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:36.331576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.337558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.338579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.339597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.340245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.340934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.539336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.555870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.557720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.572027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4da8862d-f646-41cf-92ff-6324dcc0a426 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.255978 Oct 04 18:11:36.572895 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2105/4359] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:36.601855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:36.605385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:36.615226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.616113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.624653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.626192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:36.628863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:36.629604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:36.838240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.850886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.853603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:36.855044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fcd16ca4-ddf0-4a52-a790-e38ea195a0dc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.043564 Oct 04 18:11:36.856940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2255/4360] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:35 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:37.199961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:37.273644 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f86206a-43d1-41b4-98c4-e369df7f0c56 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.672574 Oct 04 18:11:37.275351 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2106/4361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:36 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:37.617007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.618518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.634526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.635024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.644291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.650306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.650925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.654037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.910224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:37.911428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:37.947891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.948648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.955102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:37.956655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:37.957738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:37.958802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.011693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.030770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.040715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.066121 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3cea2f3-52a5-4645-8b9b-a9a87d2c19ae tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.454322 Oct 04 18:11:38.070028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2256/4362] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:38.319231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:38.320193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:38.334732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.339605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.342172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.345447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:38.350065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:38.350821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:38.507035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.517266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.526176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ee8f6ff-c0e0-460e-b10d-11b1797193d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.211391 Oct 04 18:11:38.527991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2257/4363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:38 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:38.529167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.533623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:38.540274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c5d4a4f-6eb5-48d7-9e5e-ec1e58552f99 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.633359 Oct 04 18:11:38.556022 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2107/4364] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:37 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:39.112882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.113494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.139725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.145359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.148785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.157439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.166938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.167656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.446166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.509495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.523519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.556896 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f60bd23-ae95-42ee-8f1b-6a5e85836b64 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.447390 Oct 04 18:11:39.563736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.564562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.567643 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2258/4365] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:39.600857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:39.602036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:39.610389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.615390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.616177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.617187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.617913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.618599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.640502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.641001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.644002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.644783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:39.645257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:39.647447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:39.941131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:39.954710 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bad14208-c007-471f-baf7-777a0b35f53d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.400527 Oct 04 18:11:39.961953 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2108/4366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:40.590705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.591383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:40.617528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.618168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.618778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.633939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:40.637079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:40.637367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:40.695793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.708993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.724552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:40.726747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4594d06-0a2e-481f-95da-42ea5b586de5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.156144 Oct 04 18:11:40.731867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2259/4367] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:39 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:40.987930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:40.988568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.007468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.011163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.011635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.023068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.023068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.023068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.254114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.274229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.290749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.319375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f4d8bac-8217-41c1-a645-39617b13fca4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.733082 Oct 04 18:11:41.325941 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2109/4368] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:41.732887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:41.766003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:41.767241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:41.787057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.790079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf022253-2bd7-4290-b00e-761e61ff88d6 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.796485 Oct 04 18:11:41.791558 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2260/4369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:40 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:41.796921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.797623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:41.802379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:41.803084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:41.804517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.175161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.194614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.199240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:42.202444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f29e3041-ec19-40a5-ba67-ca7bd345a0fc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.440741 Oct 04 18:11:42.232556 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2110/4370] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:41 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:42.359596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.360273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.378333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.380079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.382213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.387859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.388726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.397704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.829054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:42.830425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:42.861688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.863981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.865522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:42.870461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:42.872486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:42.873448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.240258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.270939 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30f53245-fb0c-48d2-a1ab-25e60e37146f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.448044 Oct 04 18:11:43.271586 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2111/4371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:11:43.314253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:43.315185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:43.358248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.359010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.359924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.366100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:43.368983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:43.370821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:43.663290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.668106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:43.692664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.701556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.726727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=76 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:43.730429 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbb387f6-b790-4cd9-8821-6fdd40d5092c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 1.376701 Oct 04 18:11:43.734153 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2261/4372] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:42 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:43.890678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.900480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.902782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:43.904223 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d3b8abd-45da-4982-94dd-490577fdf177 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.613807 Oct 04 18:11:43.908907 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2112/4373] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:43 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:44.307714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.308903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.330028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.330566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.331038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.331785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.332290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.332896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.783604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.785137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:44.846819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.847815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.850569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.855907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:44.857561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:44.859310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:44.914784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:44.956070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-74a0633c-3cbd-4dfc-bddf-45ef0b5af856 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.653753 Oct 04 18:11:44.968473 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2262/4374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:44.990613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:44.993347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:45.030878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.032171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.043219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.044180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:45.044853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:45.045655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:45.152810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.168689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.172279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.180867 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c99d1b0-c7ba-4d0a-bc55-44c8eb30e86f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.403057 Oct 04 18:11:45.207217 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2113/4375] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:45.722084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.732215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.743343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:45.762614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c483bc8d-c614-48e1-9819-5ff3e87392d9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 0.774462 Oct 04 18:11:45.765202 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2263/4376] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:44 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:45.997734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.001307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.043364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.044139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.044751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.047063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.052673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.053473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.229063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.230995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.254458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.254860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.255343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.256079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.256556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.257022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.357181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.375130 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bc04c68d-abe4-48f0-aeb1-8833fc1782fe tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.386387 Oct 04 18:11:46.376570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2114/4377] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:45 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:46.453643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.487673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.492814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:46.513756 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b90c7b6-14a7-4e63-a396-a559a195d2e7 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.290959 Oct 04 18:11:46.515610 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2264/4378] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:46.811341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:46.814746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:46.835047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.836316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.836958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.839087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:46.839790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:46.840425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:46.912954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:47.408431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.412477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:47.454675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.455733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.467902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.473998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:47.475126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:47.475739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:47.875402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.927568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.946192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.955715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:47.958285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b659cf17-5f60-4637-bcfa-e4be151a188c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1738 microversion: 2.20 time: 1.162207 Oct 04 18:11:47.963385 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2115/4379] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:46 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1738 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:47.984896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:47.985217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ae31695-4165-47cd-8a02-6cc5c2dd3ddf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1346 microversion: 2.1 time: 0.584465 Oct 04 18:11:47.985687 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2265/4380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:47 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1346 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:47.990700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:48.019649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.033451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.034758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.041546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:48.043181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:48.044321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:48.296480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.343669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.350791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:48.361440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70cba032-f225-4891-a66b-b5e3d847d35d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.392684 Oct 04 18:11:48.364550 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2116/4381] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:47 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:49.028467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.031594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.043737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.044590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.082019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.083368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.086707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.087620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.089276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.090098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.094943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.096066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.097550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.101043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.106141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.107159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.278695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.279461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.280915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.283253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'fault' on Instance uuid cc456396-c944-42e6-a70a-e8e92ea83ebc {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:11:49.664675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:49.688317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-696c997e-4bd4-4134-ad75-c545769f85ab tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 200 len: 1305 microversion: 2.1 time: 0.663710 Oct 04 18:11:49.692358 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2117/4382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 1305 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:49.714307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:49.715974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:49.736839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.738288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.742936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:49.744838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:49.746128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:49.748188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.172042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.202757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.214915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:50.236037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b8571d7-3b73-4ae1-9611-1ca6daa4c4fd tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.541123 Oct 04 18:11:50.258059 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2118/4383] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:50.742327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:50.747226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:50.776681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.781127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.782208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.783705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:50.798546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:50.803362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:50.899196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc HTTP/1.1 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'cc456396-c944-42e6-a70a-e8e92ea83ebc'} Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:50.904173 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:50.918155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fb253fa5-738e-482f-9a8d-8eb45d51a2b9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 404 len: 111 microversion: 2.1 time: 0.185925 Oct 04 18:11:50.921276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2119/4384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:50 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:11:50.970384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "name": "network-vif-unplugged", "status": "completed", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:51.036785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.037450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.038294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.192358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] Creating event network-vif-unplugged:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h2-831194-21 Oct 04 18:11:51.222835 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f6572256-b0c5-4762-8a23-6f1235c9bfbf req-129af2b8-69de-410b-92da-0ab12b292f73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.275669 Oct 04 18:11:51.230785 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2120/4385] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:11:51.304271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.308823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.351109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:11:51.359827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.374345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.375173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.394166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.395016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.399663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.753925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.781897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.787603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:51.799811 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-570d4038-1549-4ea6-bd6f-09b34991c180 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.515652 Oct 04 18:11:51.804941 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2121/4386] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:51.826628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:51.829515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:51.844350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.847986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.852017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.853292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:51.854323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:51.855535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:51.896732 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc/os-volume_attachments HTTP/1.1 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': 'cc456396-c944-42e6-a70a-e8e92ea83ebc'} Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:51.900827 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:11:51.905898 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:11:51.914929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:51.916185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a38d409-5e0b-4f12-b485-47347857655a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.108329 Oct 04 18:11:51.917333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2122/4387] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:11:51 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc/os-volume_attachments => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:52.206515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.260222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.298370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:52.300902 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26a000df-e14c-414f-abff-6e4d43f8081e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1720 microversion: 2.20 time: 3.281662 Oct 04 18:11:52.314931 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2266/4388] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:49 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1720 bytes in 3298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:52.543284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-196804433", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:52.743705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:52.859382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:52.860294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:52.871725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.873951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.875115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:52.877079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:52.880102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:52.881106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.081563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.111542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.113397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.131893 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9be5b09-572c-45b2-b155-e5d2007385dc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.277043 Oct 04 18:11:53.132715 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2267/4389] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:52 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:11:53.349742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:53.351099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:53.394094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.395234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.396038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.402846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:53.416726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:53.431817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:53.825724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.848080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.850174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:53.851729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b2625d8-1e60-4b1e-979e-6fefa7fc2186 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1720 microversion: 2.20 time: 0.507609 Oct 04 18:11:53.865860 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2268/4390] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:53 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1720 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:54.166471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.167351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.184591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.185084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.185535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.186420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.186883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.187464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.895247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.901352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:11:54.901816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:11:54.902306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:11:54.902725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:11:54.903270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:11:54.914067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.917703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:54.939440 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8bda139-f868-4dea-93b4-7f07fbd2bb84 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.778331 Oct 04 18:11:54.940883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2269/4391] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:54.946641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:54.947759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:54.957599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.958696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.959507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.962592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.963994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.964808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:54.988449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:54.989032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:54.989484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.006465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:55.007198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:55.018486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:55.175679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:11:55.265452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:11:55.367524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:11:55.373115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:11:55.568115 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdcf9648-67ce-4c5b-bbd2-e2a8e8678156 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.029718 Oct 04 18:11:55.573057 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2123/4392] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3035 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:11:55.587223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e280bc0-6ae3-4dbb-a935-aa12a61dafac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.588230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e280bc0-6ae3-4dbb-a935-aa12a61dafac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.784560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e280bc0-6ae3-4dbb-a935-aa12a61dafac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.800674 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e280bc0-6ae3-4dbb-a935-aa12a61dafac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a" status: 200 len: 1214 microversion: 2.1 time: 0.219853 Oct 04 18:11:55.805260 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2124/4393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:55.833662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84234785-5160-453d-be82-4bee5277f896 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.836374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84234785-5160-453d-be82-4bee5277f896 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:55.890734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84234785-5160-453d-be82-4bee5277f896 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:11:55.952546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.968389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.971901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:55.973672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58fb8d01-25a0-4bcf-a0de-ef9b90951c1a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1723 microversion: 2.20 time: 1.031619 Oct 04 18:11:55.976012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2270/4394] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:54 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1723 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:55.987442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:55.990401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:56.009181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.009687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.010289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.014252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.015829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.017365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.353011 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84234785-5160-453d-be82-4bee5277f896 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a" status: 204 len: 0 microversion: 2.1 time: 0.524558 Oct 04 18:11:56.362209 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2125/4395] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:11:55 2022] DELETE /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a => generated 0 bytes in 536 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:11:56.387669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3201a84f-6b2a-45c8-b1e0-af5d75f73915"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:56.400191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:56.425757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.427641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.428795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.433073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:56.434764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:56.436189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:56.864611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:56.899375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:56.912218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:56.957262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a30d228-ab21-4cbb-b332-7be3ac19047b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.977657 Oct 04 18:11:56.960348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2271/4396] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:55 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:56.983016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:56.984990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.008908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a HTTP/1.1 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0c68dce9-e008-454e-b6d5-76bd96a6326a'} Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:11:57.016178 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:11:57.021676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3171a766-c14f-465b-911e-913963343668 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a" status: 404 len: 111 microversion: 2.1 time: 0.056848 Oct 04 18:11:57.024273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2272/4397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:56 2022] GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:11:57.225273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1698680679", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:57.410021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:11:57.601667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9306f42-c3c1-4be4-81bd-b5ec9529903a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.236404 Oct 04 18:11:57.605091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2126/4398] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Oct 4 18:11:56 2022] POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 188 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:11:57.844941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:57.849341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:57.883961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.886930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.890286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:57.893326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:57.895935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:57.898571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.457709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:58.489512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84f90424-6109-440f-bfa0-7deaace317a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.650298 Oct 04 18:11:58.506518 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2127/4399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:57 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:58.539683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:11:58.540774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.558689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.559794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.561072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.565792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.566525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.567135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.623410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128850) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:11:58.862358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc6ba2ef-1394-41e5-8570-9b46eb75e29e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/action" status: 202 len: 0 microversion: 2.20 time: 0.353747 Oct 04 18:11:58.882419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2128/4400] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:11:58 2022] POST /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:11:58.895345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:58.895982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:58.957394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.957974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:58.963081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:58.968196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:58.990992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.016432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.175635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.187381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.190465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.200741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8875194-09dd-449b-a676-f1cb00b6e411 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.316865 Oct 04 18:11:59.214567 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2129/4401] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:58 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:11:59.226484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.230891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.247802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.255093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.255897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.256668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.257139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.257770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.625982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:11:59.637855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d731360b-a9c3-482a-8889-15fea9b87485 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.419839 Oct 04 18:11:59.639168 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2130/4402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:11:59.653657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:11:59.679399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:11:59.703713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.704223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.714360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:11:59.715121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:11:59.715600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:11:59.716064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.155074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.175250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.177291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.179540 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8dbddf0f-38b0-46df-909f-3550612491da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1749 microversion: 2.20 time: 0.538763 Oct 04 18:12:00.193855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2131/4403] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:11:59 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1749 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:00.193855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.193855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.195225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.196498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.203385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.203385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.203385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.203385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.409378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.423120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:00.426472 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90fd69f1-060f-48f1-94ca-3d0db9578797 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.244542 Oct 04 18:12:00.427152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2132/4404] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:00.453018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.453713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.464594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.465193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.465646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.466469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.467799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.468317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.564113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.586104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.587995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:00.601001 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18ac0d16-5833-449a-a228-f87121f9164d tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1555 microversion: 2.91 time: 0.153279 Oct 04 18:12:00.601705 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2133/4405] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:00.610594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-690523031"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:00.613332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.647244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.647893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.648453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.648892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.649455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.649895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.659691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:00.661479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:00.662301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:00.662918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:00.663553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:00.674374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.675252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.675963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.676895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:00.677612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:00.678394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:00.710329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:00.719136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:00.735138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:00.738282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:00.840826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-660ce269-2296-45b9-989a-50c756ad036b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.619969 Oct 04 18:12:00.849277 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2273/4406] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:11:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 3629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:12:00.870203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf8c02cb-f849-46ee-934c-edb2e2add5cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:00.870854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf8c02cb-f849-46ee-934c-edb2e2add5cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:00.986040 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13ede62c-4045-4f18-8047-3d9fb42c5e20 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.382571 Oct 04 18:12:00.991468 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2134/4407] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:00 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:12:01.212895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.213650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.228236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.230908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.231585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.234754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.237363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.238051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.480814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf8c02cb-f849-46ee-934c-edb2e2add5cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.509360 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf8c02cb-f849-46ee-934c-edb2e2add5cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1215 microversion: 2.1 time: 0.656207 Oct 04 18:12:01.510521 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2274/4408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:00 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1215 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:01.647262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:01.648065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:01.676354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.678019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.678698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.680853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:01.682052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:01.685122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:01.937603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.953307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.955163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:01.968190 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c0b72e7-fe94-4137-a15a-3a293b8ed8c6 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1537 microversion: 2.91 time: 0.333173 Oct 04 18:12:01.997511 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2275/4409] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1537 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:02.024217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.061578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.083785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.090304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c16a959-b746-455d-b105-50ffca567075 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1749 microversion: 2.20 time: 0.879966 Oct 04 18:12:02.093169 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2135/4410] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:01 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1749 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:02.609587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:02.612168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:02.630257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.631547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.633448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.634764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:02.635666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:02.636490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:02.727177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:02.749575 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3682dc4-fae1-43f1-92e6-75943f550662 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1219 microversion: 2.1 time: 0.194963 Oct 04 18:12:02.770531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2276/4411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1219 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:03.005109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.005941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.013703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.015621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.016275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.017212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.017914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.018734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.150280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.151097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.161184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.161852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.168880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.170649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.171888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.172650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.173006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.187712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.189248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.202727 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de2416b7-a616-46f2-a70c-10012a599923 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1537 microversion: 2.91 time: 0.201927 Oct 04 18:12:03.218061 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2136/4412] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:02 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1537 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:03.742440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.770142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.779667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:03.787479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56a57036-6057-40aa-8945-888e06c0d120 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1749 microversion: 2.20 time: 0.642098 Oct 04 18:12:03.792269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:03.794025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:03.820602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2277/4413] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1749 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:03.827814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.830492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.832748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:03.849429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:03.850216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:03.851760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.035730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.091261 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-31739485-1529-4268-9c78-b9fe541e7766 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1211 microversion: 2.1 time: 0.303048 Oct 04 18:12:04.109106 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2137/4414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:03 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1211 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:04.231304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.232220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.241062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.254830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.258318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.259252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.270355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.270355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.705959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.742270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.745108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:04.767722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0102356a-4a4a-45bf-8a73-59db5964d97a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1540 microversion: 2.91 time: 0.536204 Oct 04 18:12:04.770132 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2278/4415] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1540 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:04.815436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:04.831608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.834394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:04.835362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:04.851150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.860658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.864940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.872091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.874700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.875905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.879250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.893257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.893635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:04.895094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:04.895825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:04.896550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.090747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-831194-21". {{(pid=128850) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:12:05.160821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:05.397915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef1e86ce-b3ce-400a-9b79-da599245184e tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action" status: 202 len: 0 microversion: 2.91 time: 0.594617 Oct 04 18:12:05.408943 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2138/4416] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:12:04 2022] POST /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:05.442055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:05.443734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:05.484433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.487769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.488535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:05.489790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:05.490638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:05.491390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.150099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.165415 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82f00b7c-d06d-49e5-af2b-492acc50b722 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1285 microversion: 2.1 time: 0.754866 Oct 04 18:12:06.166150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2139/4417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:05 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1285 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:06.180473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:06.181135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:06.203910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.205340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.210904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.213166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:06.215865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:06.222276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:06.259125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:06.445481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.467311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.475349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.479812 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-023fbd4a-6276-410d-8722-bd862971b3bf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.651757 Oct 04 18:12:06.484958 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2279/4418] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:04 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:06.676316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.696054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.703417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:06.727249 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2683bd15-b759-4787-95f1-46ad6ef09ff1 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1488 microversion: 2.91 time: 0.558909 Oct 04 18:12:06.730175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2140/4419] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:06 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1488 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:07.196690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.204772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.226292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.240488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.251308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.258360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.262203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.270110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.513971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.515762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.529451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.537976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.538876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.540032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.540796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.541934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.799676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:07.823800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0cfa147e-5000-4b59-b418-fe2c0a2f5f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1273 microversion: 2.1 time: 0.627812 Oct 04 18:12:07.842772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2280/4420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1273 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:07.869152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:07.877936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:07.910257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.911051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.916324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.917853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:07.922662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:07.923368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:07.975191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:08.271414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.284709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.300276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:08.324989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c007967-5b46-4c03-869a-4ecea28a3e20 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1490 microversion: 2.91 time: 0.479120 Oct 04 18:12:08.338260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2281/4421] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1490 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:08.553865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-plugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:08.567340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.568309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.569065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.593244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] Creating event network-vif-plugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:12:08.610667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ef61b0eb-4ada-4102-831b-772d3ec909f0 req-f71bdce1-af51-496a-9c10-70693bd853f7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059499 Oct 04 18:12:08.612978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2282/4422] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:12:08.861032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:08.878622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:08.914152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.914679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.930306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:08.930306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:08.930306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:08.930558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.088297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.114329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.119156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.126496 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26e9b784-d46b-4675-bb71-542b35d8b83d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.616609 Oct 04 18:12:09.129090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2141/4423] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:07 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:09.365051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:09.366507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:09.390470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.393127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.394937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.416235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:09.418073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:09.422985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:09.951424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:09.959833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d419d0dd-9158-4edf-9880-715668f19286 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 1.110442 Oct 04 18:12:09.966465 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2283/4424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:08 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:10.159198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:10.160237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:10.182759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.183543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.187155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.188101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:10.190151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:10.191635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:10.701899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:10.855708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.866192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.884777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.890025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.894302 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2fa7aa17-9f44-4a06-974a-9f8545194cc7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.740711 Oct 04 18:12:10.894919 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2284/4425] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:10 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:10.911485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.921891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:10.963632 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16c48c81-2c4e-4676-bda6-19636635285a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 1.605484 Oct 04 18:12:10.969159 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2142/4426] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:09 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:11.010000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.010639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.042096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.053535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.055944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.061358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:11.061977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:11.066154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:11.495016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:11.925657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:11.947768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:11.956896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:11.980322 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01b88558-98b2-4679-ab52-e2efc9c91956 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 0.974704 Oct 04 18:12:11.996655 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2285/4427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:12.014515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.016632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.018831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.020307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:12.021074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.026545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:12.040389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.041421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.065708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.074002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.075168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.079933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:12.083960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:12.086358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:12.671140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.686049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.687782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:12.705582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0596c4dc-19f4-43db-bb57-e95d5a391d0c tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.688165 Oct 04 18:12:12.707658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2286/4428] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:12 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:13.040671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.044050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.090815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.099690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.104634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.110518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.115339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.118015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.630913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.673656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.696553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.703891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec74d097-1cf7-45e3-8112-62c34b613e07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.771383 Oct 04 18:12:13.707731 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2143/4429] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:11 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:13.744357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:13.768418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:13.771137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:13.795073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd6a9bc2-ab22-4ee4-82ed-fae2e75f9f0f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 0.761134 Oct 04 18:12:13.798586 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2287/4430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:13.825110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.826531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.827283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:13.828229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:13.828702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:13.829141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.187000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.207667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.209939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:14.258932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-613205da-034e-4654-a9df-3558194b290e tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.518126 Oct 04 18:12:14.259962 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2144/4431] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:13 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:14.409898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.412290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.432522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:14.439705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.443087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.451447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.453630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.454662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.455338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.740602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:14.741868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:14.783915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:14.791137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.791651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.792180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.797538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:14.800475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:14.802516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:14.828265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lazy-loading 'services' on Instance uuid 76480cd4-7c3e-456d-808b-51d47529efff {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:15.127008 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47c48dff-e10e-43dd-8093-1afb3b45a4f1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff/os-volume_attachments/53524cef-b3cd-48c5-8ee9-47085f4ec750" status: 202 len: 0 microversion: 2.1 time: 0.716697 Oct 04 18:12:15.132893 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2288/4432] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:12:14 2022] DELETE /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff/os-volume_attachments/53524cef-b3cd-48c5-8ee9-47085f4ec750 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:15.154231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.158310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.201022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.204242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.207707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.212529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.215358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.220542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.821760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:15.846672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17eeb758-a052-43de-8805-0df78c2c6263 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 0.707534 Oct 04 18:12:15.848681 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2289/4433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:15.886960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:15.892440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:15.927930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.931727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.934503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:15.935680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:15.943597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:15.944364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.433080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.468295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.479240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.510633 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc9caa4f-0446-44c8-8679-c0f618176ddc tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.660044 Oct 04 18:12:16.511431 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2290/4434] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:15 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:16.896108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:16.897235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:16.937883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.952497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.955527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.958332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.965514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:16.970950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:16.971723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:16.974596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:16.989598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.013322 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e72ac19-b38d-441e-9241-484fa3345daf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 2.263078 Oct 04 18:12:17.018754 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2145/4435] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:14 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 2283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:17.557567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:17.558663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:17.566814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.567675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.568550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.571269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.572510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.574862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.788700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:17.814966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59372bfc-0f92-403e-a807-cd21ce9f59fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 0.917504 Oct 04 18:12:17.841434 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2291/4436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:16 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:17.862155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4906c2e-85c2-4a22-9af8-54f87cd227ad", "tag": "a0b43ed9-82ef-4d9d-bd3b-6175adcfa611"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:17.891255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:17.903029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:17.906034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:17.970613 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] Creating event network-changed:a0b43ed9-82ef-4d9d-bd3b-6175adcfa611 for instance a4906c2e-85c2-4a22-9af8-54f87cd227ad on n-h1-831194-21 Oct 04 18:12:17.995188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f50cd6ed-27d9-49f6-8795-5bf9f5ce3521 req-e2918d2c-fde2-4262-82cb-37c219930db4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151787 Oct 04 18:12:17.996539 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2292/4437] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:18.051529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.052633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.071536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.083390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.086759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.091575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.099763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.100644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.339712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.345901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:18.352052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.371155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:18.431619 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-050a06be-2a15-405e-adc4-8341c0f0813a tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.877841 Oct 04 18:12:18.432348 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2146/4438] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:17 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:18.855033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:18.856824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:18.874038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.880271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.883071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:18.886310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:18.890562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:18.896547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.194263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.210372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.221811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:19.229077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77cedd7c-1848-4500-bd18-cfd4760f9e12 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.179525 Oct 04 18:12:19.230445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2293/4439] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:19.478120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:19.491406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:19.518378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.530012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.531300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:19.537490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:19.541511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:19.542247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.032496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.059291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.061667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.081361 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c055a534-4e9c-4cbe-bfbd-ed680438fb97 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.609342 Oct 04 18:12:20.086617 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2294/4440] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:19 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:20.158473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.172493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2004851-9ac7-457c-8328-82be1a89c369 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 1.327297 Oct 04 18:12:20.194260 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2147/4441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:18 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:20.259333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:20.260572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:20.276267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.282104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.287153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.288414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:20.289065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:20.291091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:20.747991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.765376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.766897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:20.768185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9b42313-02e5-4393-b571-83329489020c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.512816 Oct 04 18:12:20.768725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2295/4442] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:20 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:21.134910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.135535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.158778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.159990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.160606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.161563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.162264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.162859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.205212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.206150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.219166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.222269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.227145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.234597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.235378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.235995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.383934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.393684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.398936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.412297 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d41267d-482d-4215-b848-405f92d37116 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.282840 Oct 04 18:12:21.415903 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2148/4443] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:21.644490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:21.652694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25959efa-b375-40d1-bbee-1e064131e2bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 0.451724 Oct 04 18:12:21.662057 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2296/4444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:21.803315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:21.804209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:21.818619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.829569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.830308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:21.833562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:21.835736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:21.839907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.464113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.465156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.479553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.482445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.485477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.486828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.489934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.494483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.738582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.760791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.763432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:22.769476 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77fa4d5b-89f0-462d-adcf-e5c99e7b5db7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.970884 Oct 04 18:12:22.794079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2149/4445] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:21 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:22.799308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:22.805504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:22.833000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.834398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.835520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.837172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:22.838384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:22.855178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:22.994895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.006109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.016039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:23.043557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7dc0c47-4b7e-4faf-89e3-244e0f81fe00 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.582912 Oct 04 18:12:23.058894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2297/4446] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:23.814635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:23.826414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:23.862971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.887089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.889169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:23.890809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:23.892090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:23.893161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:24.002826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:25.187496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.217890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e718e7d-a9d8-4369-998f-911edaaa6d58 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 2.419671 Oct 04 18:12:25.233873 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2150/4447] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:22 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:25.246453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:25.252900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:25.273214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.274246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.275025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.275978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:25.276491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:25.277082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:25.593097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.658342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.662160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.673013 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-020d3b87-7210-400e-a785-267fd56aa222 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.874824 Oct 04 18:12:25.680174 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2298/4448] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:23 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:25.844736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.869448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.885239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:25.916594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84eee50a-17f1-4042-9a9a-ab61fffd9498 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.693566 Oct 04 18:12:25.931774 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2151/4449] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:25 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:26.260829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.261932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.314400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.317333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.318146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.319432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.320264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.321048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.361669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4906c2e-85c2-4a22-9af8-54f87cd227ad", "name": "network-vif-plugged", "status": "completed", "tag": "a0b43ed9-82ef-4d9d-bd3b-6175adcfa611"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:26.457929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.472586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.476690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.550442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] Creating event network-vif-plugged:a0b43ed9-82ef-4d9d-bd3b-6175adcfa611 for instance a4906c2e-85c2-4a22-9af8-54f87cd227ad on n-h1-831194-21 Oct 04 18:12:26.592627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6847547a-ecbe-4439-b957-bdf990f9e021 req-56ba7769-311c-4c29-af3f-3e53dc6288bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.249875 Oct 04 18:12:26.597898 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2152/4450] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:26.723924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:26.728063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:26.779723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.780370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.780837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:26.781608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:26.782123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:26.782551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.186898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.211099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.253194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c7c2081-4f8b-4102-af18-1584c488cd2f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 1.999090 Oct 04 18:12:28.270772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2299/4451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 2009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:28.270872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.270971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.272696 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc5097c6-15c0-4e78-b8d2-ca4f1db2ea2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.559166 Oct 04 18:12:28.273652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2153/4452] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:26 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:28.307863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:28.308510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:28.337346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.337692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.341305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.342235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:28.342751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:28.346471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:28.559283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.573551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.578416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:28.591213 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6661efd5-807a-486d-bfa9-734505d92fbb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.325280 Oct 04 18:12:28.591607 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2300/4453] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:28 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:29.290659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.292348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:29.308670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:29.310460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:29.320110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.323114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.324158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.325033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.326016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.328915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.329310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.330045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.331209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:29.331885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:29.335599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:29.336322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.280138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.292997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.323779 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f7b0d5f-5101-455a-b7ce-d4e1111cb5a1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1315 microversion: 2.1 time: 1.037157 Oct 04 18:12:30.325227 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2154/4454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:29 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1315 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:30.337439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.338967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.340194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e12b5c20-2eeb-47c6-9b35-618cec652aa9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.036275 Oct 04 18:12:30.360122 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2301/4455] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:29 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:30.369587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:30.370731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:30.395900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.400859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.403048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.406814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:30.409146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:30.414103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:30.806958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.837589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.840862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:30.867667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d7a0ff4-dcb8-433e-ae96-b70ec82e2756 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.539106 Oct 04 18:12:30.869061 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2155/4456] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:30 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:31.356899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:31.360557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:31.400547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:31.406433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:31.440237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.445572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.446833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.466781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.469608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.472044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.473155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.479840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.487871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:31.503945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:31.508211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:31.513800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.208042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.228626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.231497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.235617 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c87cf0e9-1ddc-45b9-ae2d-e27e19208d7b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.846274 Oct 04 18:12:32.240353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2156/4457] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:31 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:32.257618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:32.258669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:32.282126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.283377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.284517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.285622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:32.286572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:32.287723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:32.604593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.620975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.627058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:32.649990 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ce42d42-a0c8-49ec-8a48-2257c3002af8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.407925 Oct 04 18:12:32.667429 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2157/4458] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:32 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:33.272163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:33.272994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:33.294741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.295474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.296079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.297222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.298017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.298737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.357006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:33.425229 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14506a51-4230-4254-9aa2-32c61cf1f4b0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1502 microversion: 2.1 time: 2.059361 Oct 04 18:12:33.430509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2302/4459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:31 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1502 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:33.455807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:33.470413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:33.516175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.517508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.519640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:33.523656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:33.527219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:33.530206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.010172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-335898ab-b068-4feb-89ca-c9dc12edec72 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad/action" status: 202 len: 0 microversion: 2.1 time: 0.541375 Oct 04 18:12:34.014546 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2303/4460] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:33 2022] POST /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad/action => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:12:34.035294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.036391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.051754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.052456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.053152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.054600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.056970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.058677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.170580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.210310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.224878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.229302 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1377372d-418f-4e20-8a9c-0e47ce15b0ae tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.961905 Oct 04 18:12:34.242192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2158/4461] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:33 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:34.283635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.287004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.317598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.335707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.336502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.337459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.338205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.338969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.449772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:34.627661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.647567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.649329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:34.674575 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-207cd9ff-9007-4c1d-b5e0-8e1475763e88 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.657700 Oct 04 18:12:34.686899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2304/4462] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:34.694575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.696045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.726326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.735032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.735813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.737028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.737920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.738622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.742427 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d43ae99-ad60-4455-8759-fcc9825e2184 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "DELETE /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 204 len: 0 microversion: 2.1 time: 0.497705 Oct 04 18:12:34.752086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2159/4463] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:34 2022] DELETE /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 0 bytes in 508 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:34.768159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:34.775655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:34.797873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.798676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.799308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:34.800229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:34.800862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:34.801452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.367323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:35.378147 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa828bb6-7a31-4d1c-a11d-ca6811afb585 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1514 microversion: 2.1 time: 0.620986 Oct 04 18:12:35.394909 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2160/4464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1514 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:35.415245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:35.421128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:35.440120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.440861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.441433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.442346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:35.453373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:35.454235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:35.985735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.028619 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a36e7ba2-9b1a-4612-9039-9425991bb272 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1487 microversion: 2.1 time: 1.333657 Oct 04 18:12:36.030517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2305/4465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:34 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1487 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:36.040304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.041405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.051009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.051922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.052596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.053727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.054510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.055343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.114401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.156924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.166903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.174455 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a8e8df46-823d-4c90-aa8a-359e7ecd803b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.777564 Oct 04 18:12:36.205892 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2161/4466] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:35 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:36.214362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.215448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.238919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.251952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.252518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.257637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.258315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.258772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.338393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:36.358089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:36.521796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.537012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.546675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:36.563764 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48cfcfc3-1ed4-4aea-912b-f55d0280f3cb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.531376 Oct 04 18:12:36.566581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2306/4467] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:36.577282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.579943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.594397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.596150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.599179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.600241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.602666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.603947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.643253 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4475c0c4-7d9b-4b27-b3fa-3cb4ac5151c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 204 len: 0 microversion: 2.1 time: 0.449377 Oct 04 18:12:36.648137 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2162/4468] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:12:36 2022] DELETE /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:12:36.681714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:36.682796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:36.724023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.728888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.730130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:36.740432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:36.741602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:36.742580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.095169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:37.135374 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36ed6cc8-5c75-4646-b914-fac67b56fd5b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1493 microversion: 2.1 time: 0.456432 Oct 04 18:12:37.136388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2163/4469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1493 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:37.148453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:37.149114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:37.172256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.172799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.173280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.189990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.190527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.201921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.691478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:37.714834 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6b45e5df-6669-476a-b0dd-b27a20816bd1 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1514 microversion: 2.1 time: 1.143149 Oct 04 18:12:37.716746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2307/4470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:36 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1514 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:37.741926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:37.751495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:37.754234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:37.766708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.767860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.768730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.770156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.771297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.772194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.772930 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8510cc49-a229-47ea-8fe0-7b4bfba6a5b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.633803 Oct 04 18:12:37.791259 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2164/4471] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:37 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:37.812891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:37.813814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:37.829044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.832459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.833926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:37.842971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:37.844107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:37.845733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.134729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.155752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.163732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.195334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a339a5a-6f11-4747-96be-d40d278202b4 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.388731 Oct 04 18:12:38.196246 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2165/4472] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:37 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:38.211825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:38.222470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.257709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.263129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.266959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.269751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.270735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.275763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.702241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.736699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.747346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:38.747346 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db935c6f-47e4-4317-9188-1020ac3bfb23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 1.021729 Oct 04 18:12:38.770908 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2308/4473] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:37 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:38.798092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:38.799181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:38.810722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.812022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.813943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:38.815236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:38.815981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:38.818579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.585030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.604284 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f888cb22-5968-4b66-8f3e-7b0cde58fd4f tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1514 microversion: 2.1 time: 0.831444 Oct 04 18:12:39.608293 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2309/4474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:38 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1514 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:39.619922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.622377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:39.635681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.638164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.639488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.641530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.642094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.645059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.683499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:39.703178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-412dcee6-8b49-49a3-81f3-3d57bd23ad8f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1493 microversion: 2.1 time: 1.505097 Oct 04 18:12:39.705681 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2166/4475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:38 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1493 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:39.720887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:39.721948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:39.735475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.738837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.739751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:39.743180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:39.744071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:39.744856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.099476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.185543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.193204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.216823 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-20c91a6e-a413-4044-8d7b-8a5da466046f tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.509395 Oct 04 18:12:40.223009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2167/4476] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:40.248487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.260124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76480cd4-7c3e-456d-808b-51d47529efff", "name": "network-vif-deleted", "tag": "2407bf7a-52fc-448d-baae-9ebf047682a0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:40.284470 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec720d9b-5bf0-4454-8055-358e3f1703cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.674646 Oct 04 18:12:40.302030 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2310/4477] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:40.319997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.323792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.324653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.326944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.340834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.343031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.343566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.344060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.344784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.345299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.348022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.388712 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] Creating event network-vif-deleted:2407bf7a-52fc-448d-baae-9ebf047682a0 for instance 76480cd4-7c3e-456d-808b-51d47529efff on n-h2-831194-21 Oct 04 18:12:40.411564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4a7cb5b9-95e2-40de-bd84-fae9fbe6179f req-f15b0031-363a-430a-8525-734222a0cebf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184196 Oct 04 18:12:40.414972 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2168/4478] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:40.428687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-1013614911"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:40.434471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.450909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.451548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.453134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.454245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.455376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.455888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.781261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.808987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.811702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:40.813973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-904054a1-0031-461e-9afb-e7734b4d86b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1751 microversion: 2.20 time: 0.510298 Oct 04 18:12:40.815394 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2311/4479] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1751 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:40.822959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:40.825063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:40.836517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.837940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.838882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.840801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.841912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.843041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.928579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:40.929864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:40.930896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:40.931857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lazy-loading 'fault' on Instance uuid 76480cd4-7c3e-456d-808b-51d47529efff {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:41.026074 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03f2ed8e-f1c1-4e2c-899a-670a4702574e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.607949 Oct 04 18:12:41.026629 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2169/4480] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:12:40 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:12:41.031581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.048366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-unplugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:41.048941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb8992b3-ddee-4abe-bc1c-a67554cc4093 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 200 len: 1309 microversion: 2.1 time: 0.231258 Oct 04 18:12:41.050713 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2312/4481] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:40 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 1309 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:41.061087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.063084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.070340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.071226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.071906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.072834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.073540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.074345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.077711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.078319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.078755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.096108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] Creating event network-vif-unplugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:12:41.102067 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5d877a5c-9dcc-40f2-a196-f352651ef56f req-e8294879-a5f7-4edf-b26f-9329e496926c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073518 Oct 04 18:12:41.102992 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2170/4482] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:41.156508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.160818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:41.167004 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91a4b144-9954-4358-a467-12e0cfdec8ad tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1451 microversion: 2.1 time: 0.114373 Oct 04 18:12:41.167700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2313/4483] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1451 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:41.268553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.270007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.283521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.284565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.285544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.287023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.287940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.288786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.451816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.466307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.468435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:41.475217 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6515f887-62e6-4e13-a9e8-7c2d4be59e2b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.215466 Oct 04 18:12:41.476551 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2171/4484] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:41.615011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4906c2e-85c2-4a22-9af8-54f87cd227ad", "name": "network-vif-deleted", "tag": "a0b43ed9-82ef-4d9d-bd3b-6175adcfa611"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:41.674276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.675553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.676519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.707534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] Creating event network-vif-deleted:a0b43ed9-82ef-4d9d-bd3b-6175adcfa611 for instance a4906c2e-85c2-4a22-9af8-54f87cd227ad on n-h1-831194-21 Oct 04 18:12:41.718655 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-60914114-0e50-4e27-8c03-85f0d078eab3 req-717ed430-d93e-4cdf-b57c-fe07c43485cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110890 Oct 04 18:12:41.723333 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2314/4485] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:41.854970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:41.856582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:41.869848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.870574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.872687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:41.876023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:41.878660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:41.880368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.312523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.313144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: 76480cd4-7c3e-456d-808b-51d47529efff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.320705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.321208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.323327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.323327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.327614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.327614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.347795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] HTTP exception thrown: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Request method failure captured: Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff HTTP/1.1 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHZt6-cviBWGvSKTDlBvJ8psi6nfqg3_x0k5Oe1hY-qypvK0F_z1X5vwJOWOm_TZcHm2C0LSUq576mrRy1083rQkldLRvTFm1IbSJ7bdJcNEplpHUmiWzlttxTkvJP5rWSxUeaesgDYL5oYM5xNR_i6GxqcLQJiQSIrF3oBcLQx1oeU Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a3706a13ef744582bc31cafd160cb982 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3706a13ef744582bc31cafd160cb982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a3706a13ef744582bc31cafd160cb982 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesSnapshotTestJSON-1505069221-project Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: eb1b1bf1d54240339e6eca8fb18c593f Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505069221-project Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '76480cd4-7c3e-456d-808b-51d47529efff'} Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:42.350274 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Returning 404 to user: Instance 76480cd4-7c3e-456d-808b-51d47529efff could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3246384a-3268-41e4-ab26-ad0726d36807 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff" status: 404 len: 111 microversion: 2.1 time: 0.261486 Oct 04 18:12:42.364347 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2315/4486] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/76480cd4-7c3e-456d-808b-51d47529efff => generated 111 bytes in 267 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:42.369536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.372544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.388426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.389056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.389637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.390576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.391386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.392036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.457002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.458689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.459394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.460055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'fault' on Instance uuid a4906c2e-85c2-4a22-9af8-54f87cd227ad {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:42.561875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.591261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cda9cb09-2b38-4710-a12e-dd90a22f7356 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 200 len: 1305 microversion: 2.1 time: 0.230951 Oct 04 18:12:42.594391 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2316/4487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 1305 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:42.605584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:42.606840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:42.631627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.633578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.635094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.636177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:42.639999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:42.640772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:42.716901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.737657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.740861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.745292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f2f184bd-8e16-4220-9838-cc39e1366aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.902139 Oct 04 18:12:42.763626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2172/4488] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:41 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:42.977409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.995331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:42.998697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:43.007651 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54e8c522-61d3-4709-b373-251e9c09669b tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.411311 Oct 04 18:12:43.017273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2317/4489] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:42 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:43.616609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.617469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.628644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.638490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.639235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.640358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.641188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.641804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.691654 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad HTTP/1.1 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a4906c2e-85c2-4a22-9af8-54f87cd227ad'} Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:43.693370 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:12:43.699770 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:12:43.700868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:43.719723 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72b449fa-7bc7-4ddb-a648-3a2ab055fcf4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 404 len: 111 microversion: 2.1 time: 0.089530 Oct 04 18:12:43.722216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2173/4490] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:12:43.776581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:43.777392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:43.786291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.786783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.787502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.788385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:43.789007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:43.789600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:43.830053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-757423541", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:43.952426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:12:44.612118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.629708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.632408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:44.635516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d9beba9-f53c-49ce-862e-816c838321ba tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.862867 Oct 04 18:12:44.665456 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2318/4491] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:43 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:44.673467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:44.676624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:44.696829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=80 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:44.702539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.707356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.712717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:44.713858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:44.714569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:44.717307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.198821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.215932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.234783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:45.245920 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3a8e518-ae1c-4cde-a046-e15d35e7d2ff tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1546 microversion: 2.91 time: 0.578401 Oct 04 18:12:45.267832 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2319/4492] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:44 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1546 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:45.278712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:45.289319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.290105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.290830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.305351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] Creating event network-changed:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h1-831194-21 Oct 04 18:12:45.319431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cc83fb2d-2be9-4b75-850f-88ba1426a68c req-ca0c39a1-5dc4-44f1-a307-40ddad9b1341 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049768 Oct 04 18:12:45.320291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2320/4493] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:45.673810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:45.675021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:45.689208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.692681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.693293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.694216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.694798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.696204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.708391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:12:45.709367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:12:45.712147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:12:45.718496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:12:45.719443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:12:45.731119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:45.752416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.756445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.760004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.782902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:45.802768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:45.821187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:45.892861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:12:45.909807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:12:45.979825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:12:45.983291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:12:46.083813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-097bc103-3c43-4bb2-a41c-5b3aa9a85c21 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.257614 Oct 04 18:12:46.084946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2174/4494] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2260 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:12:46.098169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0fd0616a-b7ca-485b-ae44-50d364d96886 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.098979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0fd0616a-b7ca-485b-ae44-50d364d96886 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.284720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0fd0616a-b7ca-485b-ae44-50d364d96886 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.303215 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0fd0616a-b7ca-485b-ae44-50d364d96886 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1214 microversion: 2.1 time: 0.207866 Oct 04 18:12:46.305221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2175/4495] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1214 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:46.344134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.346526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.371697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.372446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.373131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.374408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.378586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.379995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.400452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.421134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.435789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.445992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81954a0b-88b6-46df-b49d-f6e1c6138e9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.775333 Oct 04 18:12:46.447395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2321/4496] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:45 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:46.640539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.665283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.673125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:46.693484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ba4931b-9a24-49b9-8387-561227f8cef8 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1533 microversion: 2.91 time: 0.369101 Oct 04 18:12:46.695883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2176/4497] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1533 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:46.764693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:46.765366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:46.793948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.794786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.795429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:46.796512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:46.799968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:46.799968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.128892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-plugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:12:47.154723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.155249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.158879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.203409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] Creating event network-vif-plugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:12:47.211326 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-57e2d92e-7cb9-4ce6-8f88-3bf52d1b392d req-2d069272-ac39-42c8-b6de-d547942b6f56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088064 Oct 04 18:12:47.213168 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2177/4498] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:12:47.347677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.359153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.397383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.400538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.404377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.409267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.412650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.413812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.523346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] Lazy-loading 'services' on Instance uuid f3a5c768-13bc-46a9-8353-bbbd0592685c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:12:47.612775 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-02c9acbf-8912-433b-b36a-ee6e4c056ecb tempest-UnshelveToHostMultiNodesTest-1898502535 tempest-UnshelveToHostMultiNodesTest-1898502535-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1940 microversion: 2.91 time: 0.864685 Oct 04 18:12:47.618990 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2322/4499] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:46 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1940 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:47.645389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:47.651418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:47.700068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.700716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.705104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:47.706373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:47.708538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:47.709856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.436795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.492728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.526207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:48.528511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f199cee-8435-4e27-a88a-815644aa4b15 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.907427 Oct 04 18:12:48.536614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2323/4500] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:48.544358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:48.546558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:48.576650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.577690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.578489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.579642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:48.580429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:48.581169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:48.651177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:12:49.031093 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-540e5515-f657-448d-b580-8d89d70bea71 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 204 len: 0 microversion: 2.91 time: 0.492080 Oct 04 18:12:49.039538 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2324/4501] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:12:48 2022] DELETE /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:12:49.076864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.081615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.128920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.130897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.137232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.138807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.139673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.156335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.170568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.193056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-994c5ee4-73f1-467b-b8ba-e0921f3b1f9d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1218 microversion: 2.1 time: 1.858082 Oct 04 18:12:49.209862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2178/4502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:47 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1218 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:49.596932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:49.617410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:49.648285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.651441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.653737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.657292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:49.658215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:49.658909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:49.721802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.734552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.745388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:49.769883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b70dd4a-0386-44db-a313-f117afe24fcb tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.724793 Oct 04 18:12:49.774236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2325/4503] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:50.229714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.230604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.241764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.242299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.242754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.243512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.243958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.262157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.816464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:50.827851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1db74b8-cec9-4295-b32c-a90ac1d8a2b2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1272 microversion: 2.1 time: 0.602382 Oct 04 18:12:50.832854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2326/4504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1272 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:50.846267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:50.847248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:50.864019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.864893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.866598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:50.867866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:50.872573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:50.873301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.486293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.522497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.525589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1998c08071e143489872cd9edc7be4c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c09e803f31b46119808db064f6a414d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:51.540590 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e4a7d06-6da5-467c-98ed-14adf63f8897 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 200 len: 1539 microversion: 2.91 time: 0.705981 Oct 04 18:12:51.560964 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2327/4505] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:50 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 1539 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:51.874331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:51.876052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:51.899084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.911859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.915156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:51.918595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:51.927848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:51.930584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.614421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.615937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.654504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.656109 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be8a1aed-3d87-48a3-8eed-97ab6b461fcf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1272 microversion: 2.1 time: 0.787228 Oct 04 18:12:52.656715 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2328/4506] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:51 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1272 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:52.678737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:52.679944 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7806409e-416e-405d-bc1c-775253553e10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 3.109832 Oct 04 18:12:52.680522 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2179/4507] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:49 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 3112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:52.696635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:52.697310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] [instance: f3a5c768-13bc-46a9-8353-bbbd0592685c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:52.725120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.728836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.748480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.749754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:52.750772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:52.755523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:52.831901 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] HTTP exception thrown: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Request method failure captured: Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c HTTP/1.1 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbfdJWII3NMFL5GeIvLFXxgHvbOWpQMHqkFNNqFesbciJzayllVc1VPY8GUV3ZXJiMdXM7Mds8ARJbECjU5nGMljqvwwGAyyOvYDT1lZAZkSjcODNcBJkzoMEVbGs3D0TB9g-sIE47Fg-81wbZyPSe9ZmCSLuJVA8-qXrLRFU8SsFU Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.91 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1c09e803f31b46119808db064f6a414d Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-543274663 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1c09e803f31b46119808db064f6a414d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c09e803f31b46119808db064f6a414d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1c09e803f31b46119808db064f6a414d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1c09e803f31b46119808db064f6a414d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-543274663 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1c09e803f31b46119808db064f6a414d Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-543274663 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-UnshelveToHostMultiNodesTest-543274663-project Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 1998c08071e143489872cd9edc7be4c0 Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-543274663-project Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'f3a5c768-13bc-46a9-8353-bbbd0592685c'} Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:52.835919 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. Oct 04 18:12:52.841143 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:12:52.847887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] Returning 404 to user: Instance f3a5c768-13bc-46a9-8353-bbbd0592685c could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:12:52.848818 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d7a5dd5d-ca45-488e-81be-68d6b2f37a91 tempest-UnshelveToHostMultiNodesTest-543274663 tempest-UnshelveToHostMultiNodesTest-543274663-project] 10.222.0.42 "GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c" status: 404 len: 111 microversion: 2.91 time: 0.183422 Oct 04 18:12:52.849647 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2329/4508] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:52 2022] GET /compute/v2.1/servers/f3a5c768-13bc-46a9-8353-bbbd0592685c => generated 111 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:12:53.713755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.715202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.716731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:53.718799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:53.735205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.736247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.738536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.743651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.744652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.745334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.764850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.771965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.772868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.785381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:53.786444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:53.791588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:53.916849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:54.315035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.399948 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e067756a-2d2d-4d56-8aba-3cce00f6960e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1272 microversion: 2.1 time: 0.695330 Oct 04 18:12:54.411638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2180/4509] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1272 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:54.467923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.488168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:54.506591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.516364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:54.521737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60a06f41-3c50-4942-8634-37612296b333 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.810520 Oct 04 18:12:54.524166 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2330/4510] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:53 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:55.443963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.449756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.484636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.486922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.488374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.492073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.497541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.500572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.563646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:55.575469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:55.596751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.597967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.598968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.600469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:55.603409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:55.608737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:55.852537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:55.880315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72fd913d-c575-41b0-a171-62e01578cf45 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1272 microversion: 2.1 time: 0.451898 Oct 04 18:12:55.881087 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2181/4511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1272 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:12:56.357171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.402913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.421964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:56.423725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43017d8e-1841-4e30-890a-cbeded872b44 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.871136 Oct 04 18:12:56.449870 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2331/4512] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:55 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:12:56.936536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:56.937548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:56.983284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:56.986120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:12:57.015100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.016058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.022443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.030049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.030803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.031495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.424448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:57.481611 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e2b86ee2-de39-4c43-9347-f5c6619403b1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1272 microversion: 2.1 time: 0.559958 Oct 04 18:12:57.482771 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2182/4513] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:56 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1272 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:12:57.508923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:57.528090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:57.544769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.548522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.550612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:57.553266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:57.556329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:57.558580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.376408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.396029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.409909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:12:58.413574 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-728ac527-fb9d-40c8-903e-810241b9dd07 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.939452 Oct 04 18:12:58.442995 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2332/4514] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:57 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:12:58.553718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:58.571507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:58.616626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.628324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.632261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:58.638525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:58.639386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:58.640050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.452929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:12:59.455915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:12:59.501049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.501985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.506589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:12:59.507623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:12:59.512168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:12:59.512858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:00.198215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.248548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.263491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:00.266111 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7499b89d-fc7c-422e-8e7f-ba84d29f637b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.821104 Oct 04 18:13:00.267420 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2333/4515] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:12:59 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:00.377080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1068750423", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "f6cbfb0b-9b0a-4b13-8edd-4bbe94a86bbf"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:01.320992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:01.352570 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a45dbc6-9b77-4596-8d7d-95f18751e27a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1314 microversion: 2.1 time: 2.817083 Oct 04 18:13:01.353583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2183/4516] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:12:58 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1314 bytes in 2820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:01.390345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:01.392404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:01.405149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.406133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.406954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:01.409139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:01.409943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:01.410778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.261623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.284225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.294977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.297909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d97cc9e-53e6-4264-9867-7021f5be0913 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.930170 Oct 04 18:13:02.318926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2184/4517] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:01 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:02.392351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:02.393425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:02.412916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.418657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.420930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.424600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:02.429243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:02.433354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:02.905327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:02.946636 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1967c71-3bc8-4517-8302-b40c30075ff2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1314 microversion: 2.1 time: 0.545029 Oct 04 18:13:02.949745 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2185/4518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:02 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1314 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:03.337787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:03.340097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:03.363001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.422394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.053s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.422394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:03.425410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:03.448093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:03.448093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.349265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.372980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.384259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:05.387353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d6e9636-2296-42c7-8974-086b9ca2a190 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 2.054302 Oct 04 18:13:05.390877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2186/4519] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:03 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 2060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:05.416476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:05.420150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:05.439570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.441152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.442192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:05.443973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:05.444974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:05.445615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:07.155630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:07.179916 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c1fa2e9-f541-4b9c-aa3d-e014ddc8a019 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1314 microversion: 2.1 time: 1.783706 Oct 04 18:13:07.181109 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2187/4520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:05 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1314 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:07.580293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf407fb5-a9cd-4123-9c81-444dd70cc1e4 tempest-ListImageFiltersNegativeTestJSON-736024027 tempest-ListImageFiltersNegativeTestJSON-736024027-project] Calling method '.version_select at 0x7fbdc1d21b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:10.210978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:10.456283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:15.438460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:15.938252 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-cf407fb5-a9cd-4123-9c81-444dd70cc1e4 tempest-ListImageFiltersNegativeTestJSON-736024027 tempest-ListImageFiltersNegativeTestJSON-736024027-project] HTTP exception thrown: Image not found. Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf407fb5-a9cd-4123-9c81-444dd70cc1e4 tempest-ListImageFiltersNegativeTestJSON-736024027 tempest-ListImageFiltersNegativeTestJSON-736024027-project] Request method failure captured: Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/images/b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5 HTTP/1.1 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHex8KD7zScNmKd-0YvfOFYmn_GZAddZ33Y_t5UJDtvoxSNSn5aknRr0yEmFCMjvmJEYhhz55a6Q6ZSKdQ_8BdkNWarHQJy5ZspEMTwY9d0AojlBibk2jKVXYvPt7Ogk4eEtZ9-zHlYRO3zpATxXJcKf_tcsZntDFQnC0pigXN0tBv8 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b04197a1b27a4b3bab04f0fb0f81c6a5 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-736024027 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b04197a1b27a4b3bab04f0fb0f81c6a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04197a1b27a4b3bab04f0fb0f81c6a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b04197a1b27a4b3bab04f0fb0f81c6a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b04197a1b27a4b3bab04f0fb0f81c6a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-736024027 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b04197a1b27a4b3bab04f0fb0f81c6a5 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-736024027 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ListImageFiltersNegativeTestJSON-736024027-project Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 5f44ee429cbe42f4abd539b0d82b8e49 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-736024027-project Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: exception: Image not found. Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5'} Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5 Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 04 18:13:15.996270 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5 could not be found. Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 04 18:13:16.005424 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:13:16.014050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf407fb5-a9cd-4123-9c81-444dd70cc1e4 tempest-ListImageFiltersNegativeTestJSON-736024027 tempest-ListImageFiltersNegativeTestJSON-736024027-project] Returning 404 to user: Image not found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:13:16.014050 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf407fb5-a9cd-4123-9c81-444dd70cc1e4 tempest-ListImageFiltersNegativeTestJSON-736024027 tempest-ListImageFiltersNegativeTestJSON-736024027-project] 10.222.0.42 "GET /compute/v2.1/images/b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5" status: 404 len: 62 microversion: 2.1 time: 8.830246 Oct 04 18:13:16.014050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2188/4521] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Oct 4 18:13:07 2022] GET /compute/v2.1/images/b3da9aa4-ea5e-4155-b8f4-ec8e7f31b7c5 => generated 62 bytes in 8831 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:13:16.032937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.037075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.066995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.076538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.084023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.085103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.086079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.086979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.200635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] validate_networks() for [('f6cbfb0b-9b0a-4b13-8edd-4bbe94a86bbf', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:13:16.427923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.439608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.441425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:16.442905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd7b6e88-41ca-4216-aa82-288b15befd23 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.419822 Oct 04 18:13:16.443956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2189/4522] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:16.454938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d582fff-6bfd-4a70-be3f-8cd352b53edb", "tag": "d655bf3a-c729-491c-a6fd-faf49054493f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:16.466875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.467666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.468370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.520174 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] Creating event network-changed:d655bf3a-c729-491c-a6fd-faf49054493f for instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb on n-h1-831194-21 Oct 04 18:13:16.534689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6581a30d-96ed-4087-9660-c423ede38312 req-021b35b2-a749-4791-b224-56963261e906 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086645 Oct 04 18:13:16.543086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2190/4523] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:16.552789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:16.557468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:16.589620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.590378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.590964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:16.592010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:16.592740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:16.593417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.067202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.079982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7fc2993a-ede0-4e97-8f34-47d74b2e20c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1314 microversion: 2.1 time: 0.531996 Oct 04 18:13:17.080686 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2191/4524] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:16 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.097944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.097944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.116618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.117124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.117570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.118666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.119133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.119640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.467665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:17.486193 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d75fee4-dff1-4c77-b499-6f44e98477b8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.403857 Oct 04 18:13:17.503262 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2192/4525] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:17.520663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:17.524147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:17.541538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.542312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.544592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:17.545556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:17.546267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:17.547044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.576310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:13:18.577414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:13:18.578051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:13:18.578751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:13:18.580551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:13:18.594112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.594636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.595076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.595807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.596261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.596688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.632198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.641972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Getting quotas for project a3706a13ef744582bc31cafd160cb982. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:18.653959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Getting quotas for user eb1b1bf1d54240339e6eca8fb18c593f and project a3706a13ef744582bc31cafd160cb982. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:18.669076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.671211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:18.672580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e498001-4856-40e4-944c-dcecb5df75df tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 1.168185 Oct 04 18:13:18.673651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2193/4526] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:17 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:18.674149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:13:18.676841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:13:18.679786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d582fff-6bfd-4a70-be3f-8cd352b53edb", "name": "network-vif-plugged", "status": "completed", "tag": "d655bf3a-c729-491c-a6fd-faf49054493f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:18.693703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.694390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.695094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.712245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] Creating event network-vif-plugged:d655bf3a-c729-491c-a6fd-faf49054493f for instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb on n-h1-831194-21 Oct 04 18:13:18.721924 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1ee1da68-2177-4868-ae40-8613c62aa48a req-8f80507c-40bf-4ce2-8ea2-2f93ef6d7c4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045619 Oct 04 18:13:18.723624 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2194/4527] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:18.737716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1724608936"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:18.745412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.759896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.763948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.765009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.765136 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a9ecd6e-ad2b-417f-b1b9-6877c9215aa4 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 18.395990 Oct 04 18:13:18.767716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.768507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.769270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.786347 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2334/4528] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:13:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 18418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:13:18.793657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:18.794543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:18.829539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.830378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.831098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:18.832543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:18.833247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:18.833947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.225134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4851bab7-b5e7-49a0-8e51-58dde2f21d46 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.484573 Oct 04 18:13:19.230335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.237727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2195/4529] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:18 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 04 18:13:19.247501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b9e7ba9-7704-4ed5-8c83-fd7660485c3b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1314 microversion: 2.1 time: 0.459899 Oct 04 18:13:19.248043 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2335/4530] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:18 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.257582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a81713e-cda6-46a0-8d72-92e0bc82c7ee tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.258315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a81713e-cda6-46a0-8d72-92e0bc82c7ee tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.278848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.279518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.304405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.308640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.310723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.311738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.312419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.312980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.442297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3a81713e-cda6-46a0-8d72-92e0bc82c7ee tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:19.464499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a81713e-cda6-46a0-8d72-92e0bc82c7ee tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1219 microversion: 2.1 time: 0.219094 Oct 04 18:13:19.465445 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2196/4531] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:19.720754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:19.721687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:19.734988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.735510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.735961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.736703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:19.737171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:19.737607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:19.993600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.007390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a6281fa-c7f3-4df2-a03c-a924a030db08 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.752962 Oct 04 18:13:20.015452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2336/4532] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:20.184306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.199602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.203655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.205051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdd8180d-d170-4a55-b06b-6f37362574e8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.488328 Oct 04 18:13:20.209639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2197/4533] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:19 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:20.280442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.281439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.301498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.302031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.311630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.313613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.314138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.314596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.488787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:20.489413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:20.503003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.503506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.503952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.504675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.505139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.505563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.603034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:20.612627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd101783-09d6-4f14-8319-62db5c14748c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1215 microversion: 2.1 time: 0.126908 Oct 04 18:13:20.630847 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2198/4534] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1215 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:20.788529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-unplugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:20.811773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:20.812684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:20.814353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:20.823094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:20.850327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] Creating event network-vif-unplugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:13:20.863026 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-51ce58df-0e4e-44fc-afc7-3e79a259e766 req-9edf7eba-059f-460a-9ed1-687abdbe6a8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078915 Oct 04 18:13:20.863751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2199/4535] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:13:21.059661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.065277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.096234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.096828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.097937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.098689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.099157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.099585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.382297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.397742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cacb8bf-70a0-459a-a387-4e38efd25ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1689 microversion: 2.1 time: 0.349341 Oct 04 18:13:21.400409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2200/4536] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1689 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.409003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:21.411265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.426425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.428148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.429264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.431434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.433234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.435074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.441935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:21.478127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f0925b9-332a-4cdb-81c5-97c1e30dc66e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1500 microversion: 2.1 time: 1.202079 Oct 04 18:13:21.508366 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2337/4537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:20 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1500 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:21.514904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:21.515780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:21.524915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.526291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.528301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.529496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:21.530201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:21.530837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:21.564189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'flavor' on Instance uuid 8d582fff-6bfd-4a70-be3f-8cd352b53edb {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:13:21.976439 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-243b97b1-4539-4577-906e-184d9d2a74df tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb/action" status: 202 len: 0 microversion: 2.1 time: 0.466211 Oct 04 18:13:21.981234 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2338/4538] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:13:21 2022] POST /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:13:22.014052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.018072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.030430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.031297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.031966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.032989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.033836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.035043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.042350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.062026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.067684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.072547 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-baa25b28-6338-420c-b852-aa9dc015f646 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.669443 Oct 04 18:13:22.075913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2201/4539] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:22.087901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.089781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.105966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.107913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.110700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.112496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.116525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.118255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.254076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.264937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3385aa0-1a45-41cd-9e13-ca155f45ab15 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1277 microversion: 2.1 time: 0.277047 Oct 04 18:13:22.266791 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2339/4540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:21 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1277 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:22.427953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:22.432563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:22.442348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.443606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.444243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.445558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:22.446301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:22.446901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:22.475440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:22.487417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9547690f-9c39-4697-8550-d6f9ad0a6747 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.409874 Oct 04 18:13:22.501862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2202/4541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:23.122328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.123788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.134108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.135392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.136109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.137015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.137657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.138236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.139505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.151174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9be26b24-9983-4a0d-aec0-bc2f39002d14 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1689 microversion: 2.1 time: 0.727087 Oct 04 18:13:23.155673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2340/4542] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:22 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1689 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:23.304348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.305345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.322767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.324012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.324814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.325951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.326891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.327592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.708042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.738005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.746292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.748066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4201ca2-c130-4b81-ac15-4de306cfaba5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.642015 Oct 04 18:13:23.775248 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2203/4543] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:23.782341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:23.794792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:23.831238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.832173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.832315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.832956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:23.833424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:23.838683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:23.843460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:23.852344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e9e1c1f-970d-43a8-ba59-a2411e450942 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1277 microversion: 2.1 time: 0.561432 Oct 04 18:13:23.852921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2341/4544] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1277 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:24.202163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.202790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.214021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.219702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.220675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.227135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.227937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.229819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.360676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.377965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a242ae98-cf82-4fad-b48e-d6d7951080af tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.595140 Oct 04 18:13:24.383946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2204/4545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:23 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.784323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.785344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.803345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.805493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.806242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.807596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.808344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.809016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.912488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:24.922581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0bc3db65-184d-4150-ae9d-3b36a7ae2be7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.725800 Oct 04 18:13:24.927063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2342/4546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:24.934369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:24.943732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:24.967391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.968164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.969003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:24.970244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:24.970878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:24.971491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.548196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.622925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.664104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:25.671639 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17ef1bd3-bc46-4472-b6a9-c2c110e490da tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.892827 Oct 04 18:13:25.685432 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2205/4547] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:25.736548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:25.751042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:25.837726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.845519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.846704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:25.865568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:25.866675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:25.867616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.027727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:26.074811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04e605ec-fa4f-4c93-829e-0af5acbdb363 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 1.145784 Oct 04 18:13:26.091597 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2343/4548] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:24 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:26.146974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:26.162710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:26.227682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.249269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.250911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.256986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:26.257815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:26.260235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:26.960633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.011976 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6dc1d470-65ed-4b7c-8a77-9c946d196c15 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 1.324768 Oct 04 18:13:27.036821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2206/4549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:25 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:27.064995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.071678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.114326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.120441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.125312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.127746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.131753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.132576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.753056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.777350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.784423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.786610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6cb67834-d104-445b-aea5-da4fe3d2fdd2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 0.743413 Oct 04 18:13:27.804193 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2207/4550] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:27.820651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:27.823365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:27.829715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:27.836366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.837995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.838849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.839763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:27.840460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:27.841041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:27.842297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-654bc62e-6c9e-474b-bd8e-a96341684971 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 1.748842 Oct 04 18:13:27.849480 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2344/4551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:26 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.068661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.069735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.088705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.091225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.091983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.099324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.105549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.106506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.596446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:28.612434 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e76d4036-20d0-4fee-8f20-9476ef44d42d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.548440 Oct 04 18:13:28.613635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2345/4552] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:28.625510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-plugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:28.649618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:28.656111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.656972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.658670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.674256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:28.706641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] Creating event network-vif-plugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:13:28.722359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f39190bb-e3ec-41fc-8ddc-43e369990599 req-89138b18-82d9-4cdb-9644-c7d6a7416011 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107358 Oct 04 18:13:28.723969 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2346/4553] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:28.823968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:28.825105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:28.842446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.843906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.844610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:28.845551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:28.846373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:28.847134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.457060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:29.504625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:29.516565 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53a9df94-2a6a-4e9c-a4a8-82c1ef15f146 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 1.710405 Oct 04 18:13:29.518224 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2208/4554] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:27 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:29.523687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:29.524707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:29.533440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.534286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.535208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:29.536113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:29.536857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:29.537455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.010652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.037105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d3c936b-c220-4a16-9b40-f8b46120780f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.517085 Oct 04 18:13:30.043566 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2209/4555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:29 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:30.062965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe59e570-f6ff-4945-85ec-026e8299b3e8", "tag": "d32f409f-081b-4424-81e9-949cc1adc08b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:30.087096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.089993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.093303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.125498 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] Creating event network-changed:d32f409f-081b-4424-81e9-949cc1adc08b for instance fe59e570-f6ff-4945-85ec-026e8299b3e8 on n-h2-831194-21 Oct 04 18:13:30.131736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.163212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.171118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:30.176585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-050fa1bd-1560-48ab-9b25-00c6a410d1da req-690626b9-348b-44f0-904e-37d8f4d94abf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128373 Oct 04 18:13:30.180417 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2210/4556] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:30.182172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-de82ae01-9690-4649-916c-c0b65d332098 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 1.359149 Oct 04 18:13:30.186689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2347/4557] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:28 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:13:30.213866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.215239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.240733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.248798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.249256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.256874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.261392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.262325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.547416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:30.548576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:30.564753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.577307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.578131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:30.579524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:30.581586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:30.582372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.054355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.134273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-646c7c6e-c568-4586-b4af-7c207421c950 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.946931 Oct 04 18:13:31.140987 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2211/4558] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.147016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "name": "network-vif-plugged", "status": "completed", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:31.203708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.206962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.212189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.259431 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] Creating event network-vif-plugged:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h1-831194-21 Oct 04 18:13:31.281027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d87343dc-534a-453f-b58b-0f9ada2d3d54 req-59a15176-fe85-43ed-84b0-eaff450d7c99 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129651 Oct 04 18:13:31.281027 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2212/4559] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:31.305062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.306590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.318716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.325760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.326584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.328173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.328864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.329507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.848075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:31.863195 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ed0ab43-81da-4fe7-ae98-81bdd73e5940 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 1.320222 Oct 04 18:13:31.873646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2348/4560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:30 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:31.897999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:31.898835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:31.916453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.924821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.932028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:31.933912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:31.938660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:31.952403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:32.964523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:32.997067 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79bfcc84-a1db-4019-b98d-1f2e68277129 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 1.701115 Oct 04 18:13:33.000335 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2213/4561] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:33.017297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.019762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.038325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.039070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.039858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.041515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.042371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.048401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.263597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.283303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:33.310982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.333265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:33.341356 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7f26e91-df8e-439e-88f1-fe5332c45598 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 1.463278 Oct 04 18:13:33.348367 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2349/4562] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:31 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:33.377275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:33.381050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:33.434398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.440891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.441373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:33.443282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:33.450610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:33.452867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.002236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.018450 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63148de6-57fc-4d30-ac21-f9426c3e27ee tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 1.013602 Oct 04 18:13:34.019586 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2214/4563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.031888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.045458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.059677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.061952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.065152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.066280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.066996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.071990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.179746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.192451 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5c9728d-bc3f-4a23-886f-b28465a5e616 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 0.839951 Oct 04 18:13:34.195747 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2350/4564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:33 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:34.379749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:34.380688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:34.398426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.402765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.406570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.411822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:34.418429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:34.419087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:34.556926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:34.574470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d48bdbe-7497-4581-826e-d7feac5fdbed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.548021 Oct 04 18:13:34.578107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2215/4565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:35.059588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.060264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.086067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.086757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.087212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.095806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.096279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.118317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.725369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.752988 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7dfeae84-a198-4254-a3d8-5de894d43efc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.697482 Oct 04 18:13:35.753417 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2216/4566] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:35.775774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:35.777802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:35.790632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.791150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.792188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.794453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:35.799230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:35.799993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:35.957921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:35.994138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.005330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.011041 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96008fff-b0e4-4b0e-a93b-a09fa2e3a96e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1807 microversion: 2.20 time: 1.633932 Oct 04 18:13:36.012854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2351/4567] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:34 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1807 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:36.033775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.037089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.060972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.061522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.062012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.062769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.063227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.063661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.770678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:36.776628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:36.779290 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75c42080-e568-4aa6-90c5-a7ac5d96bc86 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 1.022208 Oct 04 18:13:36.802153 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2217/4568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:35 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:36.807576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:36.816397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:36.843164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.854716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.855459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:36.858949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:36.859836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:36.860508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.186801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.211579 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03087aa2-7851-448f-a997-534f18341d36 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 1.196411 Oct 04 18:13:37.215196 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2352/4569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.226036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.233696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.256333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.258301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.260071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.263255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.265512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.266548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.433481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.459856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c62afd7-e9bc-44fd-811f-0db68cf41f0d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.654624 Oct 04 18:13:37.460729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2218/4570] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:36 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:37.617018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.632338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.633893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:37.635670 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7d01fb2-a8ec-446b-85b7-bd4e8cc37cda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1794 microversion: 2.20 time: 0.419100 Oct 04 18:13:37.636242 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2353/4571] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1794 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:13:37.721113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe59e570-f6ff-4945-85ec-026e8299b3e8", "name": "network-vif-plugged", "status": "completed", "tag": "d32f409f-081b-4424-81e9-949cc1adc08b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:37.740506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.741115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.741651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.778341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] Creating event network-vif-plugged:d32f409f-081b-4424-81e9-949cc1adc08b for instance fe59e570-f6ff-4945-85ec-026e8299b3e8 on n-h2-831194-21 Oct 04 18:13:37.798070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7aea95af-2b0c-4c1e-ad84-db8d1b784449 req-71370260-1d5f-4ce6-82ca-02de8d507693 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076780 Oct 04 18:13:37.801622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2219/4572] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:37.830436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:37.831299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:37.852287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.853492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.857237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:37.858711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:37.868026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:37.871770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.248156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.248880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.263933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.272499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.275985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.280434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.281250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.284482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.647725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.670314 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff820389-aa99-4eb2-b839-8aeedbfef24c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.426431 Oct 04 18:13:38.673044 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2220/4573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:38.697687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:38.700251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:38.727059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.732058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.735923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.738467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:38.742911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:38.746416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:38.780654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:38.804087 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a711b85-72c3-4bbd-8749-b73ea7927348 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1319 microversion: 2.1 time: 0.977766 Oct 04 18:13:38.810185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2354/4574] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:37 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1319 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.145823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf05d540-9b50-43e7-9718-c6ce71d96250 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Action: 'create', calling method: .version_select at 0x7fbdbc6989d0>, body: {"keypair": {"name": "tempest-keypair-552607531", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv0KWdk8vd1YfuevIt/0Xnu2gzGfAM+nuQ66xkEY3unawHaKd0P/QsTY2wYC7OsaQ5lTJtmAWeA1NNoMjPBLQOvzK3OAkgtM4OOlO7YCOPdSOt2x2R6imc+dS7qaFjpMA=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:39.194685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cf05d540-9b50-43e7-9718-c6ce71d96250 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for project 9c8c65acdbfa4c549b971ebb407a215c. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:13:39.204692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cf05d540-9b50-43e7-9718-c6ce71d96250 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for user 4d9ea32e30bb4c9a9389b2b0e7318d44 and project 9c8c65acdbfa4c549b971ebb407a215c. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:13:39.272893 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf05d540-9b50-43e7-9718-c6ce71d96250 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.461124 Oct 04 18:13:39.273792 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2355/4575] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:13:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:39.669698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:39.689664 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2505394e-469a-4091-8824-8baba18c9909 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 1.014645 Oct 04 18:13:39.692062 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2221/4576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:38 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:39.707831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.708742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.734835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.739167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.745910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.748505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.749699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.751773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.837155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:39.839786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:39.850585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.851435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.852096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:39.857851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:39.859054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:39.859738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.315314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.332749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60d1e2d5-eaac-4e5d-ad6f-f26a0092cc41 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1509 microversion: 2.1 time: 0.499695 Oct 04 18:13:40.368034 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2222/4577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1509 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:40.397612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cbab49f-bb14-4da7-85b5-ac0f71629a07", "device": "/dev/sdb"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:40.438204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.458676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.459271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.478661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.480678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.485000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.486541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.597338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:40.610100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0bae8771-f7d6-42e0-9622-cd8f04587fff tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.906265 Oct 04 18:13:40.613188 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2356/4578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:40.723232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:40.724258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:40.733666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:40.764640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.766571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.768079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:40.771347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:40.772268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:40.790900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.082455 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78563670-6c21-4890-8a85-070d486792b5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "POST /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.710481 Oct 04 18:13:41.084516 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2223/4579] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:13:40 2022] POST /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8/os-volume_attachments => generated 194 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:41.202176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:41.224066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60c8ea73-953b-41e9-a70d-067efc23a275 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.508367 Oct 04 18:13:41.237093 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2357/4580] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:40 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:41.640525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:41.641663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:41.658702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.662575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.663327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:41.666772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:41.667592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:41.668267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.250966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:42.251577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:42.263253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.266724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.267353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.268281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:42.271049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:42.272178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:42.784797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:42.797348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-281ab342-9741-43a3-960d-0051b2c6b560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.549548 Oct 04 18:13:42.800246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2358/4581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:42 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:43.122125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:43.133089 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7bbad0ca-d2a3-40d3-a890-632d51059fc3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 1.499330 Oct 04 18:13:43.141818 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2224/4582] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:41 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 1509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:43.827330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:43.828110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:43.839207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.859035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.859873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:43.860896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:43.861462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:43.862040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.163341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:44.164761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:44.187221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.190174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.194910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.196043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:44.197681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:44.199337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:44.618116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.637078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7bb67413-2dde-4dbf-93b3-3f4d475c5612 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.813520 Oct 04 18:13:44.637987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2359/4583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:43 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:44.658364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:44.669266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-521b011a-fd8a-4e98-a251-d61b43c37942 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.516228 Oct 04 18:13:44.688636 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2225/4584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:44 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:45.666154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.667433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.676227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.677003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.677617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.678559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.679395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.680248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.698448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:45.699769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:45.708180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=77 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:45.735291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.751052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.751637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:45.752495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:45.753185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:45.753892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:46.099127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.116701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5cffd59-a614-4595-be63-dff5688cf7d8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.424710 Oct 04 18:13:46.135865 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2226/4585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:46.856208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:46.899055 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fdf5211b-8145-43fc-ad67-6c5d4e1442c2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 1.211815 Oct 04 18:13:46.920525 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2360/4586] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:45 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.152662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.153292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.168089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.168601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.169084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.169777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.172733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.178022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.724074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:47.733162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84635282-3be7-46fe-9c5a-f83100490dfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.585535 Oct 04 18:13:47.733791 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2227/4587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:47.950930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:47.953387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:47.981995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.982519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.982997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:47.984432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:47.984901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:47.985497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.444084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:48.455507 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-017e314a-6c88-45a8-ad0d-4c2e957b8a09 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.510640 Oct 04 18:13:48.458786 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2361/4588] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:47 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:48.764050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:48.764679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:48.780664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.781942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.784661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:48.785448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:48.785954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:48.786403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.216860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:49.246861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2971dace-996e-4ff2-8cf7-49132aab5b63 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.486383 Oct 04 18:13:49.270158 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2228/4589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:48 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:49.484661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:49.485919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:49.489002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:49.538810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.539441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.539981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:49.541093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:49.552948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:49.553526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.189140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:50.202993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a612ece-261c-4e88-8825-b168b63f7975 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.722335 Oct 04 18:13:50.209970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2362/4590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:49 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:50.275739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:50.276375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:50.308549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.310152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.312037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:50.314133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:50.314758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:50.315263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.089737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:51.119640 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c01ff012-a818-41ea-b555-f3c68c5cf751 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.843152 Oct 04 18:13:51.131966 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2229/4591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:50 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:51.239703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:51.240692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:51.263953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.270683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.272888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:51.276434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:51.280319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:51.282593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.039214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.070026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e85d32f-a558-453b-94b9-1332a15161f1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1506 microversion: 2.1 time: 0.834434 Oct 04 18:13:52.073608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2363/4592] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:51 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1506 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:52.167824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:52.168621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:52.187585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.191766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.193160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.198617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:52.201980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:52.202632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:52.959972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:52.977049 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b36ce20-0db2-4505-9859-6594aff66ba4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.813304 Oct 04 18:13:52.977684 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2230/4593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:52 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:53.106517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:53.108000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:53.129340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.129890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.130334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.131083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:53.131570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:53.131995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:53.567167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:53.577332 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9d691a4-1ab0-422f-b736-21f74d41e3d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1527 microversion: 2.1 time: 0.479679 Oct 04 18:13:53.597911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2364/4594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:53 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1527 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.008890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.013576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.034950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.043362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.048645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.049624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.050233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.050755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.619744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:54.625578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:54.631528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:54.650392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4953bd57-7d51-4312-a4dc-6497a37a8c51 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.642921 Oct 04 18:13:54.654494 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2231/4595] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:54.665319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.671199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.672942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:54.678154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:54.680315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:54.682510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.172486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:55.194396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2af2504c-c0a8-41af-bfd7-7a1d3cc9d3fb tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.593269 Oct 04 18:13:55.209411 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2365/4596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:54 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:55.682953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:55.684272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:55.698477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.708723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.716550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:55.718561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:55.726777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:55.732521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.229495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:56.230121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:56.269193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.272049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.281279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.287019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:56.287536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:56.287993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:56.398614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:56.411706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d768c6c7-c4aa-400c-a56a-b9d512169aac tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.732663 Oct 04 18:13:56.415065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2232/4597] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:55 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:57.443589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:57.445502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:57.460985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.465546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.473936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.475006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.475652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.476496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.503029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:57.541634 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aad48b82-e4a7-4774-a8e8-d006f1e5f536 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.314265 Oct 04 18:13:57.562230 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2366/4598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:56 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:13:57.715923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d582fff-6bfd-4a70-be3f-8cd352b53edb", "name": "network-vif-plugged", "status": "completed", "tag": "d655bf3a-c729-491c-a6fd-faf49054493f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:13:57.728297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:57.731912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:57.734219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:57.767442 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] Creating event network-vif-plugged:d655bf3a-c729-491c-a6fd-faf49054493f for instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb on n-h1-831194-21 Oct 04 18:13:57.781121 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c50aab79-4efc-49bc-8671-d693ef6ce2d4 req-8261e70f-9c5c-4930-8d43-3f2be9ac8f12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069273 Oct 04 18:13:57.782272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2367/4599] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:13:58.001718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:58.005869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:58.021351 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8074d6ab-0901-4fff-9cb5-a81b648dfff1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 0.583436 Oct 04 18:13:58.023376 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2233/4600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:57 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:13:58.577157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:58.579127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:58.597587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.600379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.601174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.605113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:58.605889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:58.606608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:58.630328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:13:59.070034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:13:59.072753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:13:59.125629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.132105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.132687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.139290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:13:59.139891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:13:59.140355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:13:59.315226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:13:59.354053 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-52a3d8fb-9462-455e-8c4b-1e82c52c94ed tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.780449 Oct 04 18:13:59.363762 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2368/4601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:58 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:00.247083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:00.269161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-952e3993-078e-4882-bc40-cc14a7753af9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1684 microversion: 2.1 time: 1.220758 Oct 04 18:14:00.272109 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2234/4602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:13:59 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1684 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:00.389062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:00.393029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:00.425542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.427291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.429546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.431447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:00.434598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:00.441090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:00.926040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:01.032797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe4d9377-15cd-4f77-90f3-c3f658e1601e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.652032 Oct 04 18:14:01.052574 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2369/4603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:00 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:01.321517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:01.322432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:01.347827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.350059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.350530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:01.358004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:01.359861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:01.360357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.085678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:02.088007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:02.119278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.122020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.122636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.124446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:02.126506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:02.127907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:02.328244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:02.360602 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a108677e-3e37-42ed-9ce0-099c90da8777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.054012 Oct 04 18:14:02.371100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2235/4604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:01 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:03.666558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:03.713774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f48a287c-7a6b-43d4-8311-0fdcf10db18a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.629694 Oct 04 18:14:03.722267 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2370/4605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:02 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:04.755526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:04.757937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:04.842109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.843566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.845519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:04.851549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:04.862126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:04.870560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.115062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-unplugged", "status": "completed", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:05.156460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:05.157994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:05.162323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:05.212381 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] Creating event network-vif-unplugged:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:14:05.227658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7967b581-6751-4d15-a32b-c1dc842154a2 req-ac6c772e-5b79-43a9-8f4d-311fc8e92397 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129030 Oct 04 18:14:05.237249 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2371/4606] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:05.556869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:05.583188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56931d0c-10b2-4699-ae2b-fbac6e87d36b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.838311 Oct 04 18:14:05.589880 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2236/4607] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:04 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:06.645532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:06.651812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:06.693096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.694312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.695153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:06.703035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:06.704711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:06.706154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:08.718880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:08.740133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c052c520-148f-4ace-966f-c319aee68e00 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 2.108494 Oct 04 18:14:08.746554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2372/4608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:06 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 2115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:09.828922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:10.268137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:10.282477 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a2396096-6183-4d1b-b977-9c025d56505e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.505098 Oct 04 18:14:10.283988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2237/4609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:09 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:10.993440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:10.995487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.017368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=32 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:11.028246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.032016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.035394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.042009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.046727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.055102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.148892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d71a17e-20e9-42ab-ae9c-2235b5bde2ca tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments/3201a84f-6b2a-45c8-b1e0-af5d75f73915" status: 200 len: 194 microversion: 2.20 time: 0.168303 Oct 04 18:14:11.156793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2373/4610] 10.222.0.42 () {60 vars in 1454 bytes} [Tue Oct 4 18:14:10 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments/3201a84f-6b2a-45c8-b1e0-af5d75f73915 => generated 194 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:11.279061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.279960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.291188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.291693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.292139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.293140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.293608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.294601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.322797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.325279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.341928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.345306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.348446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.353994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.355101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.355728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.649473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lazy-loading 'services' on Instance uuid cd46ae90-7c6a-4cbd-8fc3-df795d4f846e {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:11.917923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cff8386d-c723-4eb4-b331-b83ac576a07b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments/3201a84f-6b2a-45c8-b1e0-af5d75f73915" status: 202 len: 0 microversion: 2.20 time: 0.645648 Oct 04 18:14:11.922651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2238/4611] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Oct 4 18:14:11 2022] DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments/3201a84f-6b2a-45c8-b1e0-af5d75f73915 => generated 0 bytes in 651 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:11.933445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:11.940670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:11.981808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.986109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.986832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:11.989106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:11.992665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:11.993321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:12.332351 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0e37dfc1-db71-4a08-b3cc-c284ca56222b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.404446 Oct 04 18:14:12.333294 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2239/4612] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:12.459152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:12.488651 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78220ed1-ada3-4b8b-b235-c0790c90c601 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.176604 Oct 04 18:14:12.494876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2374/4613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:11 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:13.345886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.348832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.397630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.399003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.402651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.403592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.404167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.405465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.481457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d628ad2-bc08-4458-9093-ecf84f107d84 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.139879 Oct 04 18:14:13.483428 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2240/4614] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:13.520427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:13.521268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:13.557659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.560243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.562125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:13.577094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:13.584892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:13.588619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.008344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:14.029173 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e30e6d9-824f-4adf-99d7-d484a72f4340 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.513037 Oct 04 18:14:14.033867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2375/4615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:13 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:14.496172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:14.500845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:14.516800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.517732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.518449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.530115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:14.531513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:14.532628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:14.632231 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b0eebd6-0b8b-430d-b46f-8304e37aec09 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140474 Oct 04 18:14:14.650359 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2241/4616] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:14 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:15.055545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.056157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.098291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.100002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.110975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.113772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.128970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.130828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.667783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:15.671593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:15.724436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:15.735906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.744251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.749190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.752490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:15.754243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:15.756569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:15.782149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:15.799282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf0ae7e1-231e-4152-abe4-65f3ec4ec873 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.747664 Oct 04 18:14:15.821374 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2376/4617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:15.890854 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-029f9e8b-9a34-466c-a61e-8c122b0109b7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.228157 Oct 04 18:14:15.897320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2242/4618] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:15 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:14:16.827360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.828080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.868228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.868737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.869185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.880576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.881250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.881720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.910385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:16.914112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:16.950378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.953522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.953960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:16.954731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:16.955199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:16.955640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:17.061742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-517e04ba-b01b-4951-88d6-48759b402f25 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158442 Oct 04 18:14:17.066165 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2243/4619] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:17.360449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:17.369009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03bafb2d-e5ff-4309-9c76-1c03317d8437 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.546201 Oct 04 18:14:17.370566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2377/4620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:16 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:18.078429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.082920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.123503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.127408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.133116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.143777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.146220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.148815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.231373 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99e86213-7de6-4cf0-8882-8ac921d571c1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.159956 Oct 04 18:14:18.238390 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2244/4621] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:18.406648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:18.409409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:18.435675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.438592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.439556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.442004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:18.444275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:18.445522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:18.993188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:19.006715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e068709f-2d71-403e-b0e2-458119d961bf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.607684 Oct 04 18:14:19.009148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2378/4622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:18 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:19.249794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:19.253472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:19.290669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.294542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.295271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.298338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:19.299441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:19.306046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:19.492719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8e9fa2d-8f78-4ae3-89bd-3346e742ee78 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.247293 Oct 04 18:14:19.505911 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2245/4623] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:19 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:20.035479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.036103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.050894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.068210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.068968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.070516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.075993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.077180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.457709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:20.484826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d2f48f9-db5e-4328-a793-fe4aa4f310c5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.453170 Oct 04 18:14:20.493486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2379/4624] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:20.516884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:20.521480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:20.560626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.561912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.563510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.565524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:20.568608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:20.569186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:20.736175 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a02a8ea-e8a5-4034-888b-186f74fb63f1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.215927 Oct 04 18:14:20.741137 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2246/4625] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:20 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:21.519884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.521682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.552041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.552611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.553113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.559247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.560375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.562139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.728988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:21.729909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:21.781486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.790324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.791238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:21.796030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:21.799773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:21.803343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.006464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.032228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdd6c215-c966-4641-b772-47204acd21bc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.507024 Oct 04 18:14:22.033173 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2380/4626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:22.049326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:22.055434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:22.074338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.075736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.076387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.079392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:22.080146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:22.080815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:22.199736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-586340cc-5ec7-4303-a750-278bf9f0fd91 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.164735 Oct 04 18:14:22.206197 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2381/4627] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:22 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:22.435363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:22.451895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1244c307-001d-41c0-9c44-ee3ea87795a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.732522 Oct 04 18:14:22.460664 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2247/4628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:21 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:23.061629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.062310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.133605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.134168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.134818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.137330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.138283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.139855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.214706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:23.217552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:23.239929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.244335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.249315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.250718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:23.251561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:23.252370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:23.357029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fcd10ee6-4749-4440-914e-0aca4862c8ad tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.148168 Oct 04 18:14:23.380703 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2248/4629] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:14:23.848573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:23.890133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42025312-6d52-4cf1-9cce-5fdbcb2069cc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.832186 Oct 04 18:14:23.892112 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2382/4630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:23 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:24.381597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.384717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.404484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.405095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.405634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.406379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.406827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.407457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.509427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:24.514219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b3f3b6a-4808-4595-b2db-a8b1d6e523e2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.137075 Oct 04 18:14:24.521897 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2249/4631] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:14:24.922186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:24.924956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:24.961283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.978442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.982121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:24.984099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:24.987323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:24.995402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.532450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.542680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.585504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.587583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.588280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.589209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.589702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.590396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.733699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-072eb819-517e-49f5-bfaa-eb8ee4b90c58 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.207694 Oct 04 18:14:25.734642 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2250/4632] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:14:25 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e/os-volume_attachments => generated 25 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.787088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:25.804391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa14c235-8ae0-44fe-9685-ea8da2b0c811 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 0.881214 Oct 04 18:14:25.806858 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2383/4633] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:24 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:25.929686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:25.930396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:25.948476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.950757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.953085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:25.954467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:25.955637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:25.956479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.061577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:26.338332 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ed6b0502-be2d-4126-a482-3748ab8e1a7e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 204 len: 0 microversion: 2.20 time: 0.412636 Oct 04 18:14:26.347372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2251/4634] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:14:25 2022] DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:26.349201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.360001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.374362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.375128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.375579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.393500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.395344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.399641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.675667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:26.677244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:26.692919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.693626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.728667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:26.732428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:26.737695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:26.744852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.206157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.220692 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fbddb450-1765-4497-a34c-4f8e5239db2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.544933 Oct 04 18:14:27.223226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2252/4635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:27.239136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.246745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.258735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.263970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.276684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.282930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.290226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.302559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.303123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.337893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.366912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:27.380567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-231315a9-36d4-48d4-914e-0a498f064044 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 1.028386 Oct 04 18:14:27.401905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2384/4636] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:26 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:27.445398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:27.470850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:27.501413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.502097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.516828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.521137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:27.546507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:27.554454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:27.798410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:28.323920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.332289 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-20120ad5-4ba7-4cc0-a077-ff378d881f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.107553 Oct 04 18:14:28.342826 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2253/4637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.363038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.384043 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9cc84702-eb55-4a69-bd06-fda70e1256e7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.969752 Oct 04 18:14:28.392307 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2385/4638] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:27 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:28.430713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.432102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.440747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:28.442381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.459731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.464122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.469484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.471105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.472065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.472884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.479206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.481377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.484862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.486270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.488072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.488783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.812051 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:14:28.812576 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:14:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e (ip 10.222.0.42) !!! Oct 04 18:14:28.867265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:28.901003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b3d45d0-794f-4d89-8369-8dd901b159b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.466548 Oct 04 18:14:28.902561 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2386/4639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:28.937708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:28.940152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:28.971562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.974180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.977573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:28.983888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:28.983888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:28.984349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.229632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be55cbdf-220f-4506-b8f2-10d70640acbd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.296562 Oct 04 18:14:29.233937 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2387/4640] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:28 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:29.240402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.273326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.298946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.309809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.310559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.334111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.335166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.335352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.537202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.551555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.556495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.560884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fc54562-36ac-4385-8c51-9ba5c6c7c56c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 1.138362 Oct 04 18:14:29.579188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2254/4641] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:28 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:29.605641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:29.610925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:29.658339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.662840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.664170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.670792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:29.673667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:29.674959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:29.973308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:29.988867 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d38d5d0-29a8-43d5-846d-72020c5d9399 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 0.753291 Oct 04 18:14:29.991509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2388/4642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:30.008323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.011929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.027578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.028981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.032425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.033318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.036218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.039594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.312935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lazy-loading 'services' on Instance uuid fe59e570-f6ff-4945-85ec-026e8299b3e8 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:14:30.543496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a4a773f-40bc-4e94-af74-8decfc49bf4c tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8/os-volume_attachments/2cbab49f-bb14-4da7-85b5-ac0f71629a07" status: 202 len: 0 microversion: 2.1 time: 0.546957 Oct 04 18:14:30.546392 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2389/4643] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:14:29 2022] DELETE /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8/os-volume_attachments/2cbab49f-bb14-4da7-85b5-ac0f71629a07 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:14:30.613582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:30.617898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:30.662516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.663655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.670296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.671566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:30.672632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:30.676879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:30.719487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:30.730722 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2713c1a8-b936-4684-a47d-de03836ef173 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.145805 Oct 04 18:14:30.731327 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2255/4644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:29 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:31.025977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:31.026925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:31.044685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.046012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.046829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.047970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.051673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.056332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.686174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.714824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.719072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:31.721929 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c2158f3-4a77-4f89-bc09-7d3f74559db9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1722 microversion: 2.20 time: 1.121978 Oct 04 18:14:31.725301 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2390/4645] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:30 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1722 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:31.776403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:31.778936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:31.810571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.812455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.816426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:31.819878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:31.823861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:31.827156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.342867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.367951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-843fd133-1b69-48d1-a759-0ade7879d7d3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 1.345475 Oct 04 18:14:32.370465 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2256/4646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:31 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:32.782081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:32.784493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:32.809754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.811362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.812731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.813677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:32.814990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:32.815597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:32.900085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:32.933928 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f16e816-0b7b-4876-ab3d-ceaa90ccd57e tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1522 microversion: 2.1 time: 1.167620 Oct 04 18:14:32.938218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2391/4647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:31 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1522 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:33.290252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.329564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.332031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:33.360679 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff581b55-e706-407d-9e63-db13846d3f46 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 200 len: 1654 microversion: 2.20 time: 0.559465 Oct 04 18:14:33.383231 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2257/4648] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:32 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 1654 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:33.402782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.403958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.444901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.447118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.448627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.454988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.455796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.458827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.677845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd46ae90-7c6a-4cbd-8fc3-df795d4f846e", "name": "network-vif-deleted", "tag": "eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:33.732336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.738686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.746722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.854793 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] Creating event network-vif-deleted:eb84b72b-bb6d-4bde-bdeb-dba56ddb3bdb for instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e on n-h1-831194-21 Oct 04 18:14:33.868119 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bb8edb86-e185-433e-9f96-75cd6a7ae64d req-7b1db45d-a33a-4bc7-93f1-281ea9ff76bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195526 Oct 04 18:14:33.870204 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2258/4649] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:33.979017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:33.980504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:33.989414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.990349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.991741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:33.994247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:33.995027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:33.996423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.374158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.437386 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-efc24e0a-b22f-4abb-b567-b1cedf503272 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1678 microversion: 2.1 time: 1.042528 Oct 04 18:14:34.444160 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2392/4650] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1678 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:34.478602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.491553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:34.521965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.525367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.532316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.536433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:34.537628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:34.541250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:34.640767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e HTTP/1.1 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'cd46ae90-7c6a-4cbd-8fc3-df795d4f846e'} Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.652282 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:34.658222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:34.662263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3f74f4a-c5cf-46ca-adf1-1c2b51d283a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 404 len: 111 microversion: 2.20 time: 0.214414 Oct 04 18:14:34.665330 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2393/4651] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:34 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:14:34.690184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1f98417-552f-4b14-a141-0fa2e19af0ac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '.version_select at 0x7fbdbc6641f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:34.820673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1f98417-552f-4b14-a141-0fa2e19af0ac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-706694044" status: 204 len: 0 microversion: 2.20 time: 0.139113 Oct 04 18:14:34.822728 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2394/4652] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 18:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-706694044 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:14:34.933744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:34.953186 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db94df6d-87af-4f62-bd19-86eb723d30ce tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1504 microversion: 2.1 time: 0.984040 Oct 04 18:14:35.002333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2259/4653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:33 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1504 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:35.511460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:35.512260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:35.546955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.549664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.552639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:35.554078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:35.558390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:35.559434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.012714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:36.022013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:36.078749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.080142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.085613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.092073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.094566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.096338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:36.911355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:36.940531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-50828913-b294-4820-95cd-6b014e76f5f8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.472497 Oct 04 18:14:36.949950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2395/4654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:35 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:36.957821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d582fff-6bfd-4a70-be3f-8cd352b53edb", "name": "network-vif-unplugged", "status": "completed", "tag": "d655bf3a-c729-491c-a6fd-faf49054493f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:36.988177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:36.989140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:36.989979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.035065 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] Creating event network-vif-unplugged:d655bf3a-c729-491c-a6fd-faf49054493f for instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb on n-h1-831194-21 Oct 04 18:14:37.059396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-64f3d83b-c5f7-4654-82ae-69caab8a397d req-277286f0-e948-4774-8249-222f835b6fff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107742 Oct 04 18:14:37.068796 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2396/4655] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:37.084452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:37.092992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.115085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.122273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.124252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.126366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.128650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.130034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.311853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-630b17f5-e8fe-4215-b31e-1a18f856a38c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 200 len: 322 microversion: 2.1 time: 0.235747 Oct 04 18:14:37.313149 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2397/4656] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:14:37 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:37.342561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:37.346428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:37.383569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.389529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.391699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.411078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:37.413922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:37.417150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:37.599221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:37.626513 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0747a450-2f02-43bc-ae5a-a20af921ef1f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1504 microversion: 2.1 time: 1.616795 Oct 04 18:14:37.628002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2260/4657] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:36 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1504 bytes in 1625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:38.024574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:38.046665 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1682f30e-51ab-4bd5-b593-8a71e4a23296 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.719774 Oct 04 18:14:38.047511 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2398/4658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:37 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:38.095597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.096307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.117556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.118297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.119089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.120513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.121283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.123405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.659572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:38.660207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:38.680473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.682490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.685516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:38.688963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:38.689657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:38.697805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.260380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.272666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.285378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ccd8c3ac-cbae-4631-b38d-b9388bc09bb9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1504 microversion: 2.1 time: 0.629657 Oct 04 18:14:39.285701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f55e640c-0eb9-4c01-951c-81ca747a7b01 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.195354 Oct 04 18:14:39.287169 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2261/4659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:39.295177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2399/4660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:38 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:39.300662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-333fbf00-4d46-4db4-b8ea-4d89a9b75b29 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: .version_select at 0x7fbdbc7c2e50>, body: {"keypair": {"name": "tempest-keypair-251171192", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo0CPI2RdWrTGA9Dx1r5hl0kQY7EVcFf64o9sCk/M72hKgfdyYUUU41yyHlSg4kHIhEQnXy9jWXwqIRGCCiX3LsbdLEQoe+6WaSCa68eL0XA93AdVyAUk1YIncRNAWq/Q=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:39.320143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.321096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.340875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.341586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.342237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.343140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.343773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.344559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.377635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-333fbf00-4d46-4db4-b8ea-4d89a9b75b29 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:39.394263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-333fbf00-4d46-4db4-b8ea-4d89a9b75b29 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for user ec0e669bee9d4d949510d5a0c6576b70 and project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:39.483705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-333fbf00-4d46-4db4-b8ea-4d89a9b75b29 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.188175 Oct 04 18:14:39.485710 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2262/4661] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 18:14:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:14:39.750044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:39.768143 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d68eb10a-1939-438f-bcd0-6774157392c5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.453990 Oct 04 18:14:39.770096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2400/4662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:14:39.814959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:39.818981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:39.884240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.892117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.893001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:39.896121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:39.897125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:39.897856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.318672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:40.323246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:40.352742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.367826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.394216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:40.399505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:40.400665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:40.406989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.198769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.212243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6b0246b-10b2-44d5-9ad0-5e47e36c1be4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 200 len: 1507 microversion: 2.1 time: 0.900780 Oct 04 18:14:41.213287 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2401/4663] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:40 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 1507 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.245670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:41.246948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:41.251898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:41.264460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.265153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.266458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.268394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:41.270124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:41.270931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:41.367557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:41.380910 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Working on deleting snapshot 358436a0-78d8-4f4a-ae79-7d493c402db7 from shelved instance... Oct 04 18:14:41.412472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:41.437983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1dcbd2c5-1eb8-42d6-8880-bcb5f087a7b9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.637965 Oct 04 18:14:41.450370 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2263/4664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:41.737644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1404446840", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5b05bd8e-240d-49e1-9616-3083c9ab006c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:41.887766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] validate_networks() for [('5b05bd8e-240d-49e1-9616-3083c9ab006c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:42.712347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:42.793408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Doing local delete in cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128849) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:14:42.794476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:42.795216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:42.795879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:42.796522 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:14:42.813521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] deallocate_for_instance() {{(pid=128849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:14:43.004929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:43.005474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:43.006245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:43.007077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:43.007719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:43.026953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.027824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.028458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.031807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:43.034509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:43.035854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:43.080977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:43.092909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:43.135952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:43.140098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:43.253771 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef77b6dd-a370-461b-9bdc-a317e21309fd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.521892 Oct 04 18:14:43.255293 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2264/4665] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:43.271217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c70b688-1f3a-42e7-814c-a6914c0a7389 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:43.272033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c70b688-1f3a-42e7-814c-a6914c0a7389 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:43.363755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c70b688-1f3a-42e7-814c-a6914c0a7389 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:43.374893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c70b688-1f3a-42e7-814c-a6914c0a7389 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1215 microversion: 2.1 time: 0.110330 Oct 04 18:14:43.376165 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2265/4666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:43 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:43.465570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1432073448", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "66726747-3f30-4510-b46b-03f931f2087c"}], "security_groups": [{"name": "tempest-securitygroup--1813909587"}], "key_name": "tempest-keypair-552607531", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "cba5fe34-426d-4e8a-8f68-b608a5355194", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:43.667071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] validate_networks() for [('66726747-3f30-4510-b46b-03f931f2087c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:44.630381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Updating instance_info_cache with network_info: [] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:14:44.913817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for project 9c8c65acdbfa4c549b971ebb407a215c. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:44.942194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for user 4d9ea32e30bb4c9a9389b2b0e7318d44 and project 9c8c65acdbfa4c549b971ebb407a215c. Resources: dict_keys(['metadata_items']) {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:44.994879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:44.995316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:44.998796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:45.003076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:45.004133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:45.029915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.030625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.031146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.031877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.032409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.035531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.120787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for project 9c8c65acdbfa4c549b971ebb407a215c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:45.128907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Getting quotas for user 4d9ea32e30bb4c9a9389b2b0e7318d44 and project 9c8c65acdbfa4c549b971ebb407a215c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:45.165728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:45.279888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:45.283058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cba5fe34-426d-4e8a-8f68-b608a5355194',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:45.441795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5762ec1c-4eff-4e29-b39b-be7ac539bae9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 204 len: 0 microversion: 2.1 time: 4.203907 Oct 04 18:14:45.446176 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2402/4667] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:41 2022] DELETE /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 0 bytes in 4206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:45.453316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.454997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:45.464353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.464973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.465458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.466465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.466939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.467678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.625017 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a2bf28d6-6fda-41b6-a38d-ced7ae267688 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.165334 Oct 04 18:14:45.626167 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2266/4668] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:43 2022] POST /compute/v2.1/servers => generated 407 bytes in 2168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:14:45.639392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d582fff-6bfd-4a70-be3f-8cd352b53edb", "name": "network-vif-deleted", "tag": "d655bf3a-c729-491c-a6fd-faf49054493f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:45.665482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.666015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.672809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:45.676463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.685286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd09df39-00f5-450c-ac1b-7d93762a7868 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1285 microversion: 2.1 time: 0.240031 Oct 04 18:14:45.685900 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2403/4669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:45 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1285 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:45.707969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:45.708806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:45.713424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.compute.server_external_events [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] Unable to find a host for instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb. Dropping event network-vif-deleted {{(pid=128850) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:14:45.719168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-980fd286-1700-4ca3-a33f-353fec4ca3f9 req-8278da6e-6ad3-4f69-8e78-5487baf705dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.090573 Oct 04 18:14:45.722276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2267/4670] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 96 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:14:45.726639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.727134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.734628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.734774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795094150", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "359b4a6c-4fe0-44a5-bb2b-09235a9c6692"}], "security_groups": [{"name": "tempest-securitygroup--799186264"}], "key_name": "tempest-keypair-251171192", "user_data": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:45.735986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:45.737309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:45.738293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:45.799752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:14:46.019763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ffb9177-322c-4375-b26d-8631de395844 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 204 len: 0 microversion: 2.1 time: 0.321548 Oct 04 18:14:46.020577 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2404/4671] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:14:45 2022] DELETE /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:14:46.027053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.027766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.035518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.036066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.036566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.037908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.038607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.039339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.047511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] validate_networks() for [('359b4a6c-4fe0-44a5-bb2b-09235a9c6692', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:46.073692 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb HTTP/1.1 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8d582fff-6bfd-4a70-be3f-8cd352b53edb'} Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:46.081341 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:14:46.087011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:14:46.090224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:46.090858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-467d40d4-587c-41d7-ac26-537efbdef757 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 404 len: 111 microversion: 2.1 time: 0.068747 Oct 04 18:14:46.092055 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2405/4672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:46.107077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a8bd754-e31f-41e2-8391-01a38e68bcd8 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.107077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a8bd754-e31f-41e2-8391-01a38e68bcd8 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.206909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a8bd754-e31f-41e2-8391-01a38e68bcd8 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.217694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a8bd754-e31f-41e2-8391-01a38e68bcd8 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1121 microversion: 2.1 time: 0.123346 Oct 04 18:14:46.218390 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2406/4673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1121 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.246552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:46.247193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:46.264692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.265209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.265685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.266571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:46.267050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:46.267504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:46.669471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:46.683654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3124d9e-ea56-4560-9b88-02970bc53374 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1515 microversion: 2.1 time: 0.442459 Oct 04 18:14:46.699581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2407/4674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:46 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1515 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:46.715731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1300372370", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:46.821170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:14:47.472259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:47.473045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:47.476484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:47.478434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:47.480577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:47.514944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.518496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.521397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.523920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.524560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.525124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.580933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:14:47.582274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:14:47.583311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:14:47.584324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:14:47.590726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:14:47.614520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.615841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.616538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.617524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.618234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.618864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.623833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:47.657987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Getting quotas for user ec0e669bee9d4d949510d5a0c6576b70 and project e2ed0241d5024b11b38cf1be25968ab3. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:47.664621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:14:47.671935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:14:47.690301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:47.692771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:47.735698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:14:47.743406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:14:47.869185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae62815b-446b-4479-b062-be86a1487e75 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164269 Oct 04 18:14:47.872272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2408/4675] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:14:47.897966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:47.898752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:47.926274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.936890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.938184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:47.940753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:47.941443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:47.952279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.001408 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9ebcc8fa-b022-4976-a497-d281f23ea218 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.264215 Oct 04 18:14:48.009405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2268/4676] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:14:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 2283 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:14:48.027704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.028696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:48.037659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.038752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.039380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.040380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.042070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.046943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.268193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:48.284878 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a968672-ea08-4ff3-9809-94ad43813a3b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1163 microversion: 2.1 time: 0.277315 Oct 04 18:14:48.305209 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2269/4677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1163 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:48.319431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:48.322366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:48.341410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.344082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.345391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.348633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:48.355377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:48.356829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:48.426368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:49.242596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.257146 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb584203-2065-47ff-9d87-f2c8807c1522 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 1.378584 Oct 04 18:14:49.263008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2409/4678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:47 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.280921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.285141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.310053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.310832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.311381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.312958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.321672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.322315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.555159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.570864 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f33233a-3c8e-448a-91ad-32a1ebdb832a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1219 microversion: 2.1 time: 0.306587 Oct 04 18:14:49.572445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2410/4679] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:49.577494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.582430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.610358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.612414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.613994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.619686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.622714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.623465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.786482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.813125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.826876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:49.841149 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f313fe83-1f40-40dd-a798-42cbbf92ae7c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1277 microversion: 2.20 time: 0.261705 Oct 04 18:14:49.842022 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2411/4680] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1277 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:49.859681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:49.860040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:49.878256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.882115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.883005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:49.884340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:49.884969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:49.885533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.006639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.015523 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-985b59c1-8d63-4223-9a47-83f5317b8303 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1237 microversion: 2.1 time: 0.171919 Oct 04 18:14:50.024169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2412/4681] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:49 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1237 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:50.038708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe59e570-f6ff-4945-85ec-026e8299b3e8", "name": "network-vif-deleted", "tag": "d32f409f-081b-4424-81e9-949cc1adc08b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:50.064622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.084269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.091625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.138747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] Creating event network-vif-deleted:d32f409f-081b-4424-81e9-949cc1adc08b for instance fe59e570-f6ff-4945-85ec-026e8299b3e8 on n-h2-831194-21 Oct 04 18:14:50.154808 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ebcca193-334e-49fb-8e51-84b7345bc2ea req-cb42f3bf-1509-4ae5-8e03-9b20b60dd89c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129217 Oct 04 18:14:50.155415 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2413/4682] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:50.243399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb1b1bf1d54240339e6eca8fb18c593f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3706a13ef744582bc31cafd160cb982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.292193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.292982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f3cc15c-f6f0-4a38-9f6b-db1d62382728 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 200 len: 1515 microversion: 2.1 time: 1.985546 Oct 04 18:14:50.293129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.305862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2270/4683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:48 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 1515 bytes in 1989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:50.306831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.306831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.306831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.306831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.307161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.307364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.626982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.629611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.672307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.675360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.677403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.682987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.685414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.690073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.700477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:50.713701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:50.720909 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-555af888-d830-4113-8aaa-785aa6fc6777 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 0.434078 Oct 04 18:14:50.724353 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2414/4684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:50.873042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:50.874164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:50.898793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.903081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.903877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:50.904989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:50.905609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:50.906387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.386401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.420388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.426623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.436760 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f49503e-cc51-4c5f-9b3b-901c392f10cc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1341 microversion: 2.20 time: 0.570294 Oct 04 18:14:51.438836 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2415/4685] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1341 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:14:51.456506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.457141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.479851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.481486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.483111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.485257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.488138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.495204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.495726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.518887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aad55777-aaf2-4d26-a21b-e72de4c27479 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1267 microversion: 2.1 time: 0.899046 Oct 04 18:14:51.531167 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2271/4686] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:50 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1267 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.547347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.561783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] [instance: fe59e570-f6ff-4945-85ec-026e8299b3e8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.579451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.580072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.582217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.583234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.587183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.589023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.628066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:51.632463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] HTTP exception thrown: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Request method failure captured: Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 HTTP/1.1 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHZt6-cviBWGvSKTDlBvJ8psi6nfqg3_x0k5Oe1hY-qypvK0F_z1X5vwJOWOm_TZcHm2C0LSUq576mrRy1083rQkldLRvTFm1IbSJ7bdJcNEplpHUmiWzlttxTkvJP5rWSxUeaesgDYL5oYM5xNR_i6GxqcLQJiQSIrF3oBcLQx1oeU Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a3706a13ef744582bc31cafd160cb982 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a3706a13ef744582bc31cafd160cb982"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a3706a13ef744582bc31cafd160cb982"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a3706a13ef744582bc31cafd160cb982 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1505069221 Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesSnapshotTestJSON-1505069221-project Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: eb1b1bf1d54240339e6eca8fb18c593f Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesSnapshotTestJSON-1505069221-project Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'fe59e570-f6ff-4945-85ec-026e8299b3e8'} Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:14:51.633445 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] Returning 404 to user: Instance fe59e570-f6ff-4945-85ec-026e8299b3e8 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:14:51.638408 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a60785aa-3c10-47b4-b004-460dbfa9b3a5 tempest-VolumesSnapshotTestJSON-1505069221 tempest-VolumesSnapshotTestJSON-1505069221-project] 10.222.0.42 "GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8" status: 404 len: 111 microversion: 2.1 time: 0.100973 Oct 04 18:14:51.644896 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4653ec64-949c-4907-b8fe-f0a27257ebf7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1237 microversion: 2.1 time: 0.204369 Oct 04 18:14:51.647013 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2272/4687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/fe59e570-f6ff-4945-85ec-026e8299b3e8 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:14:51.671711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2416/4688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1237 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:51.747897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:51.749474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:51.794743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.794743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.794743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:51.794743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:51.794743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:51.795432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.483779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.484402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.507339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.507865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.508374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.509210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.510285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.510285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.757058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.773190 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89166cdf-acc8-4773-8f41-df70adb95e97 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 1.030968 Oct 04 18:14:52.778729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2273/4689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:51 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:52.792185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.803420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.827856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.832814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.833383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.834310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.836338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.836866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.850857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.884089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.892622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:52.897011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7426efab-09a0-45d9-b3bc-cb786ce98ecc tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1339 microversion: 2.20 time: 0.417028 Oct 04 18:14:52.900929 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2417/4690] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:52.920558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:52.921347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:52.946176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.947175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.947887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:52.949728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:52.952585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:52.957467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.028903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.044615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d01fdb7f-270a-48cd-8064-9d4408ab3b28 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1273 microversion: 2.1 time: 0.262046 Oct 04 18:14:53.047780 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2274/4691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.420932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:53.447849 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59e3c3d3-2368-41c1-ac3d-0435005474c9 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 0.543453 Oct 04 18:14:53.454325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2418/4692] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:52 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:53.828388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.829645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.863861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.865986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.867971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.868879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.869526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.888681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.944741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:53.952112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:53.976420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.977778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.978652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:53.979916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:53.980875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:53.981986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.394066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.427334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.430588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.432558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-796c1f54-a241-4c47-a985-8783a2e0ede8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1339 microversion: 2.20 time: 0.503243 Oct 04 18:14:54.444148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2419/4693] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1339 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:54.756373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:54.777384 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0ee36e92-84e9-481b-8080-11b210eca78d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 0.964589 Oct 04 18:14:54.782655 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2275/4694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:53 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:54.793532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:54.814539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:54.841879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.845759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.849252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:54.853664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:54.854392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:54.855105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.435987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:55.436792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:55.468180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.468509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.469067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:55.470156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:55.471942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:55.472606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.035284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.057949 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f84903d3-906a-49e4-89ab-3b0af7f4b6dc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 2.611892 Oct 04 18:14:57.070089 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2420/4695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 2625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.089338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5b04bb-3145-435a-a8e3-26897544c7b2", "tag": "328fb2b8-160e-47cb-b467-2fa5b28b01b0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:57.130052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:57.181018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.185874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.185874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.199568 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f4c0cb0-ea2d-4c97-aa84-519d9c8ea436 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 2.407238 Oct 04 18:14:57.203587 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2276/4696] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:54 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 2416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:57.235666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.236723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.262658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] Creating event network-changed:328fb2b8-160e-47cb-b467-2fa5b28b01b0 for instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 on n-h1-831194-21 Oct 04 18:14:57.265573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.267739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.271982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.273706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.274785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.277631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.285362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ac63f97f-f49c-42b7-98bb-4f574a649a6e req-7e590869-94de-40a9-8f55-b2fcf6537c22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208411 Oct 04 18:14:57.287816 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2421/4697] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:57.319984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:57.323165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:57.338614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.340632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.346198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.350817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:57.351702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:57.352576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:57.557496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:57.649013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:57.683730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:57.719492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=28 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:14:58.251564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.272898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.275480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.277307 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-07ef885c-7d0b-4377-a820-629acc4e1bd4 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 1.072207 Oct 04 18:14:58.303389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2277/4698] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:14:58.303389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae9152b-92e6-4cc1-80ba-e0fb603a793e", "tag": "b181e1cd-15b3-49dd-9fc9-257adac5ec74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:14:58.348015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.348390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.348828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.392362 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] Creating event network-changed:b181e1cd-15b3-49dd-9fc9-257adac5ec74 for instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e on n-h2-831194-21 Oct 04 18:14:58.414402 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d82e52cb-63ee-4648-9520-3fb568d143fe req-cfad57ab-3fe7-426d-b9ae-36285e3d10ad service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118946 Oct 04 18:14:58.417174 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2278/4699] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:14:58.462949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.470639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.489748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.490995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.491802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.493044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.495081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.495886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.555828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:58.574393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8011cc70-033b-4c13-a1b2-0a5a6350f6cb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 1.274388 Oct 04 18:14:58.575448 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2422/4700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:57 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:58.606002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:58.609522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:58.633464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.634651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.635633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:58.636943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:58.637670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:58.640403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.374904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.393793 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd8cb493-29fc-4971-89f5-5823e3b35eee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 0.811967 Oct 04 18:14:59.394543 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2423/4701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:59.429197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.447171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.478091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.478891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.479308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.485330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.485866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.488829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.538426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:14:59.577031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e243e406-435a-4fb0-99e4-16e1028fba13 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 1.155936 Oct 04 18:14:59.589975 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2279/4702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:58 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:14:59.627768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:14:59.634430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:14:59.666187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.666979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.667609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:14:59.669180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:14:59.669862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:14:59.673542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.238510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.281025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.288767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.290616 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cdfbde1c-0e66-468c-9257-99a885dfba27 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 0.890181 Oct 04 18:15:00.315469 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2424/4703] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:00.431629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.432530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:00.458665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.459304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.459762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.460535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:00.460991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:00.461413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:00.906398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:00.916967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-62c81ce4-3a18-4f25-87e1-4e16aced3ef8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 1.306178 Oct 04 18:15:00.940858 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2280/4704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:14:59 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:00.952763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:00.960732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:01.016780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.021070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.023138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.029850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.031167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.031695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.455797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:01.471296 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed571ef2-6b99-46f4-9ed1-dfe4dcc62ec0 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 1.045475 Oct 04 18:15:01.474008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2425/4705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:01.484218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eecddec8-c7ef-41d9-b343-435bdc8008cd", "tag": "fee181d9-4e6c-4587-a8e8-bc711f3ff8d5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:01.513243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.513243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.513243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:01.564266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] Creating event network-changed:fee181d9-4e6c-4587-a8e8-bc711f3ff8d5 for instance eecddec8-c7ef-41d9-b343-435bdc8008cd on n-h1-831194-21 Oct 04 18:15:01.571389 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e8a81683-dbcf-48cf-a0d3-8fff20d0316a req-292b0be6-5cd1-4616-a18d-a48614ddd493 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094444 Oct 04 18:15:01.573557 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2426/4706] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:01.966347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:01.989402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:01.990977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:01.991938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.014599 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] Creating event network-changed:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h1-831194-21 Oct 04 18:15:02.025321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-35af64d2-b4f6-4a2a-8862-dc57a4681e08 req-bfb0405f-76a8-4d01-b728-5e13182ce5f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449733 Oct 04 18:15:02.026372 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2427/4707] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:02.035978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.038627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.049924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.050963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.051635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.058220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.059003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.060838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.066533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.087895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fcac168f-2d56-4070-87ac-a048935c3427 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 1.145383 Oct 04 18:15:02.109170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2281/4708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:00 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.114470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.115174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.137110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.137626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.138550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.138997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.139527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.140070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.526531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:02.541999 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72d85626-3443-4f8a-a5f2-061a480821c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 0.431271 Oct 04 18:15:02.554559 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2282/4709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:02.559940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5b04bb-3145-435a-a8e3-26897544c7b2", "name": "network-vif-plugged", "status": "completed", "tag": "328fb2b8-160e-47cb-b467-2fa5b28b01b0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:02.591694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.592619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.593323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.629090 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] Creating event network-vif-plugged:328fb2b8-160e-47cb-b467-2fa5b28b01b0 for instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 on n-h1-831194-21 Oct 04 18:15:02.643972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1d8f6ef7-496d-4502-87a7-10bcaab14ee4 req-0a575831-f23a-4fbe-8068-9200c4087d6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087912 Oct 04 18:15:02.645087 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2283/4710] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:02.652134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:02.652846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:02.676127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.677173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.678470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:02.679602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:02.680563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:02.681328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.002032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.019454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.025471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.035498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:03.038278 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-daaf7417-06ed-4a87-95e4-8cd7015576cd tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 0.386043 Oct 04 18:15:03.056009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2284/4711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:03.061118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b3a67a8-28c2-4194-8292-ed9401cda874 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 1.030648 Oct 04 18:15:03.067102 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2428/4712] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:02 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:03.133250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.134171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.154356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.157234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.157819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.158708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.160812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.161449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.571107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:03.572657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:03.595691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.596222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.596869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:03.604084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:03.605725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:03.606221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.049608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.070394 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-25ecefb0-0f2f-4dbc-9cf7-78f6d2a56e51 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 0.941233 Oct 04 18:15:04.071830 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2285/4713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.094015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.095194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.113367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.126641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.131930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.134618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.138235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.142065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.615827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:04.624768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b510476-f8a2-4d08-bae7-a1b2f92bd7f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1315 microversion: 2.1 time: 1.058161 Oct 04 18:15:04.650641 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2429/4714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:03 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1315 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:04.687906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:04.694791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:04.737205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.743263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.750634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:04.754330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:04.759416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:04.764776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.153882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.166963 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f4ec839-e60a-4cfc-8d36-226b45153857 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 1.090058 Oct 04 18:15:05.172743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2286/4715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.184493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.197668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.209480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.217725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.218578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.221333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.221874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.230242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.781381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:05.796146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9db5b5f8-605c-427e-a39e-7bfd910cba22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 0.621473 Oct 04 18:15:05.796747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2287/4716] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:05.815545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:05.818983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:05.837083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.841630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.842557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:05.843733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:05.845672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:05.850404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.323409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.327544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:06.351051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a777b4f0-c885-451a-8884-bc1eea850ba9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1502 microversion: 2.1 time: 0.544954 Oct 04 18:15:06.360264 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2288/4717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:05 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1502 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:06.383332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:06.391281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:06.428788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.434561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.439409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.439961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.440711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.441244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.728120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.758336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.759934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:06.777718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-32192089-aa11-460b-8bbc-b13d52bf3556 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 2.138629 Oct 04 18:15:06.778369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2430/4718] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:04 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 2142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:06.797436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:06.832121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:06.832918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:06.834448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:06.864982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:15:06.965811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47ee9d3b-1168-41eb-8e91-8588e715832b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2/action" status: 202 len: 0 microversion: 2.1 time: 0.179430 Oct 04 18:15:06.971357 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2431/4719] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:06 2022] POST /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2/action => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:07.016203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecddec8-c7ef-41d9-b343-435bdc8008cd", "name": "network-vif-plugged", "status": "completed", "tag": "fee181d9-4e6c-4587-a8e8-bc711f3ff8d5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:07.104379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.116534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.129359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.179437 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] Creating event network-vif-plugged:fee181d9-4e6c-4587-a8e8-bc711f3ff8d5 for instance eecddec8-c7ef-41d9-b343-435bdc8008cd on n-h1-831194-21 Oct 04 18:15:07.190545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-68628eed-fd42-4d04-a601-d9a99aa58992 req-987a9d30-085b-45d9-bd68-263a5f9698a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216441 Oct 04 18:15:07.191451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2432/4720] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:07.215752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.224313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.247317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.263463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.268324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.269246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.270339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.271173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.278164 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52b62565-5aa3-4253-9652-12e94f9721fa tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 0.916010 Oct 04 18:15:07.280737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.282714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2289/4721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:06 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.312034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.317072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.339073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.342839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.343799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.346664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.350095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.351112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.404800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:07.774071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:07.785433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e3b1204-c4bb-4dc6-8e42-f21af809fa2b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 0.592454 Oct 04 18:15:07.788868 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2433/4722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:07.824776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:07.830754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:07.867704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.869723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.870678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.876246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:07.877290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:07.882012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:07.986339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.000885 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f053ac7-d207-497e-8a0d-23e8004d2fb7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.716311 Oct 04 18:15:08.001486 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2290/4723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:08.310439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.311060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.318201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.336285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.339004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.343004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.343524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.344150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.345277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.346156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5eabd1c3-935d-4c41-9b29-eea0b95a3597 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 0.536586 Oct 04 18:15:08.347580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.350477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.370392 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2434/4724] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:07 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:08.734263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:08.756489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57cc34a0-c857-4d40-a4d6-792220fa8bf5 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1305 microversion: 2.1 time: 0.448636 Oct 04 18:15:08.766735 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2291/4725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1305 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:08.822331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:08.824757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:08.843107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.858287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.860179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:08.861603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:08.863750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:08.864560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.028116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.029566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.048892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.050261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.051803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.052979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.054472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.056705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.241865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.260261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77c3e17e-14c2-434c-8f38-3cf36091f89c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1315 microversion: 2.1 time: 0.444957 Oct 04 18:15:09.268799 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2435/4726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:08 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.380485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.381284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.394014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.519216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.559563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f440e85-348a-4c43-be29-af0752852d84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.537225 Oct 04 18:15:09.565781 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2292/4727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:09.781471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:09.782130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:09.794072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.794584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.795030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.803064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:09.803725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:09.804185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:09.858256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.864687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.868993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:09.873794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0368f65-abd8-4b4e-9b70-d99ac15699eb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 0.499477 Oct 04 18:15:09.874689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2436/4728] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:15:10.291673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.292301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.300466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:10.304847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.305357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.306031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.308072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.308554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.308998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.638189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:10.646265 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c84270b-9f61-4149-a688-ca6c41377b65 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1502 microversion: 2.1 time: 0.358414 Oct 04 18:15:10.647114 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2437/4729] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1502 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:10.651935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-plugged", "status": "completed", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:10.678204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.678635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.686292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.699250 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] Creating event network-vif-plugged:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h1-831194-21 Oct 04 18:15:10.723812 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c2bec341-f652-4df7-89d8-36cb3c7a6fcd req-8716763a-a4ea-4265-ad6b-3c120fc74e2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075169 Oct 04 18:15:10.729216 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2438/4730] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:10.736105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:10.737272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:10.766739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.767652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.768368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:10.769358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:10.770105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:10.772353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.117426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.134877 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a10decb6-ad06-4e99-b7d0-0efdca0f23ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.403461 Oct 04 18:15:11.136599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2439/4731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:10 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.176179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:11.189357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.191223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.194761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.252945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.264859 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1c38c17-dcdb-4137-9a4c-b0ec31048108 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 1.487324 Oct 04 18:15:11.268168 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2293/4732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:09 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:11.278031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.278427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:15:11.279758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.298534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.299584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.300312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.301255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.302617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.303533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.346473 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5115e908-b761-44f1-96a2-10e0bc055f24 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd/action" status: 202 len: 0 microversion: 2.1 time: 0.189602 Oct 04 18:15:11.347521 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2440/4733] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:11 2022] POST /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:15:11.356261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:11.357016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:11.377101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.377968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.387170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.392098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:11.393939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:11.394580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:11.836463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.856078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.865779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.867948 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7f9dc24-4a00-4e99-b153-e90e1e7c8559 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1406 microversion: 2.20 time: 0.595150 Oct 04 18:15:11.871089 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2294/4734] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1406 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:11.930954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:11.940437 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-478c1551-328e-488c-9b90-d0e744f88d95 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.588179 Oct 04 18:15:11.943517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2441/4735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:11 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:12.167038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.167578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.176516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.178002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.178607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.179485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.180135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.180550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.302917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.308230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.330739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.335622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.336072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.347022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.347643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.350493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.476580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.500235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-991d5470-86cc-4cf8-8b93-911bff97070e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.338093 Oct 04 18:15:12.524360 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2295/4736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.612468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:12.635821 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b32d0c73-3a9d-443b-8dd2-a188be1fe37f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.345606 Oct 04 18:15:12.662485 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2442/4737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:12.920445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.921629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:12.957639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.962647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.963528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.967725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:12.968747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:12.969665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:12.989340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:12.993807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.028104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.028992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.029781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.031021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.035887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.039754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.314920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.337047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.343996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.352107 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b651304-a4c4-4897-9e81-639724708a9d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1597 microversion: 2.20 time: 0.439950 Oct 04 18:15:13.358732 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2296/4738] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1597 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:15:13.393560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.404960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.405887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.410571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-243738ea-64b3-42b2-ba00-53e3a7cb5972 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.429205 Oct 04 18:15:13.412976 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2443/4739] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:12 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:13.429129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.433225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.434140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.438850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.439755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.440544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.530099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.531057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.549817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.550610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.555551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.556913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.557662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.558389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.665609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-411f238e-3a53-4dae-a518-ff94ab6bb71d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.266215 Oct 04 18:15:13.667023 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2297/4740] 10.222.0.42 () {60 vars in 1316 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-interface => generated 284 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:15:13.672504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:13.673101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:13.698278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.699247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.699873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.703389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:13.704052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:13.704724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:13.801097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:13.814174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3242af5-4479-4980-ac4b-4f673aa322b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.287204 Oct 04 18:15:13.816066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2444/4741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:14.315858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.327580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3662f0c-b421-431a-baac-9fe20cb26264 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.659288 Oct 04 18:15:14.331143 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2298/4742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:13 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.443808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.445149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.459620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.460039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.461285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.461596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.462199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.462813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.760775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:14.773980 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b33e3736-cdbc-4a91-9811-670176890baa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.338895 Oct 04 18:15:14.775439 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2445/4743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:14.844250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:14.845961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:14.854838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.859072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.859819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:14.876433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:14.877609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:14.878548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.332008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.346441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-731272a5-10a9-44da-9f64-bcaff7078e39 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.503363 Oct 04 18:15:15.367918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.368790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.375754 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2299/4744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:14 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:15.382389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.383656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.384610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.387322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.389543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.390805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.676415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:15.693225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09570a08-5198-49d9-a202-820dcb7e3196 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.338612 Oct 04 18:15:15.694085 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2446/4745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:15.810082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:15.815478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:15.829113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:15.834426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.837146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.838419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:15.839934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:15.841034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:15.842121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.186803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:16.196256 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1fafe44b-f329-49e6-adb8-0bad428d25c0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.398296 Oct 04 18:15:16.196843 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2300/4746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:15 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:16.281123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:16.339785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.346329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.354139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.406735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] Creating event network-changed:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h1-831194-21 Oct 04 18:15:16.419198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.420310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.457492 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f953a108-4a18-43be-b57b-64861f599771 req-782aa955-724c-4240-9bcf-84ec3f0a64a7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182873 Oct 04 18:15:16.462972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.463477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.483035 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2447/4747] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:16.487031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.495665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.496800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.502517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.726364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:16.727325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:16.746185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.746934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.747621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:16.750149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:16.750829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:16.754174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.059731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.100931 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3b6cee7-1884-4553-9979-164d6cd065fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.689055 Oct 04 18:15:17.129344 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2301/4748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:17.228174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:17.229527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:17.243838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.244716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.246354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.247286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:17.249727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:17.250422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:17.289270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.303715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37c931e6-f1fa-402e-b864-3e41f0b7eaff tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.588634 Oct 04 18:15:17.329312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2448/4749] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:16 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:17.939975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:17.960928 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c44c31e4-96f8-43e1-9414-28a17dd89c01 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.736781 Oct 04 18:15:17.974343 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2302/4750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:17 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:18.137915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.139425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.166265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.167175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.167879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.168864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.171362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.172113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.330378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.331156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:18.340740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.342478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.343204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.344091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:18.344852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:18.350664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:18.795082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:18.829272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c778fac7-c385-4479-a2cc-f3ad85e4faab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.694447 Oct 04 18:15:18.830464 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2449/4751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:18.933907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:18.945157 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-943339b6-0d21-4e8c-88fc-7911a20edb57 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.619385 Oct 04 18:15:18.945794 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2303/4752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:18.994091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:18.995016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.015347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.016175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.016830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.019333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.020489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.021432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.027043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:19.356887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:19.400392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14d663d0-c9bb-445d-ab05-0aa1a0503f99 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.411354 Oct 04 18:15:19.401506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2450/4753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:18 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:19.856315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.857199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.862528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae9152b-92e6-4cc1-80ba-e0fb603a793e", "name": "network-vif-plugged", "status": "completed", "tag": "b181e1cd-15b3-49dd-9fc9-257adac5ec74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:19.871514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.872130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.872574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.873513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.874420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.874950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.875144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:19.875984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:19.876615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:19.890600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] Creating event network-vif-plugged:b181e1cd-15b3-49dd-9fc9-257adac5ec74 for instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e on n-h2-831194-21 Oct 04 18:15:19.899518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2eacd190-4126-45ef-94e5-6d1ed9ca9679 req-8ab74ddf-c7ee-4c8e-bd4a-b98d07cf9695 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.454145 Oct 04 18:15:19.900409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2304/4754] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:19.975912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:19.979581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:19.999572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.001900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.003337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.004165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.005455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.006099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.287746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.303318 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09649422-e42c-458d-ad8e-2d6817209fa2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.451059 Oct 04 18:15:20.304664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2451/4755] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:20.373460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.386096 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca8fb403-0777-4ad3-bb0d-31abbe781ab4 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1293 microversion: 2.1 time: 0.413700 Oct 04 18:15:20.390212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2305/4756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:19 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1293 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:20.431558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:20.433081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:20.445278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.446426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.447389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.448943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:20.449620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:20.450783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:20.738250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:20.769583 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a498cb10-81e1-45f8-95eb-54e248301c7d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.345120 Oct 04 18:15:20.780602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2452/4757] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:20 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.333246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.334596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.351539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.352941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.353894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.354964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.355624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.356974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.406803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.407709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.419271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:21.424178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.435699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.436317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.436906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.440152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.440703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.741163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.753205 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f3176dac-ba4c-4da9-9ed3-9021a5e11323 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.425315 Oct 04 18:15:21.760879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2306/4758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.761598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:21.779296 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7bf65e9a-bfdf-4f56-9b2f-44ddcd9ca984 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1483 microversion: 2.1 time: 0.375635 Oct 04 18:15:21.783008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2453/4759] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1483 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:21.815335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.816362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.824735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.826723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.827475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.828815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.830097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:21.831232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:21.833792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.834386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.848853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.852831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.853164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.853997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:21.854512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:21.857300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:21.967723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3bbc666f-7122-4563-ad48-8cc9afe4932c tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146034 Oct 04 18:15:21.968602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2454/4760] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:22.133018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:22.157331 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-869dd4d5-f22c-41f4-b2dd-36c48d1ac4e3 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.346624 Oct 04 18:15:22.158035 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2307/4761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:21 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:22.787641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:22.788322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:22.801433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.802118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.802754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:22.803868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:22.804716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:22.805504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.179724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:23.185555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:23.187501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:23.205713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.206638 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f29dba05-0b25-4716-a936-c0634609b325 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.429898 Oct 04 18:15:23.207249 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2455/4762] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:22 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:23.210165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.211699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.214741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:23.215779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:23.218381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:23.552052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:23.563879 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40c8ba83-60d4-48d1-a95a-a7df441aeaef tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.384000 Oct 04 18:15:23.565808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2308/4763] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:23 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.070791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.074161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.092387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ae9152b-92e6-4cc1-80ba-e0fb603a793e", "tag": "b181e1cd-15b3-49dd-9fc9-257adac5ec74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:24.102375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.110555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.112518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.114701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.121572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.126732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.131134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.134710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.137072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.154971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] Creating event network-changed:b181e1cd-15b3-49dd-9fc9-257adac5ec74 for instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e on n-h2-831194-21 Oct 04 18:15:24.164456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-39c8f54f-babf-4dcd-8bd7-0a680953f694 req-0f55b8b0-28d0-44fa-8a09-93780c078da7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091559 Oct 04 18:15:24.171573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2309/4764] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:15:24.243465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.244260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.290915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.293339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.295751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.297809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.300865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.301689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.698785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:24.712653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:24.715694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-abf31b18-0944-4b9e-97f1-9bce8cedf86f tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1483 microversion: 2.1 time: 0.656024 Oct 04 18:15:24.720277 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2456/4765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1483 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:24.724582 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-756950de-5396-434c-9244-d81cb29aa166 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.486865 Oct 04 18:15:24.725265 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2310/4766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:24.746603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:24.757588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:24.795076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.801017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.802278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:24.803446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:24.819486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:24.820174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.679756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:25.692779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12244d6f-710d-4b7b-acd5-4ca83f20ca5c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.968570 Oct 04 18:15:25.706930 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2457/4767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:24 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:25.782798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:25.784663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:25.810324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.814927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.823244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:25.824305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:25.825019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:25.825786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.724905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:26.742316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f743dbb2-31f5-42c0-b390-5b10d0aeb657 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.963477 Oct 04 18:15:26.743104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:26.744233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:26.763164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2311/4768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:25 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:26.788817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.789333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.789785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:26.790578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:26.791047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:26.791487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.481125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:27.495540 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3d826e2-a516-48f8-835a-dfc39ef0a66c tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.759381 Oct 04 18:15:27.496867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2458/4769] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:26 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:27.778557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:27.783033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:27.818453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.819810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.821862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:27.823706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:27.825366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:27.826508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.047456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.056974 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e36abba-c213-46a5-afe3-a8e467298adf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.291845 Oct 04 18:15:28.058065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2312/4770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:27 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:28.528250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:28.530248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:28.578333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.580196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.585863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.587569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:28.588465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:28.589178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:28.874306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:28.884070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ffd8c183-a640-4faa-af9a-cce69a0f48bd tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.365013 Oct 04 18:15:28.892811 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2459/4771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:28 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.086159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.086864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.105506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.107227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.110495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.114305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.131512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.135682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.403779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:29.414056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16574104-5fcb-4835-afc5-76e92187e143 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.337346 Oct 04 18:15:29.427714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2313/4772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:29.915859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:29.916592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:29.931271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.933795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.934908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:29.935910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:29.936641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:29.937100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.118135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.128418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8cdc3b56-b245-4870-891a-88a205654682 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.219983 Oct 04 18:15:30.129684 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2460/4773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:29 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:30.486686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:30.488667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:30.500343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.501432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.502193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.503480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:30.505165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:30.506433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:30.878624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:30.898024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58e39733-f947-4626-a656-a27649343a81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.448702 Oct 04 18:15:30.899281 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2314/4774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:30 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.156709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.157321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.172768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.173264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.177264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.178117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.178587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.182167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.446768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:31.462642 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a88e01a8-17b3-48d2-b139-7f1d7c328522 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.310248 Oct 04 18:15:31.464937 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2461/4775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:31.948200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:31.950632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:31.965657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.966268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.966722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:31.984905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:31.985601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:31.988018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.359755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.375800 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96b14df2-816e-417a-b579-5f0b06855611 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.444952 Oct 04 18:15:32.376663 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2315/4776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:31 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:32.493283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:32.494058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:32.509856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.510426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.510875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.511675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:32.512193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:32.512633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:32.854464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:32.863784 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f8398e8-cde7-45f6-af30-1a46258917f2 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.375791 Oct 04 18:15:32.866521 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2462/4777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:32 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:33.405687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.407620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.421630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.422501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.423186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.424278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.425023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.425702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.899288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:33.899859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:33.918509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.919218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.919738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:33.921761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:33.922387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:33.922901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:34.198589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.212464 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dcae5f30-dad1-40a3-a1de-e9144908a8cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.811480 Oct 04 18:15:34.213796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2316/4778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:34.678939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:34.712538 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-defd905e-5990-419f-9c7c-c1afbbcf94d0 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.819933 Oct 04 18:15:34.715369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2463/4779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:33 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:35.240187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.242564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.252672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.253486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.255072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.256076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.257553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.258259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.638775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:35.652075 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b396de9a-de24-47a8-ad83-9a1696418f84 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.418485 Oct 04 18:15:35.668186 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2317/4780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:35.741109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:35.741728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:35.771505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.773191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.780207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:35.781870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:35.782694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:35.783379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.393305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.402904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81613199-de4f-483a-bbeb-40cc7db4b3ea tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.666849 Oct 04 18:15:36.404261 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2464/4781] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:35 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:36.680005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:36.680607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:36.695448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.696248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.697355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.698737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:36.699255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:36.702610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:36.962086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:36.984748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86143b25-7f37-4bfe-a2f6-b20c214aa557 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.309263 Oct 04 18:15:36.985756 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2318/4782] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:36 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:37.447792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:37.448410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:37.464492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.465395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.466053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.467079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:37.468261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:37.468951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:37.701621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:37.721037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e947fd30-d6e5-4f3c-aa7a-5ef8d5aa67d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.276385 Oct 04 18:15:37.722543 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2465/4783] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:37 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.011795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.012374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.029443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.030218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.030864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.031726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.032373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.032962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.372104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:38.384503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0555f2a7-3bcd-4540-92ba-8fd650df4e6e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.377897 Oct 04 18:15:38.389988 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2319/4784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:38.750893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:38.751705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:38.763512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.767291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.768018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:38.772458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:38.773686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:38.777075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.059660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.073595 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ca89001-5e6e-46f7-8798-e0aa949618d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.327538 Oct 04 18:15:39.074672 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2466/4785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:38 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:39.426067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:39.426904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:39.444300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.444841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.445398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.446301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:39.446762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:39.447317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:39.668350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:39.701381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-811eeb52-49f2-47a1-b8bc-768963ff9e16 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.280286 Oct 04 18:15:39.702365 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2320/4786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:39 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.109694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.110349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.120077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.124267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.124913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.125753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.130536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.131856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.143903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:40.440642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:40.452314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-617117bd-7232-4787-acaa-5c88c2f08aa1 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.351751 Oct 04 18:15:40.453191 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2467/4787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:40.733516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:40.734915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:40.751865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.752816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.752944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:40.753928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:40.758768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:40.764981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.009616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.020542 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bcb4b964-187d-4aa7-b19d-902c24fe78a6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.289243 Oct 04 18:15:41.026054 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2321/4788] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:40 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:41.477424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:41.478257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:41.481154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=62 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:41.493788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.494318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.494760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.495482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:41.495938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:41.496362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:41.705542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:41.714840 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-269beb06-a480-44d1-ae36-0d76b2b6e472 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1512 microversion: 2.1 time: 0.241711 Oct 04 18:15:41.716867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2468/4789] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:41 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1512 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:42.061274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.063399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.074790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.075291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.075755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.076459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.076906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.077333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.380662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:42.388730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a851560e-f75d-4b4f-8290-dd0af58fcd2e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.332092 Oct 04 18:15:42.390590 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2322/4790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:42.763235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:42.764925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:42.774586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.775368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.776030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:42.776971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:42.777667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:42.778508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.039643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.048293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e351abf4-d25f-4c7c-816b-c296bb2c298a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1489 microversion: 2.1 time: 0.289288 Oct 04 18:15:43.050966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2469/4791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:42 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1489 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.102699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.104052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.121699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.131088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.131524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.132452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.133116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.133711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.173748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:15:43.186149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:43.431527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-444969a9-956f-47d2-9f61-931e82c4d3f5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 204 len: 0 microversion: 2.1 time: 0.323315 Oct 04 18:15:43.432708 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2323/4792] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:15:43 2022] DELETE /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:15:43.436850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.438099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.466857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.466857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.466857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.471775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:43.471993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:43.475477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.475827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.476288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.491951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.492462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.492908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.494583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:43.495223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:43.495664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:43.808442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.820220 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f343fb0-9bc4-4c73-b2b9-74a4ca467424 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.399499 Oct 04 18:15:43.822255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2470/4793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:43.826179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:43.837150 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c26f7c82-56fc-4424-b515-6efd64f5f560 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1495 microversion: 2.1 time: 0.387331 Oct 04 18:15:43.838023 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2324/4794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:43 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1495 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:44.850106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.860201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.867230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:44.867992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:44.877309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.878340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.879030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.880190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.881394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.882203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.890497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.891829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.896643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:44.899420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:44.900001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:44.901656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:45.134455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.150108 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0236b2c5-b51c-463e-8e70-d86280bd7df0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.304303 Oct 04 18:15:45.150980 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2471/4795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:45.342833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:45.361586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68b320ce-ee00-46f4-8f6e-2a7a073f6ecc tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1495 microversion: 2.1 time: 0.491474 Oct 04 18:15:45.364071 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2325/4796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:44 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1495 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:46.056524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eecddec8-c7ef-41d9-b343-435bdc8008cd", "name": "network-vif-deleted", "tag": "fee181d9-4e6c-4587-a8e8-bc711f3ff8d5"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:46.089228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.094427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.094427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.124906 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] Creating event network-vif-deleted:fee181d9-4e6c-4587-a8e8-bc711f3ff8d5 for instance eecddec8-c7ef-41d9-b343-435bdc8008cd on n-h1-831194-21 Oct 04 18:15:46.146729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c5fc8bd3-8912-4add-8d9c-40aa3be88c39 req-d2bc97db-ff19-452d-8c61-d19b918c4983 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097947 Oct 04 18:15:46.154263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2472/4797] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:46.181293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.182053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.199342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:15:46.209190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.217324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.219227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.220742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.226744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.233473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.392506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:46.393557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:46.415468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.423210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.428244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.429046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.429538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.430055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.580746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.590849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:46.591438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:46.593492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:46.594033 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be09c680-a1e2-4993-9b34-08a40fe326d0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1512 microversion: 2.1 time: 0.416774 Oct 04 18:15:46.594410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'fault' on Instance uuid eecddec8-c7ef-41d9-b343-435bdc8008cd {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:15:46.595188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2326/4798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1512 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:46.761124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:46.773090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f3bd38a9-b856-43b1-b17b-f982c515084b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 200 len: 1305 microversion: 2.1 time: 0.386232 Oct 04 18:15:46.774556 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2473/4799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:46 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 1305 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:47.806944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:47.806944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:47.816663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.817164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.817608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.824063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:47.824427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:47.824873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:47.875759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd HTTP/1.1 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'eecddec8-c7ef-41d9-b343-435bdc8008cd'} Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:15:47.877488 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:15:47.887353 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb146ff6-7239-428c-a822-7aee14d6d526 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 404 len: 111 microversion: 2.1 time: 0.078676 Oct 04 18:15:47.901213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2474/4800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:15:48.224370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.225071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.240129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.240644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.241095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.241821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.242316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.251572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.254048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-951584439", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "591f6dc7-d4ed-4f52-936f-0c80dcd7e26a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:48.378477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] validate_networks() for [('591f6dc7-d4ed-4f52-936f-0c80dcd7e26a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:48.594805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:48.607273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80309b1b-ac63-4e1d-b122-677ac875f246 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1489 microversion: 2.1 time: 0.986185 Oct 04 18:15:48.625194 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2327/4801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:47 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1489 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:48.641883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:48.655387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.666868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.672256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.674794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.676730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.680166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.681787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.790482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0601cd70-6634-4355-9c1f-130acae5ee0e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 200 len: 187 microversion: 2.1 time: 0.156607 Oct 04 18:15:48.791054 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2328/4802] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:15:48 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 187 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:48.801792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:48.802518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:48.819191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.819191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.828529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:48.829347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:48.829856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:48.830308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.292468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.318605 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84e5f46b-0332-4bdc-a074-4ffa99809a6c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.521321 Oct 04 18:15:49.319628 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2329/4803] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:48 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:49.372821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.373477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.399910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.400359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.400919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.401732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.402220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.402642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.744039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:49.744593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:49.744930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:49.745307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:49.749556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:49.750239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:49.769505 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ea82d81-9dac-4194-8b4b-046bc097e51b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.401573 Oct 04 18:15:49.772881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.773823 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2330/4804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:49.774938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.775622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.776712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.777321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.778009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.801105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:49.802428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:49.826689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.830710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.832473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.833880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:49.842958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:49.843463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:49.868538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:49.901317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Getting quotas for user 77ee29036e794a9786d576e4b33fb5ef and project 282a2f9a9e39470fa9b99180eeefd931. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:49.949516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:49.952563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:50.098477 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3900681c-d08a-41c6-b40e-14abd893c8da tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.849667 Oct 04 18:15:50.111291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2475/4805] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1863 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:15:50.117399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7235cf73-b6b4-43e2-bd9f-0a0ca650b85f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.131705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7235cf73-b6b4-43e2-bd9f-0a0ca650b85f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.259130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.272104 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2fc325b4-a289-4c79-94a1-684da375b76f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.475806 Oct 04 18:15:50.275016 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2331/4806] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:49 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:50.303628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:50.304969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:50.331967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.332210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.332766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.333717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:50.356582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:50.357204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:50.367014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7235cf73-b6b4-43e2-bd9f-0a0ca650b85f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.391370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7235cf73-b6b4-43e2-bd9f-0a0ca650b85f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1214 microversion: 2.1 time: 0.278437 Oct 04 18:15:50.401965 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2476/4807] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1214 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:50.791544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:50.805397 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33510be1-7707-4578-ab4f-9d059828fb55 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.507744 Oct 04 18:15:50.808214 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2332/4808] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:50 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:51.072335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-770332875", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5b05bd8e-240d-49e1-9616-3083c9ab006c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:51.225204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] validate_networks() for [('5b05bd8e-240d-49e1-9616-3083c9ab006c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:15:51.420840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b29e7908-5695-4af5-83f0-881c47b61204 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:51.422235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b29e7908-5695-4af5-83f0-881c47b61204 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:51.567862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b29e7908-5695-4af5-83f0-881c47b61204 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:51.576206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b29e7908-5695-4af5-83f0-881c47b61204 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1214 microversion: 2.1 time: 0.159656 Oct 04 18:15:51.585209 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2333/4809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:51 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.569315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:15:52.570474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:15:52.572772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:15:52.573556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:15:52.574685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:15:52.589802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.590751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.591478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.592681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.593410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.594123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.618770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:15:52.621556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.626590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:15:52.631526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.643400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:15:52.646113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:15:52.647622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.648316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.648931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.649987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:52.650642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:52.651243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:52.732046 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3234f71f-9df4-4fe9-a477-64ddb9c2f881 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663938 Oct 04 18:15:52.733887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2477/4810] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:15:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:15:52.759272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7282479-f8cc-4345-a494-8c13af3551b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:52.760368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7282479-f8cc-4345-a494-8c13af3551b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:52.883583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.903418 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b714917-b15e-4766-a1ea-2cf3237c3133 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1266 microversion: 2.1 time: 0.285751 Oct 04 18:15:52.908489 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2334/4811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1266 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:52.946491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7282479-f8cc-4345-a494-8c13af3551b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:52.967202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7282479-f8cc-4345-a494-8c13af3551b4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1214 microversion: 2.1 time: 0.214682 Oct 04 18:15:52.970254 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2478/4812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:52 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1214 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:53.967341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:53.968976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:53.985024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:53.985552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:53.985950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:53.995278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.000133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.000875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.006324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:54.007293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:54.044059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.047463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.048157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.049095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:54.052119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:54.054803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:54.207754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.222898 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d76d0ad-2508-487f-a742-106d5199dbe9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1272 microversion: 2.1 time: 0.259001 Oct 04 18:15:54.226349 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2335/4813] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:54.344268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:54.368887 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d6bbdf6-c19e-4b2d-8dc6-b4a6d2286863 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1218 microversion: 2.1 time: 0.362759 Oct 04 18:15:54.376659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2479/4814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:53 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1218 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:55.271059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.271692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.317270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.318019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.318753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.319729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.320420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.321557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.406881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:55.408307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:55.430600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.434215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.436394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.439182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:55.442441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:55.444318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:55.667330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.677016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0021a7e6-cd70-4273-b855-0cd5061c26d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1272 microversion: 2.1 time: 0.274122 Oct 04 18:15:55.682578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2480/4815] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:55.983005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:55.997927 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b5c1799-54bf-44b9-aade-4e9781633e4b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.731030 Oct 04 18:15:56.001429 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2336/4816] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:55 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:56.715302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:56.716692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:56.747092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.755358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.758724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:56.764159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:56.769350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:56.777877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.028935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:57.029912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:57.046213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.046836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.047347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.050458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.051934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.054771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.575537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.591498 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-714868c4-074f-46a0-8130-548df394020c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.892317 Oct 04 18:15:57.593940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2481/4817] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:56 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.644854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a", "tag": "bca2530d-e1b5-48ba-9451-cbf4d9536d23"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:57.676964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:57.677744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:57.680264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:57.682326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:57.711711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc8dce58-2e6f-4380-adf6-a923a3c893d5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.686861 Oct 04 18:15:57.716971 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2337/4818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:57 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:15:57.730930 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] Creating event network-changed:bca2530d-e1b5-48ba-9451-cbf4d9536d23 for instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a on n-h2-831194-21 Oct 04 18:15:57.757184 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-84d5bc22-96a1-4551-80cb-873e5ac81e07 req-6bfebc2d-8a4a-41b0-86d4-ecdf3510dcf7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112755 Oct 04 18:15:57.762312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2482/4819] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:58.619222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.620152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.642436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.645495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.647072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.650542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.652430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.654177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.749460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:15:58.750492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:15:58.762164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.762673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.763126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:58.768957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:58.769500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:58.780524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.231441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.251110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a6b9e6f-b174-4d04-b139-154176e51107 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.507804 Oct 04 18:15:59.252020 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2483/4820] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:15:59.258583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d085b5-9fe6-4e9e-8b95-c2ec8c46e791", "tag": "7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:15:59.276547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:15:59.277040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:15:59.277479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:15:59.301608 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] Creating event network-changed:7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b for instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 on n-h1-831194-21 Oct 04 18:15:59.343099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dc518524-a8b9-407b-a390-2169d0460494 req-c491124c-4748-487d-ab15-649afc185043 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089568 Oct 04 18:15:59.353073 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2484/4821] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:15:59.479646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:15:59.494660 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a78d7dca-c9db-415e-804f-889c6b96b3ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.878657 Oct 04 18:15:59.495483 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2338/4822] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:15:58 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:00.278667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.279533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.293394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.293937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.294420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.298393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.298963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.301681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.512706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.513417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.529404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.534700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.540310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.543441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.544195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.548345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.652344 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52ce258b-2e70-421b-9a12-89fe1ec91f3f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/ips" status: 200 len: 150 microversion: 2.20 time: 0.142277 Oct 04 18:16:00.663223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2339/4823] 10.222.0.42 () {60 vars in 1289 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/ips => generated 150 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:16:00.686644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:00.687390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:00.721549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.722937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.723744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.724502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:00.724972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:00.743298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:00.866264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:01.125899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.178751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fab5b995-9dc7-498c-b92c-520fd53d8585 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.904366 Oct 04 18:16:01.179995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.200317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa3e10b2-118d-4997-a023-1c31efe40a40 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.525421 Oct 04 18:16:01.200317 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2340/4824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.227922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2485/4825] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:00 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:01.356933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.364726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.364726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Searching by: {'deleted': False, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c'} {{(pid=128850) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:01.388310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.388808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.389252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.390030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.390494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.391060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.486609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.multi_cell_list [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128850) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:01.573592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:01.578784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e549dcf-4e99-4e52-9a60-b793d5268022 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.226404 Oct 04 18:16:01.596415 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2341/4826] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:01.619118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:01.684068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:01.697767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Searching by: {'deleted': False, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:16:01.766859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.771623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.775162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.776446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:01.780474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:01.783476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:01.916306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:16:02.107693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:02.163322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.165708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.169693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.225486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.226287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.244509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.245020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.253372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.254340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.254836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.255452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.746293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-98e4cb26-6a63-4179-9030-43d1c0e5b761 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.149571 Oct 04 18:16:02.749784 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2486/4827] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:16:01 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:02.772403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:02.773569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:02.791613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.793821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.794542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:02.796254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:02.797876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:02.800294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.058083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.073304 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5e862ed-40a1-4101-8b71-290a0c5eb7de tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.321064 Oct 04 18:16:03.076868 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2487/4828] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:03.095036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bfd0311-f8a3-4609-bc43-ac5e045b7d84 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.119607 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4bfd0311-f8a3-4609-bc43-ac5e045b7d84 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.041346 Oct 04 18:16:03.121372 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2488/4829] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:03.501647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.503214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.510351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:03.523533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e6ebda2-a14c-4de5-8135-07b97dc84032 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 1.302974 Oct 04 18:16:03.526196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2342/4830] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:02 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:03.530209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.535100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.535574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.536341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.536824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.537241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.659859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:03.682329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:03.920838 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbf00764-d68a-4129-a0db-91365336ec35 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 204 len: 0 microversion: 2.1 time: 0.423104 Oct 04 18:16:03.925039 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2489/4831] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:03 2022] DELETE /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:03.938242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:03.942439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:03.956694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.961472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.963724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:03.964840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:03.966850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:03.969706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.108908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.109860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.133055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.133497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.134026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.144798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.145367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.145869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.502699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.513388 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-277873c5-7934-4049-9277-921bdbf4227a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1608 microversion: 2.1 time: 0.583255 Oct 04 18:16:04.522804 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2343/4832] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:03 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1608 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:04.562232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:04.563955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:04.600828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.601662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.602432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.603416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:04.603884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:04.604323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:04.978292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:04.987163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b17a537-e3fd-4c18-bc8b-9a048605de76 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.435158 Oct 04 18:16:04.989236 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2344/4833] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.186005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:05.201725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-901f66af-c1a3-4e77-80b0-1a97a252d3b7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 1.097714 Oct 04 18:16:05.208642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2490/4834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:04 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:05.562963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:05.569219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:05.595310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.597123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.598219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:05.604586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:05.605749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:05.606881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.019971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.021111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.070874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.071443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.071912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.072689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.073165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.073608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.085770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.101154 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de5a8f54-0574-49c4-81f7-f71dffb13c41 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1608 microversion: 2.1 time: 0.545678 Oct 04 18:16:06.122571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2345/4835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:05 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1608 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.129271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:06.146753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.154123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.154936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.155573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.156575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.157277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.157991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.217994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lazy-loading 'flavor' on Instance uuid e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:06.716465 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-87faa961-2871-48ef-b58c-b4bf1849894f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/action" status: 202 len: 0 microversion: 2.20 time: 0.591687 Oct 04 18:16:06.717752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2346/4836] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:16:06 2022] POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:06.727986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.733148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.748403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.751313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:06.754277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.754732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.756153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.757351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.761431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.774721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b4fba2f-6cfd-4fa1-9bc7-6b52b1fdd7e2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.763090 Oct 04 18:16:06.776150 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2491/4837] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:06.788236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:06.790202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:06.803756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.804928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.805931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:06.807586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:06.808826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:06.809929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.341171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.387550 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3096dcb6-dbeb-4207-a564-fd4a614a7d29 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.662795 Oct 04 18:16:07.390598 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2347/4838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:07.413254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d085b5-9fe6-4e9e-8b95-c2ec8c46e791", "name": "network-vif-plugged", "status": "completed", "tag": "7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:07.446888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.448456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.454863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.497538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] Creating event network-vif-plugged:7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b for instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 on n-h1-831194-21 Oct 04 18:16:07.511509 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7dc49a90-0e24-4ea8-bc56-51155342f9ce req-c94e0205-6ce1-4258-bca9-951aeb51896f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117551 Oct 04 18:16:07.514225 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2348/4839] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:07.530748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.536074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.554981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.556813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.557692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.560435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.563951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.564618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.792479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.826342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.840143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:07.852710 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e936e035-3d4b-41a5-8458-1fdbc1ea756d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 1.069054 Oct 04 18:16:07.855415 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2492/4840] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:06 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:07.881594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:07.887674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:07.914377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.920822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.921361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:07.922198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:07.922753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:07.923194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.281895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.297022 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-43b3d5f9-bd5c-4d43-8870-68d976750dee tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1608 microversion: 2.1 time: 0.781377 Oct 04 18:16:08.301915 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2349/4841] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1608 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.414574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.415113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.427494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.428001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.428442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.429155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.429609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.430065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.597004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.610478 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7705f4f7-8171-4c3a-8bd8-57fcef7a7c68 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.750575 Oct 04 18:16:08.622151 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2493/4842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:07 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.765202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:08.773263 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6a5562a-0fc8-451a-8af2-ac10c13efa22 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.364139 Oct 04 18:16:08.774213 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2350/4843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:08.891308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:08.891919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:08.906960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.907470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.918363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:08.918718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:08.919216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:08.919666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.328510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.330323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.344349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.381822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.382815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.383794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.387528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.388170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.551140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.567455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.577316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.584135 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47b1d242-39d1-4a8f-b632-ef4f43af1a24 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.696041 Oct 04 18:16:09.591297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2494/4844] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:08 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:09.621140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ae9152b-92e6-4cc1-80ba-e0fb603a793e", "name": "network-vif-deleted", "tag": "b181e1cd-15b3-49dd-9fc9-257adac5ec74"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:09.668130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.672907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.673451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.721926 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] Creating event network-vif-deleted:b181e1cd-15b3-49dd-9fc9-257adac5ec74 for instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e on n-h2-831194-21 Oct 04 18:16:09.738314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5e7a367a-a4a3-4aec-8cf8-11da28e8044b req-e198e5e8-4536-472b-97d2-08c0630f30da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143313 Oct 04 18:16:09.741058 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2495/4845] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:09.755991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:09.757808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.758772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:09.769103 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c59597b-75ed-4f63-a3cb-7c22fe7eb0cb tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1540 microversion: 2.1 time: 0.445400 Oct 04 18:16:09.775951 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2351/4846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1540 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:09.796566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.799486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.805991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.809136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.809638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.816609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.830918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a", "name": "network-vif-plugged", "status": "completed", "tag": "bca2530d-e1b5-48ba-9451-cbf4d9536d23"}, {"server_uuid": "6ae9152b-92e6-4cc1-80ba-e0fb603a793e", "name": "network-vif-unplugged", "status": "completed", "tag": "b181e1cd-15b3-49dd-9fc9-257adac5ec74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:09.885632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:09.889237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:09.889717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:09.941101 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Creating event network-vif-plugged:bca2530d-e1b5-48ba-9451-cbf4d9536d23 for instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a on n-h2-831194-21 Oct 04 18:16:09.942247 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] Creating event network-vif-unplugged:b181e1cd-15b3-49dd-9fc9-257adac5ec74 for instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e on n-h2-831194-21 Oct 04 18:16:09.958873 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5a3ac0d7-eb65-4c3e-a196-f297e060ffb2 req-7bedfea4-8c9b-448a-a6c4-29e85e69ae37 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.142434 Oct 04 18:16:09.959851 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2352/4847] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:09.985442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:09.988882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.003442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.004157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.004768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.005731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.007018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.007622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.296286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.310185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06aae09e-5e68-4ce8-b8da-597583b272f1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1314 microversion: 2.1 time: 0.565214 Oct 04 18:16:10.311061 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2496/4848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.500681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.513728 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-408706e6-1897-49eb-b4ce-51c972a99aac tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.543918 Oct 04 18:16:10.514412 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2353/4849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:09 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:10.646966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.647585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.649635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:10.667993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.668507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.669151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.670073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.670696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.671317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.822905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:10.823530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:10.841797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.842621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.843232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.844130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:10.844755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:10.845343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:10.980605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:10.992979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2abaf2a3-543e-4db3-b042-53e61cc2ef5b tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.176585 Oct 04 18:16:11.008253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.011626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2354/4850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:11.021309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.042765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.047121 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ebbd35c-8ecd-485b-becb-abeb29583633 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.404662 Oct 04 18:16:11.047715 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2497/4851] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:10 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:11.367686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.368808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.427835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.428717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.429497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.430780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.438967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.440167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.447370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:11.543166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:11.544595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:11.563744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.567858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.569604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.570622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:11.573678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:11.578971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:11.858512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:11.938994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:11.977262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e09332d-7981-48cf-844d-6f4019d571f7 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1314 microversion: 2.1 time: 0.423285 Oct 04 18:16:11.978446 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2498/4852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.023306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.033144 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac81d06c-e269-43cb-b468-dbc6ad3817b5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1501 microversion: 2.1 time: 0.685673 Oct 04 18:16:12.046814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2355/4853] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:11 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1501 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.068846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.070510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.100415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=18 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:12.115174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.117022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.117732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.119677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.120815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.121521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.127590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:12.328463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.352711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf36a856-b702-411b-93f0-7cdc140a5c25 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.303545 Oct 04 18:16:12.366896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2356/4854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:12.371369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-223450556", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "6864d7b0-2fde-4c29-aa73-4fa9a35c7168"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:12.386737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:12.394821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.410905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.411710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.413497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.415400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.417777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.420930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.495137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] validate_networks() for [('6864d7b0-2fde-4c29-aa73-4fa9a35c7168', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:12.542274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4b168ae-788d-4c94-8b80-1ff3cd754469 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.173364 Oct 04 18:16:12.547591 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2357/4855] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:12 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:12.549665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:12.553821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:12.568453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.569899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.572100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.572971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:12.574329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:12.575631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:12.765448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.778003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.779930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:12.781635 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3129746a-08ff-44bd-8544-d6a72ed4ec8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.236926 Oct 04 18:16:12.782785 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2358/4856] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:12 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:13.014071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.030892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.067680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.068379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.069529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.070525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.071350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.072070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.323149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:13.323775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:13.324416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:13.325060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:13.325701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:13.357189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.364692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.365350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.366197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.367576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.368685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.369315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0352b54e-63b7-45d3-bafd-31c421220fd4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1500 microversion: 2.1 time: 0.364955 Oct 04 18:16:13.370020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.381951 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2359/4857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1500 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.388776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.389691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.397345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.407847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.408544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.409694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.411638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.416267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.435668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Getting quotas for project e105dd41741f4d7090a959e56e75785c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:13.450891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Getting quotas for user 61e6702e93f143bab7fc243e11214cd0 and project e105dd41741f4d7090a959e56e75785c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:13.482379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:13.487349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:13.546385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.562837 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0fdba942-74cd-46b5-b4c7-6a439ea5fec9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.582170 Oct 04 18:16:13.563843 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2499/4858] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:13.573500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d5524d4-d9a5-443c-adaa-064bf8c61e68 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.188692 Oct 04 18:16:13.574479 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2360/4859] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.579471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.583024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.589961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.590709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.590833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:13.591462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.591658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.592535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.593327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.594048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.598658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.599165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.599616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.600345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.600810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.601253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.649414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'flavor' on Instance uuid b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:13.680768 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-deb602c4-e836-48db-b224-4c63cdcd029f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.104959 Oct 04 18:16:13.681431 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2361/4860] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:13.687493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf49e480-c027-4e75-8cba-348fa83f8e3d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.688472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf49e480-c027-4e75-8cba-348fa83f8e3d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.798071 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2356683-2420-445c-bb1f-b40097a572d8 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "POST /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a/action" status: 202 len: 0 microversion: 2.1 time: 0.221755 Oct 04 18:16:13.800686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf49e480-c027-4e75-8cba-348fa83f8e3d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:13.811354 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf49e480-c027-4e75-8cba-348fa83f8e3d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1214 microversion: 2.1 time: 0.127896 Oct 04 18:16:13.815712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2362/4862] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1214 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:13.817000 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2500/4861] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:13 2022] POST /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:13.838460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.839898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:13.841053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.841246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:13.855831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.860701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.861460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.861952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.862347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.863056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.864528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.864656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:13.865040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.865528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:13.865889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:13.866553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.193217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.199358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.209437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.211810 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6dde43d0-3f95-4a61-a8e6-d9ea269f8152 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1508 microversion: 2.1 time: 0.394558 Oct 04 18:16:14.212034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.213257 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8156838-a11b-49a2-ac75-65a30c123da7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.381936 Oct 04 18:16:14.214634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2501/4863] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:14.216797 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2363/4864] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:13 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1508 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.601598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.602252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.615192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.615705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.618111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.618940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.619962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.619962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.694300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:14.697375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.735278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.735877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.738113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.739052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.741891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.747550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.831737 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b9c6c70-7e23-49b4-a3d9-e1a2df8235fe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.143241 Oct 04 18:16:14.836201 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2364/4865] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:14 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:16:14.845250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:14.850548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:14.852047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.859877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.860386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.860848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.861158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac2adf0b-bb88-4e02-b900-e43bf988cb31 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.263793 Oct 04 18:16:14.862250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:14.862824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:14.863337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:14.881772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2502/4866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:14.961298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:14.972951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3360702f-c5b1-440b-ba0d-be96be519fba tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1218 microversion: 2.1 time: 0.131905 Oct 04 18:16:14.973529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2365/4867] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:14 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:15.240804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.241494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.242467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.242683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.255791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.256283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.256732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.257450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.257933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.258369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.282502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.289299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.291534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.295935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.299410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.301611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.603846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.617868 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ee41495-8db6-49b9-8a63-04dfd384897a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1491 microversion: 2.1 time: 0.385447 Oct 04 18:16:15.624842 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2503/4868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1491 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:15.646529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.654086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.655448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.661256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.663183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.663913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.664627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.664897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:15.665713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.666360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.666968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.668150 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5c6d84c-755c-40c0-b0ce-5b275fde7566 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.431909 Oct 04 18:16:15.671972 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2366/4869] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:15.719588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:15.738513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:15.845810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:15.866899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.899537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.908643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.911610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.912702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.916403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.917514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.948714 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f7cc90e6-b47f-41ab-b6e9-3cb053157d7a tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 204 len: 0 microversion: 2.1 time: 0.298152 Oct 04 18:16:15.955859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2504/4870] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:15 2022] DELETE /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:15.966629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:15.967655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:15.980081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.988355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.989334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:15.992850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:15.993621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:15.994568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.038166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-376e13fe-6588-4897-a302-365b19131a3c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.197917 Oct 04 18:16:16.039343 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2367/4871] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:15 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:16:16.053676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.057002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.085200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.086328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.086493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.087298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.087887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.088418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.195247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.204119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8dea07d3-6473-4c2c-9638-11c5598bc85a tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.246726 Oct 04 18:16:16.214063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2505/4872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:15 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.223164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.223164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.231358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.232401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.233107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.236417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.237210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.237951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.339645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.349680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-889f5bb1-dd72-4195-bda2-a1c111a93519 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1497 microversion: 2.1 time: 0.308113 Oct 04 18:16:16.351585 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2368/4873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1497 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.374643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.386378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4dc5d834-a2e8-4158-83b7-b735c3fef19a tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1284 microversion: 2.1 time: 0.180498 Oct 04 18:16:16.393916 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2506/4874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:16.717058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:16.718144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:16.727379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=90 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:16.732654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.733403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.734057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.734943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:16.735616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:16.736761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:16.961775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.992472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:16.999815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.003494 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74453178-3c9a-45df-aad3-96f8a66d3ebf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.293489 Oct 04 18:16:17.007066 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2369/4875] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:16 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:17.051311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:17.053636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.061481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.062021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.062465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.063181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.063633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.064067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.170003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-166af0fe-a228-43ef-8df1-4b59f753a2f7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.123278 Oct 04 18:16:17.174244 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2507/4876] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:17 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:16:17.233761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.234740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.242128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.243211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.243892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.244852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.245561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.246285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.338326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.350452 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02525842-5ab9-4fb4-8e3b-464df03c0038 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.121855 Oct 04 18:16:17.352315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2370/4877] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.377880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.378997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.388233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.389127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.389760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.390725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.392006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.393151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.416630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:17.417753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:17.440394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.441303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.442395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.443992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:17.445702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:17.447902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:17.671530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.680833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd26c84f-b020-4689-bfc1-a6cc68f162b5 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1497 microversion: 2.1 time: 0.308982 Oct 04 18:16:17.694448 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2508/4878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1497 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:17.928412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:17.945142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-597ee49f-b76d-4d8a-9529-61d77ede9af4 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1272 microversion: 2.1 time: 0.536266 Oct 04 18:16:17.956634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2371/4879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:17 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1272 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:18.045063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.046277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.056160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.057653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.058460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.059520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.061144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.061859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.184068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:18.186980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.210701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.213440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.215386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.217614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.218544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.221524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.299963 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8aff4ed8-694d-4178-b2cc-fe1dc9eac007 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.120103 Oct 04 18:16:18.300951 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2372/4880] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:18 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:18.383466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.384325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.409633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.410208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.412963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.415122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.415871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.418331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.656345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d9ea32e30bb4c9a9389b2b0e7318d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c8c65acdbfa4c549b971ebb407a215c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.673470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b770205-fe1b-4d06-a8f8-707bd58319d7 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 200 len: 1252 microversion: 2.1 time: 0.302656 Oct 04 18:16:18.693210 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2373/4881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:18.703714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a", "name": "network-vif-deleted", "tag": "bca2530d-e1b5-48ba-9451-cbf4d9536d23"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:18.737485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.751308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.751884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.754828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.772444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.778981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:18.780308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-331d4a0b-ba44-471e-892b-3354f7de9fa5 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1742 microversion: 2.20 time: 0.742937 Oct 04 18:16:18.780964 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2509/4882] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1742 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:18.788102 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] Creating event network-vif-deleted:bca2530d-e1b5-48ba-9451-cbf4d9536d23 for instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a on n-h2-831194-21 Oct 04 18:16:18.805153 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9acfd24f-28be-4bf4-a19a-ae69755c7fbe req-0bfe9f98-33b5-4971-bde5-dd47a924cf05 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106468 Oct 04 18:16:18.805907 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2374/4883] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:18.816573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.817208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.829509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.831099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.831725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.832898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.833549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.834199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.872970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.874185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.875422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.876200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'fault' on Instance uuid b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:18.970381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:18.971527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:18.990097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.991365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.991814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:18.992908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:18.993635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:18.994373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.057948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.072085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12c350c6-0dad-433d-9bdb-9cd90d0f379d tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1304 microversion: 2.1 time: 0.260973 Oct 04 18:16:19.072844 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2510/4884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1304 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:19.287800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:19.304550 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d7cd5e3-ac27-4d64-9dde-52c4f507ea4e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 0.338510 Oct 04 18:16:19.305702 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2375/4885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:18 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:19.315051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:19.323833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.331233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.332263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.333006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.337287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.338088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.338754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.402687 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecdb8f98-8e22-440f-b66e-193bbd9d88e9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.089715 Oct 04 18:16:19.405548 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2511/4886] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:19 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:19.714940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.717308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] [instance: 6ae9152b-92e6-4cc1-80ba-e0fb603a793e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.743113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.749519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.750830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.757215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.757590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.758548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.789397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:19.790968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] HTTP exception thrown: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Request method failure captured: Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e HTTP/1.1 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHfSlYJOxwLwKcN8XjLJR6PDoxdn5woFqWTqzuuGzRPLHzExCRv9bKIMQA_gMG_UrOwtGs-vtIy_7MbHs8X-9FuwigxNrtQpbDdZD9cE6zvDzSDndw-KonJK_NUpVd6GCNJ31LX9vIIHZh22N02QkZji9Acmi8n0y3vVeD-J-b9h8UY Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9c8c65acdbfa4c549b971ebb407a215c Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersTestBootFromVolume-1703006820 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9c8c65acdbfa4c549b971ebb407a215c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8c65acdbfa4c549b971ebb407a215c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9c8c65acdbfa4c549b971ebb407a215c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9c8c65acdbfa4c549b971ebb407a215c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersTestBootFromVolume-1703006820 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9c8c65acdbfa4c549b971ebb407a215c Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1703006820 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersTestBootFromVolume-1703006820-project Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 4d9ea32e30bb4c9a9389b2b0e7318d44 Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersTestBootFromVolume-1703006820-project Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6ae9152b-92e6-4cc1-80ba-e0fb603a793e'} Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:19.795127 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Returning 404 to user: Instance 6ae9152b-92e6-4cc1-80ba-e0fb603a793e could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:19.802686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94a752e9-7ede-4c27-b4c6-495728241804 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e" status: 404 len: 111 microversion: 2.1 time: 0.095830 Oct 04 18:16:19.809400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f7af352-0cc9-45d3-bfc3-0fb07cb48d23 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] Calling method '.version_select at 0x7fbdbd2591f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.825204 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2376/4887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/6ae9152b-92e6-4cc1-80ba-e0fb603a793e => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:19.837275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:19.839112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:19.849487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.857792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.859375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.860991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:19.862675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:19.869778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:19.876078 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f7af352-0cc9-45d3-bfc3-0fb07cb48d23 tempest-ServersTestBootFromVolume-1703006820 tempest-ServersTestBootFromVolume-1703006820-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-552607531" status: 202 len: 0 microversion: 2.1 time: 0.073826 Oct 04 18:16:19.883052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2512/4888] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 18:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-552607531 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:20.116598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.117499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.148192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.148711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.149173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.150699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.151234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.151783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.250540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.252493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.253303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.254114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lazy-loading 'fault' on Instance uuid b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:20.423006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ee29036e794a9786d576e4b33fb5ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '282a2f9a9e39470fa9b99180eeefd931', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:20.430958 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84200ee2-bb08-449f-8b2d-6835f8df4859 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 200 len: 1304 microversion: 2.1 time: 0.329691 Oct 04 18:16:20.435962 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2513/4889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 1304 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:20.849379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df8abd7-c25b-4850-8a7e-34a9b2e55678", "tag": "00aa8120-e770-4926-abbe-cd8ddd2460d1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:20.867214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.867705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.868141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.907686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] Creating event network-changed:00aa8120-e770-4926-abbe-cd8ddd2460d1 for instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 on n-h2-831194-21 Oct 04 18:16:20.924405 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d7c1a43a-ff71-4595-a139-624d8a16da64 req-798a8dd8-82d2-4296-8d9a-3e928b86195a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.485564 Oct 04 18:16:20.925229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2514/4890] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:20.940327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:20.941069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:20.962371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.963132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.963808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:20.964928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:20.965645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:20.978251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.193272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.203388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.205967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:21.211740 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-103a1544-5a17-4123-bd79-628704a837d2 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 1.384830 Oct 04 18:16:21.233418 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2377/4891] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:19 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:21.249981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:21.272135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.293115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.298462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.299351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.300755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.305154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.306003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.419397 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5e38ce8-30c5-4a66-96ba-b0ec050eccd0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.183388 Oct 04 18:16:21.427766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2378/4892] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:21 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:21.444961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-plugged", "status": "completed", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:21.499929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.506179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.512490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.548750 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] Creating event network-vif-plugged:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h1-831194-21 Oct 04 18:16:21.566485 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-55537ad1-9eb7-434c-9423-58322ba70176 req-3987132a-1891-48b2-a54b-526da3a9660c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136927 Oct 04 18:16:21.567482 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2379/4893] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:21.585003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.585901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.603918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.604472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.604951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.605669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.606521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.606960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.636357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a HTTP/1.1 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a'} Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.637986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89fa8b07-de88-4a8e-bc28-7011d0e61400 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 404 len: 111 microversion: 2.1 time: 0.070923 Oct 04 18:16:21.644485 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2380/4894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:21.653009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.653514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.660770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.663747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.664270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.665074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.665612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.666155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.687915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a HTTP/1.1 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a'} Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.690518 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.695320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.698285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.699408 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd05ebb8-cf60-4376-bd9b-e14c5143b3fa tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 404 len: 111 microversion: 2.1 time: 0.051094 Oct 04 18:16:21.700719 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2381/4895] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:21 2022] DELETE /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:21.715562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.717277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.733625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.734552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.735200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.736797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.737487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.738427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.771240 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a HTTP/1.1 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a'} Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.773295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. Oct 04 18:16:21.778046 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.780557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.781709 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-752365ef-9546-4978-8311-f545f9ee6906 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a" status: 404 len: 111 microversion: 2.1 time: 0.076072 Oct 04 18:16:21.782918 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2382/4896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/b7bf1c41-0e5e-446d-8aaf-77a9c8f94c4a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:21.794314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.802752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.823597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.830380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.831539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.834029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.838206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.841265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.902971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd HTTP/1.1 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'eecddec8-c7ef-41d9-b343-435bdc8008cd'} Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:21.904937 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:21.909647 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:21.913181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:21.914407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a60d84b3-83de-4de6-b2cf-5495b77e78ba tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 404 len: 111 microversion: 2.1 time: 0.126930 Oct 04 18:16:21.915552 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2383/4897] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:21 2022] DELETE /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:21.934482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:21.935751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: eecddec8-c7ef-41d9-b343-435bdc8008cd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:21.950451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.953370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.957850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:21.959122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:21.959918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:21.964886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.024979 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd HTTP/1.1 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'eecddec8-c7ef-41d9-b343-435bdc8008cd'} Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.027198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. Oct 04 18:16:22.031795 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.036486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance eecddec8-c7ef-41d9-b343-435bdc8008cd could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.038967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-11fb9e73-5d1f-4863-b1f0-45bf76bfc8d4 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd" status: 404 len: 111 microversion: 2.1 time: 0.116825 Oct 04 18:16:22.044328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2384/4898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:21 2022] GET /compute/v2.1/servers/eecddec8-c7ef-41d9-b343-435bdc8008cd => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.060016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.061026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.069569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.070461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.071201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.072280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.072984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.073685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.096571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb HTTP/1.1 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '8d582fff-6bfd-4a70-be3f-8cd352b53edb'} Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.099023 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.103578 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.106121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.107424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fea9a30a-64cc-4f39-89b0-1bf6bcd8b978 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 404 len: 111 microversion: 2.1 time: 0.056581 Oct 04 18:16:22.112150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2385/4899] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:22 2022] DELETE /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.118223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.119346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 8d582fff-6bfd-4a70-be3f-8cd352b53edb] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.130111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.130935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.131634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.132572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.133255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.133941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.151435 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb HTTP/1.1 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '8d582fff-6bfd-4a70-be3f-8cd352b53edb'} Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.153389 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. Oct 04 18:16:22.161415 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.163778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 8d582fff-6bfd-4a70-be3f-8cd352b53edb could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.164881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6aefddae-7015-4dbd-a509-5b81b1f18564 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb" status: 404 len: 111 microversion: 2.1 time: 0.051361 Oct 04 18:16:22.165669 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2386/4900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/8d582fff-6bfd-4a70-be3f-8cd352b53edb => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.175875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.177165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.219779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.222264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.222962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.223972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.226834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.227382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.249709 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad HTTP/1.1 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a4906c2e-85c2-4a22-9af8-54f87cd227ad'} Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.252730 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.260112 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.263036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.264227 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-616be4d9-bf4a-467e-ae63-f58abeb6f075 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 404 len: 111 microversion: 2.1 time: 0.094043 Oct 04 18:16:22.268726 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2387/4901] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:22 2022] DELETE /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:22.275412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.276506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.286479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.287584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.289074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.290104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.290798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.291473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.446046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.457151 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce508478-ed1a-4b56-b380-b4b3d6594b34 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 1.530621 Oct 04 18:16:22.475684 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2515/4902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:20 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 1550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:22.493964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.494881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: a4906c2e-85c2-4a22-9af8-54f87cd227ad] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.510960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.511674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.512414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.521365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.522340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.523212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.574142 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad HTTP/1.1 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a4906c2e-85c2-4a22-9af8-54f87cd227ad'} Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.577128 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance a4906c2e-85c2-4a22-9af8-54f87cd227ad could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b522b38d-431f-49d7-9ca8-e584708d63cf tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad" status: 404 len: 111 microversion: 2.1 time: 0.102134 Oct 04 18:16:22.590120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2516/4903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/a4906c2e-85c2-4a22-9af8-54f87cd227ad => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.607751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:22.624021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.654510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.655988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.657198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.659530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:22.660692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:22.661949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:22.791811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7bdd434d-f50a-422d-b97a-5a39d2e75303 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 14 microversion: 2.1 time: 0.209452 Oct 04 18:16:22.793321 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2517/4904] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:22 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 14 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:16:22.803212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.804239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.827788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a HTTP/1.1 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0c68dce9-e008-454e-b6d5-76bd96a6326a'} Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.843048 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.857340 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.860783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.860783 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d04c19aa-3b28-4eda-9283-798b60e5fe44 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a" status: 404 len: 111 microversion: 2.1 time: 0.064920 Oct 04 18:16:22.863522 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2518/4905] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:22 2022] DELETE /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.871674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:22.882857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: 0c68dce9-e008-454e-b6d5-76bd96a6326a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:22.897024 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a HTTP/1.1 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '0c68dce9-e008-454e-b6d5-76bd96a6326a'} Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:22.898943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:22.904951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:22.904951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:22.904951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:22.904951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. Oct 04 18:16:22.904951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:22.909879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance 0c68dce9-e008-454e-b6d5-76bd96a6326a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:22.911019 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65005c2f-90ca-4ff7-ad94-00d77f80096b tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a" status: 404 len: 111 microversion: 2.1 time: 0.045918 Oct 04 18:16:22.912109 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2519/4906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/0c68dce9-e008-454e-b6d5-76bd96a6326a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:22.922110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.937593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.945933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:22.957245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34b2d39e-3020-4eb9-8e5a-380d19bd54d6 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.686873 Oct 04 18:16:22.975665 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2388/4907] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:22 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:23.500189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.500963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.521726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:23.522437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:23.547408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.564573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.565248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.566424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.567104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.567719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.805316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:23.807773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.820415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:23.822388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.826888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.827588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.828505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.829146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.829822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.896920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e3938f7-8bf9-4b30-8c11-a51fe59a29a7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action" status: 200 len: 8207 microversion: 2.1 time: 0.096302 Oct 04 18:16:23.898229 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2389/4908] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:23 2022] POST /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791/action => generated 8207 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:23.911553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:23.920439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:23.948568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.952078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.952831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:23.955899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:23.960010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:23.961650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.226769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.241005 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-366c8085-5038-4e28-86e9-2c1e19826597 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 0.745924 Oct 04 18:16:24.242313 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2520/4909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.250114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.251923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.284940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.285865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.288296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.290881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.291598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.293174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.542828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.560828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.566690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.568540 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3bea5970-a104-4df0-941c-6447c149e33f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.324932 Oct 04 18:16:24.597395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2521/4910] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:24.778719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:24.794906 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac46aaf2-6dc5-49cd-a54f-c08797018753 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.890791 Oct 04 18:16:24.805960 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2390/4911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:23 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:24.836658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:24.837592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:24.855582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.858820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.863389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:24.868055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:24.871330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:24.873096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.266136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.273177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.274007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.278500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d6594af-b17a-476f-ba90-e8efa598c313 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.445877 Oct 04 18:16:25.279098 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2522/4912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:24 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:25.296922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.306352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.309989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.311431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.311634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.312247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.323232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.324195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.324709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.325160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.325922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.326396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.326838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.327027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.754410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:25.777068 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc4e41ae-dabd-4e4d-9d7f-5b17620544cc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.466822 Oct 04 18:16:25.778171 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2523/4913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:25.786480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:25.794727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:25.808575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.809392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.810067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.810994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:25.811633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:25.822666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:25.834264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:26.269258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.285579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.287459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.288919 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ab260e0d-9ff2-4d19-8095-a88e11980e2f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.509114 Oct 04 18:16:26.289950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2524/4914] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:26.296892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:26.297940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.306608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.307506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.308350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.309353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.310239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.311378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.509358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.553529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-899045bd-a7d3-4ce1-a99f-78e3b3f2de2d tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 1.280572 Oct 04 18:16:26.560660 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2391/4915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:25 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.847885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:26.861732 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ab79d22-26a4-4c44-af91-dda66451564b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.569009 Oct 04 18:16:26.862561 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2525/4916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:26 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:26.908673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:26.909511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:26.946272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.950657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.953899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:26.955050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:26.962558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:26.968737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.088399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Locking {{(pid=128850) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 04 18:16:27.181899 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f67313f7-b51f-4bd8-8d3d-960441cc0de7 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.278330 Oct 04 18:16:27.183721 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2392/4917] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:26 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:16:27.192791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.193522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.214912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.217337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.217964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.219481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.221196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.221678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.342726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.343365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.389497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.390049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.393933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.397420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.397974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.401319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.664357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:27.680899 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d565aac8-fb73-4097-9245-6a2392ef0758 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.493206 Oct 04 18:16:27.684264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2526/4918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:27.702264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:27.712318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:27.736884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.741485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.742050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:27.748944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:27.749448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:27.749931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.105661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.116333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.133284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.135158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2852d925-667a-420a-8a70-9530b3765422 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.796975 Oct 04 18:16:28.159688 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2393/4919] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:16:28.171793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.181073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.181953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.182692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.186472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:28.213232 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9e031e2-0737-4cd8-84f7-389d63a75ae6 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 0.527179 Oct 04 18:16:28.214424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2527/4920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:27 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:28.228450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-580351629", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "490152e8-6532-4c3b-8fba-987fd0feff0f"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.239856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action HTTP/1.1 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 15 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: {"os-stop": {}} Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '822485e1-d0c7-4c5a-959d-5a0ddd55d640', 'body': {'os-stop': {}}} Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked Oct 04 18:16:28.242763 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:28.249959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 409 to user: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 is locked {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:28.252492 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2cce236e-7575-47bd-8560-cc1962d4873f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 409 len: 107 microversion: 2.1 time: 0.091717 Oct 04 18:16:28.253612 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2394/4921] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 107 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:16:28.265704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.277060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.296860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.297370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.297819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.304991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.305602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.306090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.362101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] validate_networks() for [('490152e8-6532-4c3b-8fba-987fd0feff0f', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:16:28.480262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Unlocking {{(pid=128850) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:16:28.609179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:28.638239 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71f946e0-5349-43e0-9b60-44d65d5f99c3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.377330 Oct 04 18:16:28.639842 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2395/4922] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:28.662762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:28.679784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.680361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.680862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.723738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Going to try to stop instance {{(pid=128850) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:16:28.913919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28364aea-e15d-4d60-af8d-48e1e818f62e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.261620 Oct 04 18:16:28.924901 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2396/4923] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:28.931135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:28.931845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:28.968341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.968764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.969178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:28.975535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:28.984934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:28.985428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.510047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:29.518458 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c570fc15-d8e5-4b35-87ba-11afc73a8961 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.591944 Oct 04 18:16:29.522532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2397/4924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:28 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:29.533964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:29.534693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:29.566331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.567462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.568206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:29.569495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:29.570087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:29.570532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.075979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:16:30.076433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:16:30.076887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:16:30.077303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:16:30.077726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:16:30.103431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.103938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.104377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.105123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.105587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.106062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.167351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Getting quotas for project 2882eb4bf472464aa109062eb3d65517. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:16:30.176586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Getting quotas for user aa3cf22c31ed4a00902ad4724c8470aa and project 2882eb4bf472464aa109062eb3d65517. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:16:30.201375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.223100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.228030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.228563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:16:30.233286 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0e1ccc5-1dcb-4ff0-b6e2-07d9ef64ff39 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.704495 Oct 04 18:16:30.233899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:16:30.288763 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2398/4925] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:29 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:30.302388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.311285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.329195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.331907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.342694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.343406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.343766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.344202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.387341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:30.442921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1287c720-ae3f-421a-9616-273d00a764a5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.223199 Oct 04 18:16:30.450809 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2528/4926] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:16:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:16:30.460615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df8abd7-c25b-4850-8a7e-34a9b2e55678", "name": "network-vif-plugged", "status": "completed", "tag": "00aa8120-e770-4926-abbe-cd8ddd2460d1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:30.483388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.483883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.484514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.541686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] Creating event network-vif-plugged:00aa8120-e770-4926-abbe-cd8ddd2460d1 for instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 on n-h2-831194-21 Oct 04 18:16:30.549710 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-00e242bf-16d0-41c1-9764-5d75a9d3cce5 req-7b393729-8ac7-4a7e-828b-4f2201e3a50c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097280 Oct 04 18:16:30.555264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2529/4927] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:30.562564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0244e058-d6b6-4978-ba42-a5b49cbae517 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.563300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0244e058-d6b6-4978-ba42-a5b49cbae517 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.899090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0244e058-d6b6-4978-ba42-a5b49cbae517 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:30.917637 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0244e058-d6b6-4978-ba42-a5b49cbae517 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1213 microversion: 2.1 time: 0.360747 Oct 04 18:16:30.936767 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2530/4928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1213 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:30.948648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:30.949091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:30.977724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.978429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.978752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:30.979492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:30.979965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:30.980399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.461597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.491999 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-41179507-4c66-4882-9d6a-3a561461f674 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.552728 Oct 04 18:16:31.493123 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2531/4929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.516789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.520036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:31.544559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.544963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.545553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.546252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:31.546726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:31.547171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:31.723765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.738213 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58b811c1-cb3a-427e-811c-ad4d17124866 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1314 microversion: 2.1 time: 1.447793 Oct 04 18:16:31.746694 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2399/4930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:30 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1314 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:31.844580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.867688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.874988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:31.883105 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8c467d1-e82a-4da5-ad9e-a0b17751a520 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.387656 Oct 04 18:16:31.887455 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2532/4931] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:31.966641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:31.967402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.010612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.012892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.015071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.016159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.018055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.022112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.342952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:32.356923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3565fdec-e227-4047-854f-688f3bef5a93 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1217 microversion: 2.1 time: 0.414943 Oct 04 18:16:32.365812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2400/4932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:31 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1217 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:32.523209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.524633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.594335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.595619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.596424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.597570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.598297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.598752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.784639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:32.785678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:32.832258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.850115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.856632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:32.857387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:32.858108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:32.858857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.078600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.120960 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e27ae911-48d9-4962-87e0-8d1b6a082a9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.601801 Oct 04 18:16:33.123010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2533/4933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:33.164583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.171365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.212763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.214089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.215250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.218778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.219486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.221331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.784305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.799224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.802966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:33.805607 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d259ea67-c19e-42ef-8823-7772d47837c9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.676850 Oct 04 18:16:33.810575 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2534/4934] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:33.823449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:33.824418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:33.869663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.883316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.884059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:33.885334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:33.886082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:33.886694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.402532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.418988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0320f830-137d-4c71-9dfc-ea97b48a0344 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1271 microversion: 2.1 time: 0.606913 Oct 04 18:16:34.443673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2535/4935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:33 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1271 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.466061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.466770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.479160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:34.488386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.490899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.493614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.497426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.499120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.500597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.501867 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4bac4a4-8067-42ae-be50-fb764ba1b0a9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1501 microversion: 2.1 time: 1.726249 Oct 04 18:16:34.504673 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2401/4936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:32 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1501 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:34.558549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:34.560182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:34.586379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.605043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.605524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:34.613366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:34.617752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:34.618474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.253252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.277416 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c476dbe-d7b5-460e-83db-3da539407cb1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.817845 Oct 04 18:16:35.278679 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2536/4937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.285387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.292802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.314068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.314939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.315584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.319870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.323050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.323918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.655033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:35.683812 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-540a26cd-9f9a-4a66-a95a-7e325f408399 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1501 microversion: 2.1 time: 1.157493 Oct 04 18:16:35.692065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2402/4938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:34 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1501 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:35.713897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:35.717134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:35.740003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.744880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.748532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:35.759635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:35.760441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:35.763189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.075293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.091846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.096295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.100776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ef2e611-0517-4b22-a38e-960e6f74a6a7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.817258 Oct 04 18:16:36.117856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2537/4939] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:36.117856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:36.117856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.135459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.136992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.138466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.141134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.142523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.144606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.214272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lazy-loading 'flavor' on Instance uuid 3df8abd7-c25b-4850-8a7e-34a9b2e55678 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:36.526878 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2aa27913-af2f-4321-aa04-2953b8fb953c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action" status: 202 len: 0 microversion: 2.1 time: 0.408991 Oct 04 18:16:36.534115 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2538/4940] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:36 2022] POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:36.550262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.551641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.559259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.560188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.561080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.562304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.563029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.565415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.915432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:36.931243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a4e9e9f-4379-450d-bb4c-abb13dfb45fa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.395339 Oct 04 18:16:36.934988 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2539/4941] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:36.946819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:36.948291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:36.989727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:36.992269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:36.993009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:36.995407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:37.006627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:37.010556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.021205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.050014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83803025-127a-4d6d-a17e-6fa1057425a3 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1509 microversion: 2.1 time: 1.105349 Oct 04 18:16:38.050968 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2540/4942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:36 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1509 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.064988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.065929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.112963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.122922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.125199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.128234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.130007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.132472 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e724295-697f-47ca-846a-d98daeb66303 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 2.434879 Oct 04 18:16:38.132639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.132963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.133712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2403/4943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:35 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:38.155610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:38.158203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:38.177222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.179404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.181612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.183774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:38.186238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:38.186875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:38.256423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:38.799124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.820438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.830758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.832414 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad8d81aa-d17f-47a9-bcdc-3b45da6e82fb tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.780270 Oct 04 18:16:38.862806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2541/4944] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:38.873716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:38.888141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d70080e-d2b6-49bd-a279-d92e7d238ef6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.749586 Oct 04 18:16:38.891071 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2404/4945] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:38 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.088523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.089866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.139313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.157437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.159361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.169017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.171155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.176142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.178584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.179118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.187229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.196316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.200016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.201592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.205725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.212423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.774501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.793739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6aef3c0f-dc9b-4488-8694-9c36df545557 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.640950 Oct 04 18:16:39.795777 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2405/4946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:39.805384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4170756-0fb8-40f3-8348-e18e18d49209", "tag": "9481313e-1ab6-4d65-b80a-4eb9de6e4037"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:39.830313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.830882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.831346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.855154 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] Creating event network-changed:9481313e-1ab6-4d65-b80a-4eb9de6e4037 for instance a4170756-0fb8-40f3-8348-e18e18d49209 on n-h2-831194-21 Oct 04 18:16:39.869718 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-28c00b5f-74da-4260-b604-625157e400c6 req-7f692585-61c3-42fc-a912-0277f07101cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071920 Oct 04 18:16:39.870339 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2406/4947] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:39.876899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:39.878051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:39.894338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.895067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.895756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.896830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:39.897573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:39.898272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:39.945001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:39.954704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5e1f5e2-5609-469d-86b0-5d54d5f32c94 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1492 microversion: 2.1 time: 0.879260 Oct 04 18:16:39.994454 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2542/4948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1492 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:40.035496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.036211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.059578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.060203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.066858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.081874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.082810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.083346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.164519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:40.340660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.350454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.366934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:40.368118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8ab7db4-dcfc-4d7a-b8aa-401a63c04c65 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.496579 Oct 04 18:16:40.368725 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2407/4949] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:40.389730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:40.390326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.412668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.413252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.413941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.414920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.423406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.424139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.573383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a1e1a7d-2510-4bac-8761-f3789118c014 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action" status: 202 len: 0 microversion: 2.1 time: 0.203304 Oct 04 18:16:40.576229 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2408/4950] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:40 2022] POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:40.588639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:40.591179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:40.613268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.616091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.618065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.619778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:40.620937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:40.624098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:40.916238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:41.098248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.122809 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1767beda-d908-4f42-a548-8e9826185707 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1658 microversion: 2.1 time: 1.112439 Oct 04 18:16:41.124882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2543/4951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1658 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:41.154463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.159318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.175401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.176260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.176742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.182335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.182929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.183453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.451623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.464832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c9d89b2-4c57-4841-90a0-4432cb308a4c tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1498 microversion: 2.1 time: 0.884683 Oct 04 18:16:41.469906 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2409/4952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:40 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1498 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:41.497573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:41.519338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.525250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.526100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.547301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:41.557729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f483c95-804f-4079-a9f6-4abb8b87f0f9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.431594 Oct 04 18:16:41.570817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:16:41.572187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2544/4953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:41.582911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.583870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.595469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.595979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.596423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.597144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.597603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.598190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.661235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:41.744083 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e24259e-6cbe-46fc-8117-7d08e7a5cfda tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.272313 Oct 04 18:16:41.745461 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2410/4954] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:41 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:41.753617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.754617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.762630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.763462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.764139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.765079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.765758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.766797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.815159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc HTTP/1.1 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'cc456396-c944-42e6-a70a-e8e92ea83ebc'} Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:41.817378 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:41.820488 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:41.823235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:41.824545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c12182e-11ff-4a3b-a0a0-4d4d90d7f666 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 404 len: 111 microversion: 2.1 time: 0.077586 Oct 04 18:16:41.825626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2411/4955] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:41 2022] DELETE /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:41.830916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:41.832168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:41.839732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.840338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.840893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:41.841744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:41.842811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:41.843372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.037207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.054596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.060511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.066293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-39910377-9d98-4126-84cf-2f7bfc05e85d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.491651 Oct 04 18:16:42.085862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2545/4956] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:42.085862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.085862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: cc456396-c944-42e6-a70a-e8e92ea83ebc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.109374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.114073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.119047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.122012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.124772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.125396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.179180 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc HTTP/1.1 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'cc456396-c944-42e6-a70a-e8e92ea83ebc'} Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.186584 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. Oct 04 18:16:42.189905 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.192578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance cc456396-c944-42e6-a70a-e8e92ea83ebc could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:42.195793 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-004b372b-f40e-41ac-8e88-4a013797383f tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc" status: 404 len: 111 microversion: 2.1 time: 0.122114 Oct 04 18:16:42.196599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2546/4957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/cc456396-c944-42e6-a70a-e8e92ea83ebc => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:42.208992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.210488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.227324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.228226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.233473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.234608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.236344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.237081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.274867 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd HTTP/1.1 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c546d831-d1dc-4f64-ab14-64628bed90fd'} Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:42.278782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.285224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:42.287488 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4720e592-9339-433d-80d4-cc6ace0496e9 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 404 len: 111 microversion: 2.1 time: 0.084464 Oct 04 18:16:42.294445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2547/4958] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:42 2022] DELETE /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:42.300608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.302550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] [instance: c546d831-d1dc-4f64-ab14-64628bed90fd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.317918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.318716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.322436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.323356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.323951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.324500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.358627 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] HTTP exception thrown: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Request method failure captured: Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd HTTP/1.1 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbyazihp4FYmw02YjfQaD-NQJTTuAn7rGi_kHlRyrKKAK7uWj4lK-U1ZXzAgWjOxVGXvku1p1YfUmG6DU_5RGLSseJetjFJP_qtQqEUC8YtcT0YpSOKNGkRG8XBjhJNYI5ilZ_7WLe5Dp0tviLxhFhtbpTS7a0LkitLgRHokJ7lzgs Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_282a2f9a9e39470fa9b99180eeefd931"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 282a2f9a9e39470fa9b99180eeefd931 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-1689884009 Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 77ee29036e794a9786d576e4b33fb5ef Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-1689884009-project Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c546d831-d1dc-4f64-ab14-64628bed90fd'} Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:42.360849 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. Oct 04 18:16:42.367028 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:16:42.368610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] Returning 404 to user: Instance c546d831-d1dc-4f64-ab14-64628bed90fd could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:42.369729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28c9454c-0d3e-41f7-a1bb-f73d9e255839 tempest-DeleteServersTestJSON-1689884009 tempest-DeleteServersTestJSON-1689884009-project] 10.222.0.42 "GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd" status: 404 len: 111 microversion: 2.1 time: 0.073736 Oct 04 18:16:42.374750 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2548/4959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/c546d831-d1dc-4f64-ab14-64628bed90fd => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:16:42.496576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.497557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.508872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.512063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.513745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.514772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.520242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.520996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.701446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:42.727430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d29a0f9-92cc-4a8a-893c-620f4f64b614 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1667 microversion: 2.1 time: 0.896919 Oct 04 18:16:42.729858 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2412/4960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:41 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1667 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:42.758480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:42.763712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:42.789566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.795968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.797006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:42.798584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:42.799269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:42.799717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.384741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:43.399511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27049dcf-2888-4f69-96ff-e3da832fb778 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.663783 Oct 04 18:16:43.406172 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2413/4961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:43.424388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:43.426428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:43.448058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.455745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.457526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:43.459158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:43.460254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:43.462232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.408574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:44.424947 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c29fffca-51ec-4c82-9307-92c7e62af0f7 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1498 microversion: 2.1 time: 1.935887 Oct 04 18:16:44.430749 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2549/4962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:42 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1498 bytes in 1942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:44.443951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:44.445011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:44.472625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.473479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.474211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:44.475792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:44.477778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:44.479100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.061324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.098999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.109579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.112688 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0b7a0a9-dbcc-412c-a2ed-1efefe6e3371 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 1.704516 Oct 04 18:16:45.114097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2414/4963] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:43 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:45.125180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.126602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.155303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.161539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.163806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.165958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.169270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.173550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.901434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.914324 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2707302c-990d-4f59-97d3-23ff7c53f7e5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.796398 Oct 04 18:16:45.944672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2415/4964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:45.961982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:45.965422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:45.983638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.984328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.984952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:45.986858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:45.987012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:45.989808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:45.991494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.034817 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-178284d5-88d8-48df-8437-df9ef927fca1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1667 microversion: 2.1 time: 1.600749 Oct 04 18:16:46.039321 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2550/4965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:44 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1667 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:46.149451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.154327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.183334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.184220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.184998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.186325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.194242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.195059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.743933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.766112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.770982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.776024 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6b29a92-57c1-4be4-8b9e-d44631edd6ff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.633003 Oct 04 18:16:46.805209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2551/4966] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:46.821371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:46.841310 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf465d32-7994-40fb-8bb1-33b76ca59d35 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1501 microversion: 2.1 time: 0.893694 Oct 04 18:16:46.842288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2416/4967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:45 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1501 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:46.880221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:46.881654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.905381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.906120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.907271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.912829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.913795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.914585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.952126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:46.952751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:46.967827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=96 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:46.976424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.982480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.986507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:46.990935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:46.996146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lazy-loading 'flavor' on Instance uuid 3df8abd7-c25b-4850-8a7e-34a9b2e55678 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:16:46.996694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:46.998075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.265065 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c313985-1cfd-4d11-9188-b58ebb25b584 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action" status: 202 len: 0 microversion: 2.1 time: 0.392550 Oct 04 18:16:47.275233 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2552/4968] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:46 2022] POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:47.281251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.312617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.323434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.324608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.325573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.327734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.328633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.329450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.584345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:47.617430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee6de85d-a79b-406f-966b-09ae0477e6f3 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.668915 Oct 04 18:16:47.626830 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2417/4969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:46 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:47.651764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:47.655667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:47.673371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.675779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.678590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:47.679990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:47.698615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:47.699266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.193977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.202998 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a51720d-4609-4bc8-8f81-22148ca0dfd5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.926145 Oct 04 18:16:48.209267 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2553/4970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:48.227065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.231157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.252693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.253546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.254331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.255200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.258411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.259228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.261167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.264560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b55fb6e-f949-4a56-8214-068c55a81036 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1509 microversion: 2.1 time: 0.636620 Oct 04 18:16:48.270164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2418/4971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:47 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1509 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:48.279731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4170756-0fb8-40f3-8348-e18e18d49209", "name": "network-vif-plugged", "status": "completed", "tag": "9481313e-1ab6-4d65-b80a-4eb9de6e4037"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:48.317709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.319002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.325929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.355501 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] Creating event network-vif-plugged:9481313e-1ab6-4d65-b80a-4eb9de6e4037 for instance a4170756-0fb8-40f3-8348-e18e18d49209 on n-h2-831194-21 Oct 04 18:16:48.369242 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-29a9b0c3-2e7f-4979-a8e2-0167f298d4ee req-fa5f2a5b-2baa-4286-9dfb-4458d9ba5930 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097199 Oct 04 18:16:48.370238 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2419/4972] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:48.379356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.380087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.403389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.403906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.404369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.405104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.405575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.432310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.804410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.820736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.836138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:48.838801 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8739fbd-a3e2-4a0a-b8ef-0bcbedf299d7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.627344 Oct 04 18:16:48.839607 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2554/4973] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:48.877281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:48.883235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:48.909701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.910363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.910986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:48.911980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:48.912551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:48.913084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.478655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:49.505100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a326f7d1-670e-40d9-94b6-2ace4adb5f5b tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1313 microversion: 2.1 time: 0.664457 Oct 04 18:16:49.505693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2555/4974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1313 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:49.531055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:49.542885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:49.562156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.578709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.579197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:49.580282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:49.580951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:49.581590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.281985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.295293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-298e9821-1203-450e-a9f1-803a36d7e747 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1492 microversion: 2.1 time: 0.768062 Oct 04 18:16:50.310883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2556/4975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:49 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1492 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:50.314871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:50.315505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:50.336723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.337515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.338191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.340479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.341310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.346893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.815178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.830145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81c52c2c-9a5e-4b58-b85e-aef74277040b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 2.454893 Oct 04 18:16:50.836613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2420/4976] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:48 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 2462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:50.854931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:50.860081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:50.881814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.882371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.882833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.883563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:50.884027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:50.884464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:50.885289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.920216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.927441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:50.935659 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-390628b1-4e94-4a31-b471-811ae853a8e9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 0.619369 Oct 04 18:16:50.938246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2557/4977] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:50 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:50.963582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:50.976416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.023067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.024269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.026555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.028178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.029259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.041066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.181893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:51.220390 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ca16ce5-48e2-4dd9-bcfc-8d34fadfbd21 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action" status: 202 len: 0 microversion: 2.1 time: 0.371857 Oct 04 18:16:51.227188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2421/4978] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:50 2022] POST /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678/action => generated 0 bytes in 390 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:51.244240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:51.252984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.274891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.277436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.279172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.284533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.288179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.288929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.427932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Unlocking {{(pid=128850) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 04 18:16:51.647665 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd9a5154-03d4-49e7-a091-8d5e737372bc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.418040 Oct 04 18:16:51.647665 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2422/4979] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:51 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:51.681895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:51.685535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:51.714111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.714111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.714111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:51.724013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:51.733109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:51.733902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:52.909118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.959680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7147a9f7-4020-4062-b2b2-47a5917e8417 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1498 microversion: 2.1 time: 1.303310 Oct 04 18:16:52.971593 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2423/4980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:51 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1498 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:52.982823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:52.992379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:52.994716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.010650 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2a3535e-87de-4a3a-9fca-15c4168aa35a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1498 microversion: 2.1 time: 2.068897 Oct 04 18:16:53.011464 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2558/4981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:50 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1498 bytes in 2071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:53.028321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.048687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.049943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.051527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.054710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.059315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.077541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:53.083159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:53.100285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.102714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.104048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.106421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:53.108440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:53.111532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:53.243213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:16:54.425793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.465599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.476978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.486692 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b50ebdd3-3b53-4538-88a9-c70a26b8c0be tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1737 microversion: 2.20 time: 1.416610 Oct 04 18:16:54.489594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2559/4982] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:53 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1737 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:54.505932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.512536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.534003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.534856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.537159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.540394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.541350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.544143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.570306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:54.586894 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36dcded3-1496-4ec5-b5f6-f0000b69b95c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.610897 Oct 04 18:16:54.591605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2424/4983] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:52 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:54.606314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.610562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.622879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.626616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.627242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.628173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.629759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.630362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.684379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:16:54.894703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aaa959cf-0675-4cdd-8662-0a557c0bbfce tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 204 len: 0 microversion: 2.1 time: 0.297863 Oct 04 18:16:54.898105 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2425/4984] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:16:54 2022] DELETE /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:16:54.917685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:54.919059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:54.940822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.945046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.946684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:54.947787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:54.953000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:54.954066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.651722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:55.665227 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c0d6787-d39b-4b8b-908f-a36a6e616d1b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.763083 Oct 04 18:16:55.667180 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2426/4985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:55.689315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:55.690946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:55.699784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.700814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.701592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:55.702725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:55.704894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:55.705797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.270561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.292608 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d4294b44-fdb0-42be-804a-d4829be2b7c8 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1498 microversion: 2.1 time: 1.801627 Oct 04 18:16:56.317017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2560/4986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:54 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1498 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.329070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.333947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.345998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.348624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.349228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.351785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.353333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.353955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.712741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:56.731207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-961f2d2f-de18-41c0-8bc6-3c899a1db0a9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1504 microversion: 2.1 time: 1.061722 Oct 04 18:16:56.742255 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2427/4987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:55 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1504 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:56.753278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:56.754560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:56.779795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.781342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.781342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:56.790374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:56.791266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:56.791971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.056698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.070807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.077760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.079614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7406fca-ae45-442e-a1aa-c0aa55e52fe9 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1719 microversion: 2.20 time: 0.761086 Oct 04 18:16:57.082155 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2561/4988] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1719 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:57.321497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:57.322328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.337126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.337649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.338125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.338864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.339334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.344799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.724579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:57.735025 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-615ded75-87b8-42c4-b278-a5542777198e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.990016 Oct 04 18:16:57.735589 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2428/4989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:56 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:57.770319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:57.771434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:57.823370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.824315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.825117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:57.826441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:57.827275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:57.828110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.018893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c8e6ebd-4451-4219-8b8b-be61ce3fbd1c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.259171 Oct 04 18:16:58.022778 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2429/4990] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:16:57 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:16:58.072385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.073139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.091152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.091870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.095545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.096490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.099505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.106841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.269712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.279273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d487bc4-df45-47f8-8feb-ce85579343c5 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1498 microversion: 2.1 time: 0.962241 Oct 04 18:16:58.280121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2562/4991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:57 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1498 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:16:58.294488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.295352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.304002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.305147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.305769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.306851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.307510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.308538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.553657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.580270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d933b279-66df-49d3-a881-cce778dc7bff tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 200 len: 1462 microversion: 2.1 time: 0.557912 Oct 04 18:16:58.582977 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2430/4992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 1462 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.601355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:58.602864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:58.614156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.615298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.617329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.621892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.622364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.622807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.690987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:58.704789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3565f35d-185a-49c0-94b9-6b966bd0e876 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1676 microversion: 2.1 time: 0.423390 Oct 04 18:16:58.707099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2563/4993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1676 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:16:58.727593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4170756-0fb8-40f3-8348-e18e18d49209", "name": "network-vif-deleted", "tag": "9481313e-1ab6-4d65-b80a-4eb9de6e4037"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:58.747941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:58.748689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:58.749133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:58.787431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] Creating event network-vif-deleted:9481313e-1ab6-4d65-b80a-4eb9de6e4037 for instance a4170756-0fb8-40f3-8348-e18e18d49209 on n-h2-831194-21 Oct 04 18:16:58.802242 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2eeb7fed-6b4e-4441-b99c-5fba42db392d req-ee9a3118-e093-407b-aa5b-30edb02dd567 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090372 Oct 04 18:16:58.803466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2564/4994] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:16:59.263389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-unplugged", "status": "completed", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:16:59.310413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.313729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.320801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.376387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] Creating event network-vif-unplugged:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h1-831194-21 Oct 04 18:16:59.424074 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a3f9ed68-57d3-4cce-b168-6658b9fd7059 req-6589644d-cb15-453d-a3ad-2cdf57609fc0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170849 Oct 04 18:16:59.427466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2565/4995] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:16:59.455322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.459860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.489457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.491077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.492185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.495661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.496177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.496627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.770045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.788018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.790486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:16:59.792569 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-417a8ed2-36fa-45d5-9894-33d84f666c9e tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1719 microversion: 2.20 time: 1.207994 Oct 04 18:16:59.798571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2431/4996] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:16:58 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1719 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:16:59.814363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.815009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: a4170756-0fb8-40f3-8348-e18e18d49209] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.822527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.823280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.823900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.824860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.825331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.825754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.849018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] HTTP exception thrown: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Request method failure captured: Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 HTTP/1.1 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHh3pcAToxyFnOwfp_Ci3k85IHmMlCflWjUCJLOxUm6iKVAOIajhvj1EbY_K0JAo21en-4_cAHJhCPdIHD7zPiAf2mXfCTuirNFU-eCbNoeVje3XDDvZ8RCMkm5E3pd7THtXCdmrIc9Viz5B20Ypm2wf_RQ9K-4zi6DfLgwyLzTi0NY Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2882eb4bf472464aa109062eb3d65517 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesActionsTest-1936057726 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2882eb4bf472464aa109062eb3d65517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesActionsTest-1936057726 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2882eb4bf472464aa109062eb3d65517 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesActionsTest-1936057726 Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesActionsTest-1936057726-project Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: aa3cf22c31ed4a00902ad4724c8470aa Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesActionsTest-1936057726-project Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a4170756-0fb8-40f3-8348-e18e18d49209'} Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:16:59.850821 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Returning 404 to user: Instance a4170756-0fb8-40f3-8348-e18e18d49209 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:16:59.854587 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68005ebb-f72f-42e6-a17c-b140c31db75f tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209" status: 404 len: 111 microversion: 2.1 time: 0.052481 Oct 04 18:16:59.866833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2432/4997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/a4170756-0fb8-40f3-8348-e18e18d49209 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:16:59.881168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:16:59.889086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:16:59.912981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.922543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.923308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:16:59.924578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:16:59.925261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:16:59.926628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.185846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.198516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf788dc0-e732-44c0-b7c7-8371eb55db76 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1501 microversion: 2.1 time: 0.767485 Oct 04 18:17:00.211652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2566/4998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1501 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:00.227424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1207552315", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "490152e8-6532-4c3b-8fba-987fd0feff0f"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:00.381516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] validate_networks() for [('490152e8-6532-4c3b-8fba-987fd0feff0f', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:00.519475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:00.542567 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4afc3b70-ea3c-4dfd-9679-9bd7430ed4ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1656 microversion: 2.1 time: 0.671052 Oct 04 18:17:00.558388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2433/4999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:16:59 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1656 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:00.571886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:00.572415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:00.600925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.601960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.605656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.607409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:00.610623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:00.628680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:00.774316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:00.984817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-765f6deb-7202-4789-8719-78a52e3ef1c2 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 204 len: 0 microversion: 2.1 time: 0.423914 Oct 04 18:17:00.986597 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2434/5000] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:00 2022] DELETE /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:01.011447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:01.012097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.021466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.023766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.025943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.027757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.029609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.031605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.239644 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3db9ebff-35e6-4d6d-afdd-1adcaf997589 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.245931 Oct 04 18:17:01.240966 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2435/5001] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:00 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:01.254421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.255148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.284102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.284625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.285099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.285848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.286325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.286771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.387004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:01.542429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:01.542864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:01.543938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:01.544369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:01.544935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:01.547149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=81 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:01.596010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.597922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.600656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.601690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:01.605780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:01.611847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:01.668390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Getting quotas for project 2882eb4bf472464aa109062eb3d65517. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:01.679374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Getting quotas for user aa3cf22c31ed4a00902ad4724c8470aa and project 2882eb4bf472464aa109062eb3d65517. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:01.730999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:01.738635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:01.923547 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfa2559b-066d-499c-99aa-b55b99f4c804 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.709814 Oct 04 18:17:01.940023 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2567/5002] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:01.953231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:01.954637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:01.987921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.001788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.034440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.035133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.037853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.038720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.040652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.041782 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7248d0d1-a7d0-42d7-9301-586b1c96ee13 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1719 microversion: 2.20 time: 0.797782 Oct 04 18:17:02.043483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.045607 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2436/5003] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1719 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:02.047000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.076955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.079994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.108870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.120030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.120541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.121327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:02.121808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:02.122282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:02.454919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.485207 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18833e35-c7e9-43a4-b557-c93074af983e tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1507 microversion: 2.1 time: 0.545803 Oct 04 18:17:02.488798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2568/5004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:01 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1507 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.501134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-006dffc3-50f7-483d-86f0-394aee1e234d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:02.503922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-006dffc3-50f7-483d-86f0-394aee1e234d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:02.624470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-006dffc3-50f7-483d-86f0-394aee1e234d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.652235 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-006dffc3-50f7-483d-86f0-394aee1e234d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1214 microversion: 2.1 time: 0.161080 Oct 04 18:17:02.667016 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2569/5005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1214 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:02.895923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:02.919585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fb8cfd94-a6ca-4322-9f9b-8339df0a9f5d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1663 microversion: 2.1 time: 0.872143 Oct 04 18:17:02.920634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2437/5006] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:02 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1663 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:03.095340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.096250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.161867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.162798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.164818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.171774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.172482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.176681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.517681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.518805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.556087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.556962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.560729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.562281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.562990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.563791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.681586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.715731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.724440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:03.726502 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a38ad82-a7f5-403d-a21b-495fbd9bbe3d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1662 microversion: 2.20 time: 0.651071 Oct 04 18:17:03.754974 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2570/5007] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1662 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:03.802384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:03.803452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:03.845210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.851460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.852768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:03.856316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:03.857862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:03.859310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.368524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.415558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-40ddbb06-2116-4d23-a990-0bbaac98c62e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1266 microversion: 2.1 time: 0.658185 Oct 04 18:17:04.432010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2571/5008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1266 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.462159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d56d115-d1bb-4202-acdb-78e7a6a06caf"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:04.491270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.541344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.542742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.543772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.544882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:04.549684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.552053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.555821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.577369 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5222c03-34cb-490a-b06d-e447c3991457 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1507 microversion: 2.1 time: 1.066495 Oct 04 18:17:04.608784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2438/5009] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:03 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1507 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:04.613008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:04.614574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:04.634737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.635620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.636191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:04.637137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:04.637779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:04.638382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.545614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.590057 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfe000ce-6cad-41be-b5d3-a01d8b4cdb81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.997615 Oct 04 18:17:05.593659 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2439/5010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:04 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.603084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df8abd7-c25b-4850-8a7e-34a9b2e55678", "name": "network-vif-deleted", "tag": "00aa8120-e770-4926-abbe-cd8ddd2460d1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:05.633335 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bb73cb69-1d1c-40ff-93e1-40b23a6b655f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.199510 Oct 04 18:17:05.634015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2572/5011] 10.222.0.42 () {62 vars in 1364 bytes} [Tue Oct 4 18:17:04 2022] POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments => generated 188 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:17:05.636360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.640927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.641618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.646950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.647844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.667533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.668164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.668631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.672029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.676250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.677389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.683754 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] Creating event network-vif-deleted:00aa8120-e770-4926-abbe-cd8ddd2460d1 for instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 on n-h2-831194-21 Oct 04 18:17:05.697682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-301ec9fd-c986-46c2-b580-a2376bb4cbda req-6241afa7-1cec-47b4-a3c4-18129bfaca12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102394 Oct 04 18:17:05.698820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2440/5012] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:05.721263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.722468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.736032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.736723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.737350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.738322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.740480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.741608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.891905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:05.903280 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-122b9ace-bba1-4714-a4d1-e66cf96610af tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1272 microversion: 2.1 time: 0.267951 Oct 04 18:17:05.916308 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2573/5013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1272 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:05.934647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:05.939216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:05.958201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.963267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.964502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:05.965867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:05.966801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:05.967842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.035917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.037469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.038795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.040051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lazy-loading 'fault' on Instance uuid 3df8abd7-c25b-4850-8a7e-34a9b2e55678 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:06.151153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61e6702e93f143bab7fc243e11214cd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e105dd41741f4d7090a959e56e75785c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:06.167617 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5d5fb60-ee7b-47d2-bb76-b98f45e957d9 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 200 len: 1304 microversion: 2.1 time: 0.249654 Oct 04 18:17:06.169217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2574/5014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 1304 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:06.174877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:06.175905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:06.205617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.211694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.213508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.214488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:06.217373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:06.218676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:06.313723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:06.493711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:06.518511 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc464745-f9b9-4ed5-a2c3-88d333cc8ee6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.815736 Oct 04 18:17:06.524067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2441/5015] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:05 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:06.844215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60933dd4-7e5d-4925-8629-4449f7e99253 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Action: 'create', calling method: .version_select at 0x7fbdbc7648b0>, body: {"keypair": {"name": "tempest-keypair-894873167", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIbQ/0fshjDo+64zFYNffVsQ6XTpbgvBoh7Z/lneq4uJuCruOrofuskT+Rcfvtyl4GcNc2thmaHz+L64J8dSHG9gTuUKELioEm9XftTZeSxv/xn50+JIluU6menh5TGQcA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:06.915729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-60933dd4-7e5d-4925-8629-4449f7e99253 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Getting quotas for project b02a27f8bc3144e484d3e39f5dfcd538. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:06.934386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-60933dd4-7e5d-4925-8629-4449f7e99253 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Getting quotas for user 8834410be3bd4fc59aa77b782bb01b75 and project b02a27f8bc3144e484d3e39f5dfcd538. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:07.020340 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60933dd4-7e5d-4925-8629-4449f7e99253 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.493410 Oct 04 18:17:07.024304 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2442/5016] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:07.048852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.056089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.089097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.094860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.095435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.098346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.102721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.104606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.153431 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef5d0155-b634-4813-9870-c8df1ec9331b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments/1d56d115-d1bb-4202-acdb-78e7a6a06caf" status: 202 len: 0 microversion: 2.20 time: 0.982825 Oct 04 18:17:07.158548 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2575/5017] 10.222.0.42 () {60 vars in 1457 bytes} [Tue Oct 4 18:17:06 2022] DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments/1d56d115-d1bb-4202-acdb-78e7a6a06caf => generated 0 bytes in 989 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:07.176596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.183268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.226862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.227621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.229059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.232346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.233112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.237385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.507565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.519499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-835796c4-5637-45ef-9c0b-62aa53b1fe9c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.492999 Oct 04 18:17:07.525094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:07.550130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2443/5018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.551507 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e9aae52-fdfa-48ed-8faf-182bda2629e9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1272 microversion: 2.1 time: 0.391535 Oct 04 18:17:07.555785 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2576/5019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1272 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:07.560595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.563096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] [instance: 3df8abd7-c25b-4850-8a7e-34a9b2e55678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.573510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:07.574364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.596628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.597380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.599408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.600739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.603097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.604040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.604632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.605222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.605856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.609176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.609975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.610604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.639560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] HTTP exception thrown: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Request method failure captured: Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 HTTP/1.1 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHhnwHC9EwiXhfP4AlYC-PCSvmxMyfY_oVZcGROkWhlFeCHnygYzgRX6u_TJ4sJ4Hh92fWvnD4EJqOimcWu4-DDBjPIXZ1tWIoJV8cWkjnJ5ZzmFPVcX_CH4EgRBL6UMnZ-y-ksIrSP6pjaJY1uRUusta7z0BgTuR3VL7yvyvn5M4qM Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: e105dd41741f4d7090a959e56e75785c Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestServerAdvancedOps-456376215 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e105dd41741f4d7090a959e56e75785c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e105dd41741f4d7090a959e56e75785c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e105dd41741f4d7090a959e56e75785c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e105dd41741f4d7090a959e56e75785c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestServerAdvancedOps-456376215 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: e105dd41741f4d7090a959e56e75785c Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestServerAdvancedOps-456376215 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestServerAdvancedOps-456376215-project Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 61e6702e93f143bab7fc243e11214cd0 Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestServerAdvancedOps-456376215-project Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3df8abd7-c25b-4850-8a7e-34a9b2e55678'} Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:07.642337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:17:07.647108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] Returning 404 to user: Instance 3df8abd7-c25b-4850-8a7e-34a9b2e55678 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:07.657006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0e81dae-d098-4d32-beea-39ce5329f101 tempest-TestServerAdvancedOps-456376215 tempest-TestServerAdvancedOps-456376215-project] 10.222.0.42 "GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678" status: 404 len: 111 microversion: 2.1 time: 0.098778 Oct 04 18:17:07.658207 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2444/5020] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/3df8abd7-c25b-4850-8a7e-34a9b2e55678 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:07.667268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.670844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.684791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.687603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.689718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128849) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 18:17:07.690563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.691472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.693335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.693961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.904390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e571715-7da2-41d3-9f69-b10eced28d70 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/action" status: 202 len: 0 microversion: 2.20 time: 0.347284 Oct 04 18:17:07.905200 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2577/5021] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:17:07 2022] POST /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:07.931130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:07.931130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:07.963753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.964313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.964757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:07.966814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:07.967468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:07.967859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.438400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.447928 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a9ec73f-8225-4920-b4c5-3779f95582cf tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.787906 Oct 04 18:17:08.459316 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2445/5022] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:08.510969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.511604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.526733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.527613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.528398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.540672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.544202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.545499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.818371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.859695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.870662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:08.874484 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8efa9f5-8c50-4cf4-bb99-5a8c37a8909f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1670 microversion: 2.20 time: 0.950511 Oct 04 18:17:08.909942 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2578/5023] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:07 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1670 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:08.916376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:08.917048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:08.948751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.950360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.951111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:08.953442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:08.954492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:08.955065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.393992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.420232 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3231f62-ab18-407d-ad80-a1e8fa5bad18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.899039 Oct 04 18:17:09.442860 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2446/5024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:09.480080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.481688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.492628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:09.514571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88e7270e-0d8d-4df8-bb72-cf8995c6ad20 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.599744 Oct 04 18:17:09.517132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.518293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.522773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.524577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.527397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.528509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2579/5025] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:08 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:09.529565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.914499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:09.915823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:09.928377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.931390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.933237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:09.936770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:09.937670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:09.938147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.239903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.255750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.258771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.261418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2ab1856-6925-4e4d-b153-628349047b10 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1670 microversion: 2.20 time: 0.351665 Oct 04 18:17:10.282333 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2580/5026] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1670 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:10.556548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:10.557422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:10.575594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.576640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.577254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.579433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:10.580157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:10.581298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:10.786271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:10.799735 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15e4dff2-3304-457f-8b96-c0132e0cdf21 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.333545 Oct 04 18:17:10.822661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2447/5027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:09 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:11.299065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:11.299883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:11.316774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.321404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.322304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.323205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:11.323813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:11.324386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:11.643353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:12.220482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:12.235997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7d88ca3-0378-428e-8cd3-82d6b5c8d55a tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 1.684281 Oct 04 18:17:12.239625 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2581/5028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:10 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 1689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:13.188128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.211731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.219344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.224210 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68168364-caff-48fc-a1c0-e41d8a40e86d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1672 microversion: 2.20 time: 1.931046 Oct 04 18:17:13.229039 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2448/5029] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:11 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1672 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:13.273068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:13.274795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:13.279446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:13.311865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.315160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.315640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.320719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:13.321406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:13.321888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:13.937326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:13.953086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c72987c-9667-4212-99f2-e432162bdd7d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.682975 Oct 04 18:17:13.967907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2582/5030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:13 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:14.261341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.262035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:14.278513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.281961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.290053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.300675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca3132d-a4d7-49c7-907a-1d88c9261a81", "tag": "e5a186d5-d0f1-4427-a6df-a4698f0ed3aa"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:14.308271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.309665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.310405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.335339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:14.336181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:14.339415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:14.382953 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] Creating event network-changed:e5a186d5-d0f1-4427-a6df-a4698f0ed3aa for instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 on n-h1-831194-21 Oct 04 18:17:14.406100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b2662d68-62da-433e-9cac-8ce5f2c9aa90 req-59319640-7a87-46b1-a4cc-b39b02c9038b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111997 Oct 04 18:17:14.407928 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2583/5031] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:14.993487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:14.998362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:15.036723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.037504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.038320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.042547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:15.047623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:15.048562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:15.422265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.434837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.443552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.446973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d743c0c6-b73b-4328-8d97-240933fb4a97 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.190188 Oct 04 18:17:15.448133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2449/5032] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:15.535489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:15.547394 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b19c0cf-f28d-425f-8d81-ae16a46e46c0 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.570410 Oct 04 18:17:15.548337 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2584/5033] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:14 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:16.350997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:16.361646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "26e86b68-cf65-43a1-84d9-752a82c87528"}], "security_groups": [{"name": "tempest-securitygroup--95366217"}], "key_name": "tempest-keypair-894873167", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:16.381019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.381618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.382849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.415918 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] Creating event network-changed:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h2-831194-21 Oct 04 18:17:16.448318 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-361ab800-2343-4a7c-a73f-baff9bb6a47d req-3e001f58-6855-447c-b19c-f651987dac68 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104774 Oct 04 18:17:16.451344 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2450/5034] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:16.485770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.486789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.505243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.506904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.507634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.508597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.509289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.513421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.790708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.806067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.807602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:16.810705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe54de58-ec06-4bcc-ac6a-b8f2fd39be3b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.331904 Oct 04 18:17:16.812672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2451/5035] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:16.822088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:16.823569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:16.856175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.856753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.857570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.859219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:16.862971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:16.863604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:16.963582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:17.185200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:17.202068 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1488585-525e-4f05-94fc-021c070d15c9 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.386127 Oct 04 18:17:17.203579 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2452/5036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:16 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:17.373047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] validate_networks() for [('26e86b68-cf65-43a1-84d9-752a82c87528', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:17.845122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:17.846229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:17.869458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:17.873574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.874419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.875438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:17.876644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:17.877867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:17.878882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.237503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.247092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.253807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.259255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0bbeb57-ad38-4898-8e28-42ee1ca89e0d tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.421528 Oct 04 18:17:18.260056 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2453/5037] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:17 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:18.265300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:18.269188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:18.291323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.293449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.295780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.300534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.302362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.304524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.822257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:18.830798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c666502b-0d7e-45cd-b3cb-485e3e2e83ca tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.569477 Oct 04 18:17:18.852448 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2454/5038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:18 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:18.932039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:18.932777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:18.933608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:18.934720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:18.936847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:18.969755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.972328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.972784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:18.973575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:18.976917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:18.977592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.069931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Getting quotas for project b02a27f8bc3144e484d3e39f5dfcd538. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:19.101720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Getting quotas for user 8834410be3bd4fc59aa77b782bb01b75 and project b02a27f8bc3144e484d3e39f5dfcd538. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:19.226902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:19.240705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:19.293746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.294830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.316126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.329230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.330931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.332488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.333518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.345791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.350737 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-35dd8b62-c47a-479a-a8f6-48b071267188 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.995275 Oct 04 18:17:19.357595 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2585/5039] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:16 2022] POST /compute/v2.1/servers => generated 407 bytes in 3003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:17:19.369291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2d146a8-01b9-4217-8db9-bd35d5a289ef tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.370114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f2d146a8-01b9-4217-8db9-bd35d5a289ef tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.524907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f2d146a8-01b9-4217-8db9-bd35d5a289ef tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:19.536263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2d146a8-01b9-4217-8db9-bd35d5a289ef tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1225 microversion: 2.1 time: 0.177325 Oct 04 18:17:19.547016 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2586/5040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1225 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:19.861611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:19.862564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:19.878352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.879112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.879644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:19.880568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:19.881478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:19.882194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:20.021386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.041036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.050651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.051925 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-247bee8d-ed86-412f-8e81-df77a219bfe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.765171 Oct 04 18:17:20.052537 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2455/5041] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:20.570265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82325e1c-3886-4881-ba20-f86a2ab036f4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:20.571297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82325e1c-3886-4881-ba20-f86a2ab036f4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:20.735487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82325e1c-3886-4881-ba20-f86a2ab036f4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:20.765884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82325e1c-3886-4881-ba20-f86a2ab036f4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1225 microversion: 2.1 time: 0.196996 Oct 04 18:17:20.766561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2456/5042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:20 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.081275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.082694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.091717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.100861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.101609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.102568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.105243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.105900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.121203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:21.486215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.495875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.497621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.499488 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f55186d-6cdd-4bbd-8bea-0f28309e977f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.422802 Oct 04 18:17:21.505846 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2457/5043] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:21.563891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:21.573797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-149d8acd-588e-4e73-a571-87cf12605463 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 1.717469 Oct 04 18:17:21.582974 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2587/5044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:19 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:21.796439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:21.797058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:21.805005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.813119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.817649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:21.819710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:21.821750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:21.823158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.042963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:22.074058 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f89d06f4-f7a7-432a-a55f-d4f4898c88ad tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1277 microversion: 2.1 time: 0.281523 Oct 04 18:17:22.105918 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2458/5045] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:21 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:22.561020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.562235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.580622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.581210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.581733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.606860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.607374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.607841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.634417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:22.635810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:22.677494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.683106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.683995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:22.685338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:22.690516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:22.700996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.257667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.270506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0ab8d88-8adb-44f3-9e4a-85edec31e442 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.653989 Oct 04 18:17:23.275430 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2459/5046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.294438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:23.298140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:23.318353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.319350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.320505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.322475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.324159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.326790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.581184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:23.605339 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4be0c62a-9878-4df2-ac80-73b0982b6a33 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1285 microversion: 2.1 time: 0.328439 Oct 04 18:17:23.611419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2460/5047] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:23 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1285 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:23.625494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca3132d-a4d7-49c7-907a-1d88c9261a81", "name": "network-vif-plugged", "status": "completed", "tag": "e5a186d5-d0f1-4427-a6df-a4698f0ed3aa"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:23.668469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:23.669573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:23.670746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:23.688736 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] Creating event network-vif-plugged:e5a186d5-d0f1-4427-a6df-a4698f0ed3aa for instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 on n-h1-831194-21 Oct 04 18:17:23.701518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-624c0078-1abd-40c7-a600-027a7c8b9681 req-a84957c2-4696-41fe-a250-d310e806299a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088535 Oct 04 18:17:23.703613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2461/5048] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:24.308451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.309515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.367099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.373182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.373182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.373182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.373182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.373182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.675519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.702605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.704989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:24.712067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fe3fd93-6b12-43f2-bd57-c9af77758aff tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 2.156706 Oct 04 18:17:24.718311 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2588/5049] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:22 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:24.733154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:24.751748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:24.763760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.774043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.776430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.778788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:24.787412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:24.788135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:24.988689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.006037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1079cdd1-bf99-48ca-93fc-18306b95a590 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1314 microversion: 2.1 time: 0.708456 Oct 04 18:17:25.014231 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2462/5050] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.167947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:25.170320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.182249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.192491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.196600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.197675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.198568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.200550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.418909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ed1c7c9-f7f0-4fee-a52b-59ba5b3dfeb3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.254561 Oct 04 18:17:25.425370 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2463/5051] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:17:25 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:17:25.450295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.453664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.455020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.475027 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c8ec3ea-2524-42b2-8b89-b0c7cbcaf806 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1283 microversion: 2.1 time: 0.751349 Oct 04 18:17:25.478573 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2589/5052] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:24 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1283 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:25.480035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.480548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.490165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.492189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.495122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.498340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.753353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:25.754966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:25.775967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.777148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.778028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.778933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:25.780429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:25.781431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:25.889235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:25.905572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad08a7e3-44ef-4c9e-b15a-d91cb6447427 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 0.474049 Oct 04 18:17:25.907067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2464/5053] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:26.044005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.044005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.060604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.061664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.062205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.062960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.063420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.063844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.397405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.414423 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b09f2c55-8b6d-4368-b0ce-b7121535cb8e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1499 microversion: 2.1 time: 0.378013 Oct 04 18:17:26.417453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2465/5054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1499 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:26.506066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.506766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.523419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.526309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.528368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.550257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.552637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.553350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.763415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:26.781023 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dedcd6cc-e1b4-40f4-832b-a2607058d456 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1283 microversion: 2.1 time: 0.279150 Oct 04 18:17:26.800602 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2466/5055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1283 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:26.938495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:26.939512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:26.957172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.957989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.958694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:26.959674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:26.960356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:26.960994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.329309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.333957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:27.366961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.374806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:27.386102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-728d7dfc-8ff9-4c3b-b379-5dfa7911dfbe tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.644287 Oct 04 18:17:27.404128 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2590/5056] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:25 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:27.729000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:27.730735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:27.752894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.756340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.756810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.760782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:27.764187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:27.768041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:27.839565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:17:28.109717 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97b95739-3ea6-41d2-85f9-159053ec399d tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 204 len: 0 microversion: 2.1 time: 0.386859 Oct 04 18:17:28.112794 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2591/5057] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:17:27 2022] DELETE /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:17:28.155169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.155813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.168150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.169393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.169889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.174343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.175589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.176780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.358710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:28.378702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b71fff6-8cfb-4e8d-8056-9fca218668bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 1.447172 Oct 04 18:17:28.379331 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2467/5058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:26 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:28.388723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:28.395298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:28.412514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.413560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.414207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.415110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:28.415713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:28.416740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:28.989002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:29.001532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.016335 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16352014-7705-46d5-9b4e-6f9d0f4088f5 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1505 microversion: 2.1 time: 0.635128 Oct 04 18:17:29.016937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2468/5059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1505 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:29.031108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.037730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.067352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.068807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.071086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.072710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.073356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.074184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.535842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:29.685036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.702211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.743495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:29.746107 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-508e9224-f310-403f-8127-f004b7400293 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.724282 Oct 04 18:17:29.746647 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2469/5060] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:29.779602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:29.780425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:29.809603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.810148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.813944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:29.815493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:29.820056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:29.824015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.357550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.368085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f59bd3e2-8601-49a0-905c-eff55b1e7a02 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 0.620357 Oct 04 18:17:30.368908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2470/5061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:29 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.398791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.399352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.423627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.424135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.424593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.425334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.425806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.426680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.706972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:30.716254 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b92c4080-343c-48e2-a11e-715cdad7c499 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 2.599196 Oct 04 18:17:30.722568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2592/5062] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:28 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 2608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:30.759814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:30.779060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:30.780872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:30.800112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.801227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.806626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:30.807934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:30.808599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:30.817439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.436864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.449667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.451218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.453055 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a582cb8-bf47-450c-968d-fcb7cf1c348a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.679942 Oct 04 18:17:31.465981 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2593/5063] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:31.471553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.472439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.485447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:31.489605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.490423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.490887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.506868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.508406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.510556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.579119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:31.597129 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3edd73b-d35c-4182-8229-7803bfd66857 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1505 microversion: 2.1 time: 1.226795 Oct 04 18:17:31.597750 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2471/5064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:30 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1505 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:31.752871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:31.753820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:31.766548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.767852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.768694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:31.769610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:31.771966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:31.772646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.480382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:32.499631 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c723135-59ee-4a2c-ba72-bb571a7ce4e4 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.751095 Oct 04 18:17:32.500815 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2472/5065] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:32.521415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca3132d-a4d7-49c7-907a-1d88c9261a81", "name": "network-vif-deleted", "tag": "e5a186d5-d0f1-4427-a6df-a4698f0ed3aa"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:32.583183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.583898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.584497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.606912 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] Creating event network-vif-deleted:e5a186d5-d0f1-4427-a6df-a4698f0ed3aa for instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 on n-h1-831194-21 Oct 04 18:17:32.618443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6f265e39-159d-4fe9-8f38-a6f110b33bd9 req-2f14f284-8023-4c2d-8e06-b173cbace160 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115620 Oct 04 18:17:32.631299 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2473/5066] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:32.667080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:32.668496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:32.709232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.710094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.710980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.717258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:32.718335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:32.719499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:32.728668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:33.379100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.379757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.390845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23315a35-9ee6-4d76-af12-6d9931526001 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1673 microversion: 2.1 time: 1.923299 Oct 04 18:17:33.394438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.396759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.403680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5952720-4389-4524-a2b2-9617a9b18959 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.770852 Oct 04 18:17:33.406345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2594/5067] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:31 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1673 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:33.419961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.431591 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2474/5068] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:32 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:33.440912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.474030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.474949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.476388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.478802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.485546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.487266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.530590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:33.531241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:33.550519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.551023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.551473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.552197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.552660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.553095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.637528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:33.637975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:33.667692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:33.668225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lazy-loading 'fault' on Instance uuid 8ca3132d-a4d7-49c7-907a-1d88c9261a81 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:17:33.854925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa3cf22c31ed4a00902ad4724c8470aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2882eb4bf472464aa109062eb3d65517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.867056 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-51cc6e94-aa95-4cc8-9179-1e7fd79dfef4 tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 200 len: 1304 microversion: 2.1 time: 0.458872 Oct 04 18:17:33.870823 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2595/5069] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 1304 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:33.928001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:33.944785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bde50040-9fdb-41c9-84a5-9d3c46579544 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.411324 Oct 04 18:17:33.945658 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2475/5070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:33 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:34.441486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.442200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.446305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:34.447968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:34.451368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.454185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.457668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.459877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.460370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.462495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.466716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.468274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.471694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.472799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:34.475106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:34.476102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:34.917210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:34.932981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2dbf66c2-424c-4ec6-9352-a78204f9b7ed tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1678 microversion: 2.1 time: 0.489426 Oct 04 18:17:34.933678 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2476/5071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1678 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:35.288301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1261893240", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ad5b08ab-468b-4d2b-90f4-375951d89fd7"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:35.420908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] validate_networks() for [('ad5b08ab-468b-4d2b-90f4-375951d89fd7', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:35.581324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.594134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.599223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:35.606935 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5eff72f9-2deb-42f3-8da3-91c4a0b84aac tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.172443 Oct 04 18:17:35.610188 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2596/5072] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:34 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:35.621730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.624906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] [instance: 8ca3132d-a4d7-49c7-907a-1d88c9261a81] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.638862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.640707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.641323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.643305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.646934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.647550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.694134 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] HTTP exception thrown: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Request method failure captured: Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 HTTP/1.1 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHh3pcAToxyFnOwfp_Ci3k85IHmMlCflWjUCJLOxUm6iKVAOIajhvj1EbY_K0JAo21en-4_cAHJhCPdIHD7zPiAf2mXfCTuirNFU-eCbNoeVje3XDDvZ8RCMkm5E3pd7THtXCdmrIc9Viz5B20Ypm2wf_RQ9K-4zi6DfLgwyLzTi0NY Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 2882eb4bf472464aa109062eb3d65517 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesActionsTest-1936057726 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2882eb4bf472464aa109062eb3d65517"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2882eb4bf472464aa109062eb3d65517"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesActionsTest-1936057726 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 2882eb4bf472464aa109062eb3d65517 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesActionsTest-1936057726 Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesActionsTest-1936057726-project Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: aa3cf22c31ed4a00902ad4724c8470aa Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesActionsTest-1936057726-project Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8ca3132d-a4d7-49c7-907a-1d88c9261a81'} Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:17:35.699117 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. Oct 04 18:17:35.703768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:17:35.708312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] Returning 404 to user: Instance 8ca3132d-a4d7-49c7-907a-1d88c9261a81 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:17:35.723919 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-08229c99-8c31-412f-9d3d-b6ef9776506e tempest-VolumesActionsTest-1936057726 tempest-VolumesActionsTest-1936057726-project] 10.222.0.42 "GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81" status: 404 len: 111 microversion: 2.1 time: 0.111587 Oct 04 18:17:35.736174 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2597/5073] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/8ca3132d-a4d7-49c7-907a-1d88c9261a81 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:17:35.759540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:35.760173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:35.785064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.786137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.786666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:35.787535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:35.788233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:35.788781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.097816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.121557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dca63d5f-0d30-4246-98a2-deeb681c4ce5 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.383229 Oct 04 18:17:36.125354 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2598/5074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:35 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:36.161675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e924c2f7-bad2-4672-bf2c-38277699cce9", "tag": "8e97e46f-174f-44f1-8a90-5de10bdfebb1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:36.190018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.190512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.194070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.228553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] Creating event network-changed:8e97e46f-174f-44f1-8a90-5de10bdfebb1 for instance e924c2f7-bad2-4672-bf2c-38277699cce9 on n-h2-831194-21 Oct 04 18:17:36.257068 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-377ecbda-b2f9-4402-8613-276d15f9f297 req-acbac3aa-5caf-44bf-ba57-235687b2d9e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117992 Oct 04 18:17:36.257966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2599/5075] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:36.265120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.266119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.287343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.288108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.288689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.289571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.290203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.290772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.646143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.656686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f750b939-c929-4e0d-8e69-1d6200020743 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1678 microversion: 2.1 time: 0.397052 Oct 04 18:17:36.657729 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2600/5076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1678 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:36.691975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:36.693057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:36.701069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.702014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.702906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.704075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:36.704768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:36.705188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:36.941340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.959077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.963656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:36.965176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cf9b3827-1cf0-4341-a859-fcbe614a6d3c tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.304731 Oct 04 18:17:36.965867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2601/5077] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:36 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:37.157474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.158634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.173426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.174173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.175023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.176063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.176713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.177352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.538645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:37.555384 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7308ce8c-079d-4075-99bd-1e2b489ebda8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.403669 Oct 04 18:17:37.565052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2602/5078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:37.680126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:37.682291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:37.703560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.709255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.710470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:37.711827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:37.712503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:37.714216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.005703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.020338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3624c3bf-4671-4136-863f-d6fad41f2bc9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1678 microversion: 2.1 time: 0.343329 Oct 04 18:17:38.020946 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2603/5079] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:37 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1678 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:38.036624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.037583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.044618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.045403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.046674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.052486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.053804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.054426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.410823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.429378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.455896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:38.460341 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f682c51-23ef-42a7-becf-247e0d8f27e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.438112 Oct 04 18:17:38.463267 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2604/5080] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:38.569678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:17:38.571000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:17:38.571906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:17:38.572561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:17:38.573980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:17:38.588730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:38.589362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:38.601403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.602268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.602783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.603235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.603962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.604176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.604431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.604873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.609669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.610887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:38.614550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:38.615301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:38.682234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Getting quotas for project bc09e581429a445baa70c23721e2f16f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:38.712634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Getting quotas for user 260bb30321704028b66ffb2dfe30b0e3 and project bc09e581429a445baa70c23721e2f16f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:38.773543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:17:38.783220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:17:38.916880 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [a1a6119c-8217-4fe4-86af-c9f5ed59fa4e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:17:39.931037 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [a1a6119c-8217-4fe4-86af-c9f5ed59fa4e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 38842. Oct 04 18:17:39.946521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60a75792-7c56-4ff5-8226-c39c9dc8c511 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.991155 Oct 04 18:17:39.955208 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2477/5081] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 5021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:17:39.974303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:39.977627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.005538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.010543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.015211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.021548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.023312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.024352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.524282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.533983 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b622b51-fd0c-4bc2-ab83-18bf5b689829 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 1.949069 Oct 04 18:17:40.534578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2605/5082] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:38 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 1950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:40.549978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.569823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:40.602683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.603197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.603655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.623943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:40.624461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:40.624911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:40.670450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:40.686457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58e1286d-9d3a-4f0a-8bbe-578ebda3c06f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.729678 Oct 04 18:17:40.689779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2478/5083] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:40.695219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f5b303c-79ad-4709-acf7-2488eab48f89 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:40.704359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f5b303c-79ad-4709-acf7-2488eab48f89 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.092429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3f5b303c-79ad-4709-acf7-2488eab48f89 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.116361 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f5b303c-79ad-4709-acf7-2488eab48f89 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1217 microversion: 2.1 time: 0.424003 Oct 04 18:17:41.119119 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2479/5084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1217 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:41.567197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:41.568659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:41.627737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.629961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.677771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.049s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.691354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:41.692476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:41.702669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:41.937788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.941118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:41.981414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:41.998311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.003933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1cd27994-e957-4047-a13b-95c6cda26624 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.468283 Oct 04 18:17:42.012091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2606/5085] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:40 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:42.148458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:42.149383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:42.172215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.180606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.181332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.187368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:42.187882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:42.193545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:42.840827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:42.856620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e87accb-b1e2-4294-a25e-1155eb25a5c1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1221 microversion: 2.1 time: 0.712442 Oct 04 18:17:42.858099 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2607/5086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:42 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1221 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:42.994419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.022676 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdd7f55b-461e-4c31-8ef2-7516a7476a20 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 1.456722 Oct 04 18:17:43.042018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.043918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.047276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2480/5087] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:41 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:43.059557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.060070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.073371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.075251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.080022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.080837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.550906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.570544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.574390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:43.578330 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92353657-a8d0-416a-85b0-d5703f1c8321 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.541132 Oct 04 18:17:43.582608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2608/5088] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:43.882851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:43.883873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:43.918186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.922108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.924966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:43.928745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:43.957488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:43.958051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.049006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.050493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.069791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.074553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.075720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.077122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.081749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.082716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.348579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.361756 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-764aea2a-c6a0-44fc-922b-5135919323b0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1287 microversion: 2.1 time: 0.484569 Oct 04 18:17:44.363107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2481/5089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:43 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1287 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:44.515384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:44.535457 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6fc0e13d-2f51-4f7f-b49b-2e88261c9b14 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.488407 Oct 04 18:17:44.559883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2609/5090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:44.615134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:44.616049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:44.630460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.640438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.643852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:44.645433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:44.646122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:44.649792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.331063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.360193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.368923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.376844 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a4d750c-e1e8-47bb-8d64-955cdff2bef3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.766751 Oct 04 18:17:45.397038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.399515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.409743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2482/5091] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:44 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:45.418481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.418981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.421617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.422648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.423980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.425166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.570492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:45.571615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:45.594614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.606846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.611444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.612675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:45.613364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:45.613996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:45.630754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:45.642387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9c7ea7b2-b3fa-40dd-818f-f6a4e92edf5c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1275 microversion: 2.1 time: 0.254608 Oct 04 18:17:45.649148 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2610/5092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1275 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:46.420458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.427911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.524938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.526007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:46.534885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.536889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.546448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.552456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d67265a7-2334-433f-8bcf-1e49ad6d319f tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.987822 Oct 04 18:17:46.552752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.567266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2483/5093] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:45 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:46.619986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.053s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.676552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:46.677190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:46.694807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.695318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.695819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:46.696518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:46.696984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:46.697418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.630622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.645469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.648528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.655288 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12955de3-5470-4812-abbe-eeef8e4d663a tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.247880 Oct 04 18:17:47.660077 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2611/5094] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:47.668126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:47.678998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:47.749702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.768187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.768935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.769987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:47.771942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:47.775548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:47.926859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:47.945462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd624bc8-44d4-468c-860d-7f6204aeff20 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1275 microversion: 2.1 time: 1.272683 Oct 04 18:17:47.952530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2484/5095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:46 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1275 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:48.424570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:48.449035 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01f845f1-362d-47af-8a00-75a6d64cb5c8 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.784964 Oct 04 18:17:48.471243 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2612/5096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:47 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:48.694515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.695457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:48.698300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:48.710165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:48.739127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.742793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.744432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.744432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:48.744880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:48.753608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:48.975728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:48.976472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:49.000175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.008198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.008848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:49.009697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:49.018760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:49.019265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.037950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.054318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.056480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.060851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0490b293-f9e6-4e35-b66f-5b0439dc3323 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.371145 Oct 04 18:17:50.124808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2485/5097] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:50.134607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:50.141670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:50.163405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.168548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.172840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.178096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:50.180175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:50.183277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:50.351658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:50.363413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a4be2b1a-bc5a-4f8b-bc77-e805cfdbe259 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 1.391697 Oct 04 18:17:50.370585 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2613/5098] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:48 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.009967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.036018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd62c650-7c3e-42f2-b431-8bf9ceb84377 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.909487 Oct 04 18:17:51.064273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2486/5099] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:50 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.111120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.111863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.139678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.140180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.140833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.141814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.142614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.143311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.402923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:51.404212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:51.406384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:51.433509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.434053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.434505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.436394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:51.438400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:51.439699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:51.834453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.886879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.918124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.929388 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e47be635-2f39-45c4-b883-37d2b95b91d8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.830038 Oct 04 18:17:51.954033 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2614/5100] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:51.959734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:51.969218 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b1a21bb-0118-4e3d-89e6-f0bbf27b5f11 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 0.570492 Oct 04 18:17:51.972361 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2487/5101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:51 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:51.991668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e924c2f7-bad2-4672-bf2c-38277699cce9", "name": "network-vif-plugged", "status": "completed", "tag": "8e97e46f-174f-44f1-8a90-5de10bdfebb1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:52.052583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.054582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.056152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.071552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.072349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.096449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.111091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.112893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.116249 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] Creating event network-vif-plugged:8e97e46f-174f-44f1-8a90-5de10bdfebb1 for instance e924c2f7-bad2-4672-bf2c-38277699cce9 on n-h2-831194-21 Oct 04 18:17:52.116441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.119774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.123088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.130225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-74e48691-3f30-4d79-8fc6-0f060906c28d req-b1a27da7-ae85-47ce-a4d4-357afbcd7767 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173858 Oct 04 18:17:52.131664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2615/5102] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:52.715659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f490059-7284-4dee-9f40-4be5968fad3b", "tag": "034330ad-104a-4a27-b6e4-d58c543fdfca"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:52.722187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:52.740359 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2cf2218-9932-4574-a3da-f91e29ccfc3a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 0.674286 Oct 04 18:17:52.754447 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2488/5103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:52.765594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:52.766117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:52.766562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:52.774713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17e7ba3b-709a-4e27-8666-b62f7fb0f404 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: .version_select at 0x7fbdc1d57280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1551706584", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGunrKpgNj7RlzilXlGKDNwIHKi8hSGQsiePzv69K2pQ4aCpgnTuzAxsdF3RWxgtzGRL4Jf005IF8eFO0Zrsk7TRKbPr1E1LuAVFAdiRNVTATSx4ZmQvmRCGf2xTBnMfNA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:52.795467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] Creating event network-changed:034330ad-104a-4a27-b6e4-d58c543fdfca for instance 4f490059-7284-4dee-9f40-4be5968fad3b on n-h1-831194-21 Oct 04 18:17:52.810132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-17e7ba3b-709a-4e27-8666-b62f7fb0f404 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:17:52.814846 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6ff5f51e-5ba8-438b-9312-925576a6d14e req-bc6e27e0-f6c7-48e0-85e4-8518b702f6ce service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103721 Oct 04 18:17:52.816058 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2616/5104] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:52.827493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-17e7ba3b-709a-4e27-8666-b62f7fb0f404 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:17:52.881562 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17e7ba3b-709a-4e27-8666-b62f7fb0f404 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.125706 Oct 04 18:17:52.882813 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2489/5105] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:17:52 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:52.996116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:52.998102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:52.999139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.001988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.018266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.019048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.019792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.020764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.022052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.023620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.051475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.052332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.059315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.061199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.066362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.067068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.565745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.592884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.604402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.606100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03a92c6f-0af7-4a95-ae77-491161684e8f tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.617201 Oct 04 18:17:53.616424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2617/5106] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:53.736563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:53.758273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cfb011dc-5062-40a5-ad08-77f712a34fc9 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 0.765347 Oct 04 18:17:53.760259 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2490/5107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:52 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:17:53.808290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:53.814739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:53.832201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.835382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.836657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:53.838313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:53.839403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:53.840511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.197082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-plugged", "status": "completed", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:54.222954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.231086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.232796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.289688 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] Creating event network-vif-plugged:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h2-831194-21 Oct 04 18:17:54.332368 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6725c9ba-2476-43c3-98a7-0aec991b69b0 req-8f394c0a-ddcc-4bea-84f8-510ea3f5fbb2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150544 Oct 04 18:17:54.339834 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2491/5108] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:17:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:17:54.649431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.650629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.738962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.741743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.749809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.759910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:54.760693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:54.761384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:54.886638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:54.925883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69cd7335-7b48-4678-9d06-759ac4b3111c tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1349 microversion: 2.1 time: 1.147112 Oct 04 18:17:54.928009 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2618/5109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:53 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1349 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:54.950761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:54.952723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:54.978560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.000827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.002358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.004174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.006978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.008163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.379240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.395698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.408797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.410345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84d4c9a8-c2c3-4884-a6d9-a3862b61ae21 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.769297 Oct 04 18:17:55.429920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2492/5110] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:55.756699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:55.800742 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64994a57-330d-4983-bd2b-8388a08a251f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 0.857867 Oct 04 18:17:55.801936 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2619/5111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:54 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:55.953397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:55.954066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:55.978271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.979132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.980154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:55.987263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:55.988571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:55.994278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.463102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:56.466713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:56.515680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.516484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.516953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.517751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:56.518276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:56.520810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:56.990741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.029063 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bae0e05e-b1bf-4c97-8b86-b3d0178108c0 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1540 microversion: 2.1 time: 1.080765 Oct 04 18:17:57.029748 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2493/5112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:55 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1540 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:57.050476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.059259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.098864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.106069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.111764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.112376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.112865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.119628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.142215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:17:57.562287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.602113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.611719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:57.612987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-228be2bc-3cc8-41ab-957a-74dda326cb82 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 1.157593 Oct 04 18:17:57.621360 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2620/5113] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:56 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:17:57.648826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:57.649604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:57.669813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.670469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.679100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:57.680145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:57.681149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:57.681771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.060188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0bca761-0090-4d50-999d-ab28cc6aad35 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.435761 Oct 04 18:17:58.061778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2621/5114] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9/os-interface => generated 285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:17:58.130801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-954450083", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "9cd6e6bb-a9a6-4f0f-ac32-77da744fbc01"}], "key_name": "tempest-TestNetworkBasicOps-1551706584", "security_groups": [{"name": "tempest-secgroup-smoke-81779271"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:17:58.605476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:58.622899 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22ff21c8-a81b-4c93-a2a5-d62d3933fd60 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 1.577623 Oct 04 18:17:58.624279 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2494/5115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:57 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:17:58.656753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:58.657711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:58.676747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.677802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.680506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:58.682856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:58.686626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:58.687287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.194691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] validate_networks() for [('9cd6e6bb-a9a6-4f0f-ac32-77da744fbc01', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:17:59.492028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.521372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.525128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:17:59.540482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc39babc-89ea-4868-9324-292d327802d1 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1728 microversion: 2.20 time: 0.890699 Oct 04 18:17:59.542569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2495/5116] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:17:58 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1728 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:17:59.664758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:17:59.667986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:17:59.697402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.698224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.699782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:17:59.701660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:17:59.703451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:17:59.706137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.426916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:00.467974 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-391e45e2-8d02-48b1-900d-fb4184151336 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 0.818786 Oct 04 18:18:00.469704 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2496/5117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:17:59 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:00.586231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:00.587810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:00.605144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.606810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.611525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:00.613551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:00.615008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:00.617678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.381819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:01.382420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:01.383395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:01.383998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:01.384542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:01.412096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.412818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.413379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.419698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.423773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.425405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.484780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:01.496002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:01.534412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:01.538126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:01.658925 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f72cce14-efe0-4dfd-82ff-4b6d20835656 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.531880 Oct 04 18:18:01.667709 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2622/5118] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:17:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 3541 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:01.673848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:01.676859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:01.684023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:01.687673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.689105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.689717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.690649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:01.691269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:01.691848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:01.902545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.917174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.918883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:01.925303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75b16745-725a-4ab2-b0e8-fbf00ca6a8ed tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1715 microversion: 2.20 time: 1.342930 Oct 04 18:18:01.928107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2497/5119] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:00 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1715 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:01.986808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e924c2f7-bad2-4672-bf2c-38277699cce9", "tag": "8e97e46f-174f-44f1-8a90-5de10bdfebb1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:02.009995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:02.010568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:02.011006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:02.040823 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] Creating event network-changed:8e97e46f-174f-44f1-8a90-5de10bdfebb1 for instance e924c2f7-bad2-4672-bf2c-38277699cce9 on n-h2-831194-21 Oct 04 18:18:02.047887 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-606abfcd-db60-4454-8183-57438fba67bb req-83c2fcc4-f684-4f2f-9247-0721b67dc524 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075454 Oct 04 18:18:02.051976 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2498/5120] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:02.087402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c085a34-6912-4eca-a1a2-2d8846430be7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:02.089178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c085a34-6912-4eca-a1a2-2d8846430be7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:02.249073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c085a34-6912-4eca-a1a2-2d8846430be7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.299632 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c085a34-6912-4eca-a1a2-2d8846430be7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1248 microversion: 2.1 time: 0.213231 Oct 04 18:18:02.303336 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2499/5121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:02 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1248 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:02.312247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:02.340694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2c42a10-f215-455a-b390-783890ce5977 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 0.668509 Oct 04 18:18:02.341524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2623/5122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:01 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:03.312460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.314410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.335786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.336292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.363764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.366965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:03.368277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:03.373433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.374254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.374749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.385457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.386876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.389615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.393558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.395124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.395903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.656859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:03.669976 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-447c551c-38c6-47fc-86bc-b5d849878dc5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1300 microversion: 2.1 time: 0.362355 Oct 04 18:18:03.674655 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2500/5123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:03.680803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f490059-7284-4dee-9f40-4be5968fad3b", "name": "network-vif-plugged", "status": "completed", "tag": "034330ad-104a-4a27-b6e4-d58c543fdfca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:03.714876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:03.716258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:03.716896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:03.736122 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] Creating event network-vif-plugged:034330ad-104a-4a27-b6e4-d58c543fdfca for instance 4f490059-7284-4dee-9f40-4be5968fad3b on n-h1-831194-21 Oct 04 18:18:03.745850 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a4ea3a9c-7c4f-4c73-bb4e-4a802caa8688 req-1a0c63ff-56eb-4051-8782-8c671cb46660 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069227 Oct 04 18:18:03.748882 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2501/5124] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:04.430323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.445799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-261f0913-0131-4a5c-aa65-ac9499e41ed0 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1317 microversion: 2.1 time: 1.084484 Oct 04 18:18:04.447011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2624/5125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:03 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1317 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:04.702366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:04.703667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:04.742549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.748083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.748955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.750117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:04.751190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:04.753162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:04.947195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:04.956969 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18b2ab98-85fe-4aaa-b4cd-b1f05169bd1c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1306 microversion: 2.1 time: 0.259863 Oct 04 18:18:04.968463 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2502/5126] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:04 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1306 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:05.476854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.478722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.488999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.490126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.490797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.491761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.492463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.493176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.876031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.893981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:05.896895 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cddbf7a2-b0ff-414f-9106-a226b493bde8 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1506 microversion: 2.1 time: 0.426923 Oct 04 18:18:05.901966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2625/5127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:05.924216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.926383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:05.936512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.937793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.938585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.939477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:05.940097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:05.940852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:05.980722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:05.982482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1415817d-8eeb-491b-8eb8-3d336761094c tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/os-instance-actions/req-60a75792-7c56-4ff5-8226-c39c9dc8c511" status: 200 len: 313 microversion: 2.1 time: 0.062384 Oct 04 18:18:05.983618 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2503/5128] 10.222.0.42 () {58 vars in 1419 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/os-instance-actions/req-60a75792-7c56-4ff5-8226-c39c9dc8c511 => generated 313 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:05.992687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:05.993535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.003120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:06.009802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.012308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.013041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.014429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.019407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.020380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.021524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.052154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.053005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.053704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.054673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.060691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.061462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.241992 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0816839e-d9ba-4649-a602-cc9404ffd88f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "POST /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/action" status: 202 len: 0 microversion: 2.1 time: 0.242449 Oct 04 18:18:06.243311 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2504/5129] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:05 2022] POST /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:06.253297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:06.255103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:06.271242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.273639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.275958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.281208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:06.282297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:06.284039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:06.391898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.400234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47bc426b-e9cb-479a-88b2-035aeced8aea tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1306 microversion: 2.1 time: 0.411703 Oct 04 18:18:06.404177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2626/5130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:05 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1306 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:06.929287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:06.943621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b63dfd7-f6dc-40d8-9688-e31ec706fd14 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1508 microversion: 2.1 time: 0.691264 Oct 04 18:18:06.944877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2505/5131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:06 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1508 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:07.425227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.426525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.440396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.443354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.444577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.446785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.448808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.449886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.770284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:07.782449 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-967e2d14-1855-407f-880d-3094232f2455 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.358879 Oct 04 18:18:07.784370 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2627/5132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:07.970009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:07.970798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:07.982674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.983713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.986721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:07.988756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:07.990495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:07.991499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.344668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9bc13b-8758-4f96-86a2-a9c61e635c3e", "tag": "b8ba2456-2ae3-4799-ae55-0a7b17b9f832"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:08.347720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:08.360270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.361058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.362271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.364262 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-971dae4f-ecc6-43bb-b945-0f5cf40be74f tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1508 microversion: 2.1 time: 0.397915 Oct 04 18:18:08.365053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2506/5133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:07 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1508 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:08.406956 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] Creating event network-changed:b8ba2456-2ae3-4799-ae55-0a7b17b9f832 for instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e on n-h2-831194-21 Oct 04 18:18:08.415921 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d891b30e-f2ad-4f16-aa01-e0e52b689e75 req-b56bc78f-edd9-495b-802d-26dd61e01801 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078314 Oct 04 18:18:08.421509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2628/5134] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:08.810925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:08.811648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:08.835378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.838522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.838979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:08.842423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:08.843214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:08.843519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.304077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.313385 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a59063d0-0ac4-4db0-a412-3d59fd6a79b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.509064 Oct 04 18:18:09.334674 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2507/5135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:08 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:09.392578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.394021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.403858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.404733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.405821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.406804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.407553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.408335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.684317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:09.696582 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-236244b5-07e4-44a0-a3ce-0a45ff9a3864 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1506 microversion: 2.1 time: 0.311217 Oct 04 18:18:09.698295 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2629/5136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1506 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:09.732537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '.version_select at 0x7fbdbd760040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.735083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.785407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.786775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.788928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.790451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.794129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.797085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.890040 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cfecf06b-35d1-43c2-b659-4f36f79144e7 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.165850 Oct 04 18:18:09.892801 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2508/5137] 10.222.0.42 () {58 vars in 1296 bytes} [Tue Oct 4 18:18:09 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b/os-instance-actions => generated 611 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:09.907069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:09.907587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:09.918996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.919552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.919952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.920681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:09.921163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:09.925146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:09.989066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:10.263658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-39efceee-4a2a-423e-a648-af2b37bc3425 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 204 len: 0 microversion: 2.1 time: 0.362416 Oct 04 18:18:10.268220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2630/5138] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:09 2022] DELETE /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:10.273284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.273932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.282701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.283615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.284215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.285451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.286095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.286677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.350680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:10.353573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:10.382550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.383143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.383646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.384435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:10.384966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:10.385463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:10.827382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.849435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:10.849977 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2741523f-9543-432f-8250-ce02f1798fe1 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1512 microversion: 2.1 time: 0.580534 Oct 04 18:18:10.857852 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2509/5139] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1512 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:10.877264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-77c060fb-bebf-42e9-81ef-92259a4d5713 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.531846 Oct 04 18:18:10.882092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2631/5140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:10 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:11.874601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.875231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.884776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.890185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.890978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.891946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.892732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.895557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.908820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:11.910125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:11.946410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:11.947804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:11.950896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.954493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.955204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:11.960857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:11.961492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:11.962060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:12.255344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:12.325625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.344003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53fa67be-2685-42aa-9190-eee30682d23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.439357 Oct 04 18:18:12.345693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2632/5141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:12.567512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:12.583424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-432b51a5-e24e-4aa0-872d-d86b9228c311 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1512 microversion: 2.1 time: 0.714760 Oct 04 18:18:12.584573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2510/5142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:11 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1512 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.024476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.025095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.064030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.064837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.065307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.066163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.066584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.067005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.389721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f490059-7284-4dee-9f40-4be5968fad3b", "name": "network-vif-deleted", "tag": "034330ad-104a-4a27-b6e4-d58c543fdfca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:13.416305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.427329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.427848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.462951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] Creating event network-vif-deleted:034330ad-104a-4a27-b6e4-d58c543fdfca for instance 4f490059-7284-4dee-9f40-4be5968fad3b on n-h1-831194-21 Oct 04 18:18:13.474690 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-94b55366-6138-416b-a477-812677c8d179 req-dab63ad9-4f6f-45ac-9351-05b7a0abf507 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088799 Oct 04 18:18:13.480288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2511/5143] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:13.508997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.510053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.527061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.528005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.528766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.529700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.530357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.530997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.814384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.836516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0e54bb3-bfe6-4648-937c-11c212bc9c81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.812226 Oct 04 18:18:13.839611 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2633/5144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.852757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.853385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.872974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.873392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.873866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.874797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.875417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.876004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.905940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:13.908610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:13.915938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0be7327e-ed1b-4142-9ed8-5396ad49e69c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.412116 Oct 04 18:18:13.917314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2512/5145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:13.922887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:13.923744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:13.933398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.934750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.935511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.936486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.937103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.937691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.951891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:13.952476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:13.953093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:13.953578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lazy-loading 'fault' on Instance uuid 4f490059-7284-4dee-9f40-4be5968fad3b {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:14.082440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '260bb30321704028b66ffb2dfe30b0e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc09e581429a445baa70c23721e2f16f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.101382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b4e8423c-8769-459b-9b22-c8590cbc5e59 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 200 len: 1307 microversion: 2.1 time: 0.259012 Oct 04 18:18:14.104666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2634/5146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 1307 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:14.162819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:14.173847 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-393f8b7a-fccf-4cf6-bbc5-febdec771fd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.254831 Oct 04 18:18:14.174530 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2513/5147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:13 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:14.199876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.201142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.222216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.223994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.225775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.229066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.230819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.234352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.945760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:14.946438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:14.972507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.972725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.973376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:14.975299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:14.976470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:14.977113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.044016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.054357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7169382-10a8-4b0a-82f0-eef5db16acef tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.860277 Oct 04 18:18:15.063422 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2635/5148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:15.099423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.110430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.123557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.124063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.124523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.125259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.126892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.134368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.297788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.309630 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1546055a-cf28-453f-ba18-79d98bec0189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.367647 Oct 04 18:18:15.310766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2514/5149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:14 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:15.325740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:15.328387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] [instance: 4f490059-7284-4dee-9f40-4be5968fad3b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:15.362645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.364743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.374282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.376225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:15.376856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:15.377422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:15.405695 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] HTTP exception thrown: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Request method failure captured: Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b HTTP/1.1 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHi-utuC5ziUGQ4eOVw3UrhPfv3qW8Os42SzRW_wQMqDQ6UYicvBGKgVIPJTeeqMegG6fJQ5J4A2nKB1FKTH0EunibH3Dok989xR1UVzd-nyY-dYZJtSSMT_GJmediv2Z3WpZjyJ36pRCDxbIV9O-0mEJskr3Q4xhCB-p0vvLiA820w Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: bc09e581429a445baa70c23721e2f16f Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-InstanceActionsTestJSON-2007947569 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/bc09e581429a445baa70c23721e2f16f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc09e581429a445baa70c23721e2f16f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/bc09e581429a445baa70c23721e2f16f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_bc09e581429a445baa70c23721e2f16f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-InstanceActionsTestJSON-2007947569 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: bc09e581429a445baa70c23721e2f16f Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2007947569 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-InstanceActionsTestJSON-2007947569-project Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 260bb30321704028b66ffb2dfe30b0e3 Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-InstanceActionsTestJSON-2007947569-project Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4f490059-7284-4dee-9f40-4be5968fad3b'} Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:15.408429 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. Oct 04 18:18:15.412971 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:15.417118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] Returning 404 to user: Instance 4f490059-7284-4dee-9f40-4be5968fad3b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:15.419640 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-219788df-c490-49c4-bc59-646da39f8748 tempest-InstanceActionsTestJSON-2007947569 tempest-InstanceActionsTestJSON-2007947569-project] 10.222.0.42 "GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b" status: 404 len: 111 microversion: 2.1 time: 0.105650 Oct 04 18:18:15.424242 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2515/5150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/4f490059-7284-4dee-9f40-4be5968fad3b => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:18:15.526661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:15.542362 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5c40c76-953d-435c-a6f1-2bd830ae9981 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.462180 Oct 04 18:18:15.544981 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2636/5151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:15 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:15.808861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-137425014", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5b05bd8e-240d-49e1-9616-3083c9ab006c"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:16.336066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:16.338128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:16.351584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.353171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.355083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.358832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:16.359527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:16.361245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:16.969203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:16.985357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ccd3caa-0a1f-465a-8860-43112a9ae7ac tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.648148 Oct 04 18:18:16.986838 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2637/5152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:16 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:16.999130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9bc13b-8758-4f96-86a2-a9c61e635c3e", "name": "network-vif-plugged", "status": "completed", "tag": "b8ba2456-2ae3-4799-ae55-0a7b17b9f832"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:17.030484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:17.033179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:17.034775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:17.075303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] Creating event network-vif-plugged:b8ba2456-2ae3-4799-ae55-0a7b17b9f832 for instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e on n-h2-831194-21 Oct 04 18:18:17.247327 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4cdeb933-18e5-43b0-ac0c-7dfca5d3f4bb req-d0bde9cb-ad6e-44bd-b753-49ff9fbfdde0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.256699 Oct 04 18:18:17.263841 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2638/5153] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:18.016587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:18.023739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:18.050398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.051301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.051903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.052801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:18.056862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:18.057872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:18.308077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:18.319916 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb8b4537-bd9e-464b-9366-6e80f72f1ab8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1372 microversion: 2.1 time: 0.310691 Oct 04 18:18:18.341685 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2639/5154] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:18 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1372 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:19.350230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:19.351091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:19.368453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.376509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.381499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:19.382658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:19.383340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:19.384015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.044825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.054210 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e72bb51b-391d-43b9-b27d-239401d080c3 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1545 microversion: 2.1 time: 0.708479 Oct 04 18:18:20.055654 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2640/5155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:19 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1545 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:20.097658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:20.099171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:20.113630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.114179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.114632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.115447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:20.115917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:20.119384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:20.644777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:20.658270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:20.680716 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7bd6340-226d-4e96-8495-5a38d52d0f13 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1545 microversion: 2.1 time: 0.596154 Oct 04 18:18:20.685443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2641/5156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:20 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1545 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:25.405874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=15 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:25.860608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:26.460670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9bc13b-8758-4f96-86a2-a9c61e635c3e", "tag": "b8ba2456-2ae3-4799-ae55-0a7b17b9f832"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:26.493055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:26.493961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:26.494570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:26.536880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] Creating event network-changed:b8ba2456-2ae3-4799-ae55-0a7b17b9f832 for instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e on n-h2-831194-21 Oct 04 18:18:26.561761 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5fded263-661e-4779-a4b3-a87b5be71e53 req-0dc40da7-978b-4ee6-9143-3cd9fd459290 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104129 Oct 04 18:18:26.563881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2642/5157] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:30.431989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] validate_networks() for [('5b05bd8e-240d-49e1-9616-3083c9ab006c', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:31.657320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:31.658497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:31.659153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:31.659753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:31.660363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:31.679202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.682334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.683593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.688601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:31.689309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:31.689946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:31.753551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:31.768245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:31.805912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:31.811416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:31.943637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-993d8891-8b07-48ae-b587-1e983e7ff5d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.146831 Oct 04 18:18:31.951116 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2516/5158] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 16155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:31.968386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c434cce-9db2-441c-ac9f-c1cbfce561e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:31.971099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c434cce-9db2-441c-ac9f-c1cbfce561e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:31.983540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:32.188878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c434cce-9db2-441c-ac9f-c1cbfce561e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:32.198676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c434cce-9db2-441c-ac9f-c1cbfce561e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1214 microversion: 2.1 time: 0.237624 Oct 04 18:18:32.217594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2643/5159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:31 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1214 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.231896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.233523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.251383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.251728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.255810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.256566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.262936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.269412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.310828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.315960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.352800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.353293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.353745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.369069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.369687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.370681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.518669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-22dc0748-6959-464c-9b1a-14d33db686cf tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.219338 Oct 04 18:18:33.519763 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2644/5160] 10.222.0.42 () {60 vars in 1343 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b/os-volume_attachments => generated 25 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.622391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:33.647157 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33f4d2ac-133d-45d6-9754-c84042efe1f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1218 microversion: 2.1 time: 0.420408 Oct 04 18:18:33.679975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:33.680599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:33.684401 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2517/5161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:33 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1218 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:33.706849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.708490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.709933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.711735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:33.715666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:33.728519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:33.830953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:34.155658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa327b73-1d04-4914-8a47-d167af19c2e3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 204 len: 0 microversion: 2.20 time: 0.488109 Oct 04 18:18:34.157086 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2645/5162] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:33 2022] DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:18:34.166528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.167535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.174985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.175706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.176352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.177272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.177912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.178578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.517408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.532708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.549944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:34.553682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f21c9a17-6614-4c86-9481-5b0b5b1e7dda tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.392136 Oct 04 18:18:34.557760 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2518/5163] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:34.686422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:34.687257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:34.708371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.709150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.715406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:34.716211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:34.721069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:34.721511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.096295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:35.105970 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b96ca609-f1c0-441e-9719-dec1897e4f13 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1272 microversion: 2.1 time: 0.425390 Oct 04 18:18:35.116534 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2646/5164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:34 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1272 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:35.154395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.155889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.169981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.183611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.188086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.189782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.191148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.194863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.288239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:18:35.590985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.591909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.599742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-160281bb-45f0-408b-a38f-788a43d5ad44 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 204 len: 0 microversion: 2.1 time: 0.453374 Oct 04 18:18:35.606277 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2519/5165] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:18:35 2022] DELETE /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:18:35.609512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.610523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.612298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.613952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.616090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.617964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.632160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:35.632892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:35.678224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.678863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.686696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:35.691030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:35.693365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:35.695653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.157500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.182851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.185267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.190647 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6376260-3b07-43ff-ab83-53f6d0ac2cfa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 0.605914 Oct 04 18:18:36.199565 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2647/5166] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:36.212256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:36.221163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:36.244063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.247687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.250172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.253370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:36.255755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:36.257319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:36.372662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.384874 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b72b3b9e-cef4-4960-85fd-66bf0599b95a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1665 microversion: 2.1 time: 0.774446 Oct 04 18:18:36.394737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2520/5167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:35 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1665 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:36.455845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:36.483597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d971e590-bfe9-4190-9f3f-d4c2dce0a91c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1272 microversion: 2.1 time: 0.280268 Oct 04 18:18:36.484811 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2648/5168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:36 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1272 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:37.235999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.236691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.253816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.254495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.254955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.257182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.257685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.260811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.417901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:37.418859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:37.447596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.462832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.464283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:37.486763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:37.487332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:37.506451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.311371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.338134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.340161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.346567 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c7e0712-379c-4afd-a7f1-f98ea80b8bb7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 1.110230 Oct 04 18:18:38.361869 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2521/5169] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:38.361869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:38.362832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:38.378956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.379521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.379913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.380643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:38.387341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:38.387808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:38.883214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:38.908375 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37f90560-4f1c-4ea1-a9ae-3fc1c552c922 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1665 microversion: 2.1 time: 1.496622 Oct 04 18:18:38.908977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2649/5170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:37 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1665 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:39.182264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:39.196441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06967166-5d07-471e-a1f5-cb859d41e069 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 0.847012 Oct 04 18:18:39.197045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2522/5171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:38 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:39.412566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.417375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.430886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.438630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.439316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.440255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.441459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.463141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.932040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:39.934701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:39.956247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.959695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.960960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:39.966553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:39.970151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:39.971364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.840204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.850248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.858345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:40.860480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a7e775e2-cba5-4961-8e17-e0400759b2b0 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 1.483687 Oct 04 18:18:40.877066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2650/5172] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:40.898820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:40.909867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:40.935438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.938590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.939169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:40.942741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:40.943495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:40.944046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.614575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:41.663621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18e19271-4606-4b73-9bc6-6929e808ca53 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1665 microversion: 2.1 time: 1.736208 Oct 04 18:18:41.672675 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2523/5173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:39 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1665 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:41.688677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6533dc2d-bb1c-4748-b9f2-e73a261488f7", "tag": "d6e1f770-34f3-46a5-9536-6890b43dfba9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:41.720029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.720549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.722104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.759615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:41.768306 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] Creating event network-changed:d6e1f770-34f3-46a5-9536-6890b43dfba9 for instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 on n-h1-831194-21 Oct 04 18:18:41.786298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e1b1502d-5afa-415c-9890-765d047d9755 req-2090ab61-092c-402c-a3bc-6e67b4787735 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107805 Oct 04 18:18:41.787848 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2524/5174] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:41.889405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:41.895002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:41.895781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:41.914976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.918765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.919423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:41.925293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:41.926032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:41.926677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.193430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:42.228859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:42.244542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5795d39d-ed2a-44e6-a3dd-57b17108a738 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 1.367685 Oct 04 18:18:42.270348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2651/5175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:40 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:42.604011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-unplugged", "status": "completed", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:42.642411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.643245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.644437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.684185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] Creating event network-vif-unplugged:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h2-831194-21 Oct 04 18:18:42.699845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-06f3efeb-b3bb-400f-9e54-2d9cc3e103db req-09380b45-b9a8-477c-a15c-f8aca0f0e4f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100236 Oct 04 18:18:42.708614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2652/5176] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:42.736934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:42.737861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:42.759147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.759639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.768026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:42.769018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:42.769644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:42.770477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.536744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.573476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.583622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:43.591039 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4106c430-83db-43e8-9f0b-d55bed427826 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1721 microversion: 2.20 time: 1.698986 Oct 04 18:18:43.598996 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2525/5177] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:41 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1721 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:18:43.627167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:43.631215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:43.666345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.670032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.670650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.678431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:43.679315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:43.680191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:43.997461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:44.014610 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68250594-5ff9-40ed-a585-7c0ab26ae30a tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1665 microversion: 2.1 time: 1.296901 Oct 04 18:18:44.025892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2653/5178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:42 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1665 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:44.630865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:44.647400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:44.653870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.653870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.667137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.667137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:44.667137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:44.667137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:44.997821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.013205 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c3805937-4c01-420e-a5b8-8d630ea9716d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 1.403255 Oct 04 18:18:45.019659 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2526/5179] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:43 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:45.318612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.360130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.392921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ec0e669bee9d4d949510d5a0c6576b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e2ed0241d5024b11b38cf1be25968ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:45.404841 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3242756d-ffcb-4781-957b-030c22459fe7 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 200 len: 1654 microversion: 2.20 time: 0.784501 Oct 04 18:18:45.412115 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2654/5180] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:44 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 1654 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:18:45.434814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:45.455660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:45.504026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.507078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.509794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:45.512744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:45.513905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:45.514945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.133191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1440770746", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "30917d39-0144-48f0-9f77-26db6733153d"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:46.271792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] validate_networks() for [('30917d39-0144-48f0-9f77-26db6733153d', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:18:46.303750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:46.330945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01c03e8e-ef36-493b-aeba-3cef6d4e870e tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1599 microversion: 2.1 time: 0.916479 Oct 04 18:18:46.332861 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2655/5181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:45 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1599 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:46.354578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b", "name": "network-vif-deleted", "tag": "009c802e-9af9-4a70-baa4-7f5df5a6b69a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:46.393323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.398941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.400097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.458201 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] Creating event network-vif-deleted:009c802e-9af9-4a70-baa4-7f5df5a6b69a for instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b on n-h2-831194-21 Oct 04 18:18:46.497231 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dca92532-13cb-46bc-bb10-bf07cf7813f7 req-3e48cf4f-bef6-4701-a760-a570d81749f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152372 Oct 04 18:18:46.500939 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2656/5182] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:18:46.522330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:46.551854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.584040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.586648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.597803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.602400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.606787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.608415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.815244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-403e3021-e963-4e29-a9e6-46c247390877 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e/action" status: 200 len: 24562 microversion: 2.1 time: 0.309340 Oct 04 18:18:46.816657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2657/5183] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:18:46 2022] POST /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e/action => generated 24562 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:18:46.838649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:46.848458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:46.880269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.881039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.881643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:46.882559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:46.883475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:46.884301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.388352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:47.405101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa228ab1-855a-4c8f-8ada-f2a3d329289d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 0.586952 Oct 04 18:18:47.407607 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2658/5184] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:46 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:47.415474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:47.417211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:47.434823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.438235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.438926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.439965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.441644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.443820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.467729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b HTTP/1.1 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b'} Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:47.469941 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:47.474102 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:47.483359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:47.487248 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4cd79b46-43b6-4b27-b8e6-2f761b90bb48 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 404 len: 111 microversion: 2.20 time: 0.076587 Oct 04 18:18:47.489042 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2659/5185] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:47 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:47.503931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:47.504950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:47.540246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.540756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.541207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.545424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.546016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.547715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.566729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:18:47.569666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:18:47.571275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:18:47.576674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:18:47.581557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:18:47.626395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.629050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.631991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.632758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lazy-loading 'fault' on Instance uuid e924c2f7-bad2-4672-bf2c-38277699cce9 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:18:47.644909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:47.672578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.676392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.677993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.685852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:47.689596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:47.692492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:47.750629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8834410be3bd4fc59aa77b782bb01b75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b02a27f8bc3144e484d3e39f5dfcd538', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:47.768589 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f6e0a86-486d-443e-ae0b-8057adf03245 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 200 len: 1315 microversion: 2.1 time: 0.275001 Oct 04 18:18:47.776750 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2660/5186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:47 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:47.814687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f852fc2b-9dbe-4210-b730-898ec8f54c93 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '.version_select at 0x7fbdbd6a5c10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:47.851904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Getting quotas for project 818e06ad721e42f7bbc4cff6e7af44dc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:18:47.870889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Getting quotas for user ba9d0df088774125a110b1b6390dff8a and project 818e06ad721e42f7bbc4cff6e7af44dc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:18:47.878826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f852fc2b-9dbe-4210-b730-898ec8f54c93 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-251171192" status: 204 len: 0 microversion: 2.20 time: 0.077759 Oct 04 18:18:47.882222 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2661/5187] 10.222.0.42 () {60 vars in 1259 bytes} [Tue Oct 4 18:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-251171192 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:18:47.899693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:18:47.902873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:18:48.028011 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eff3b7eb-1c25-4d08-8f90-c42c161cc0b2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.003722 Oct 04 18:18:48.037573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2527/5188] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:18:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:18:48.045106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6269f08d-9b5f-49fa-96de-661c58e9197a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.045746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6269f08d-9b5f-49fa-96de-661c58e9197a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.284546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6269f08d-9b5f-49fa-96de-661c58e9197a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:48.297412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6269f08d-9b5f-49fa-96de-661c58e9197a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1225 microversion: 2.1 time: 0.258040 Oct 04 18:18:48.298499 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2662/5189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1225 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:48.453359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.459518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.513066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.514420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.529819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.543029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.544915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.547219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.583864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e924c2f7-bad2-4672-bf2c-38277699cce9", "name": "network-vif-deleted", "tag": "8e97e46f-174f-44f1-8a90-5de10bdfebb1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:48.609402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.610309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.612627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.648725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] Creating event network-vif-deleted:8e97e46f-174f-44f1-8a90-5de10bdfebb1 for instance e924c2f7-bad2-4672-bf2c-38277699cce9 on n-h2-831194-21 Oct 04 18:18:48.669242 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-fe9b21d0-0cab-4a7b-b585-854724f5bcf8 req-925116d4-e1a2-4703-8704-952909cfc18e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092353 Oct 04 18:18:48.677366 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2663/5190] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 04 18:18:48.802135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:48.803821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] [instance: e924c2f7-bad2-4672-bf2c-38277699cce9] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:48.825562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.832689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.834214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.839722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:48.841218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:48.842919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:48.926342 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] HTTP exception thrown: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Request method failure captured: Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 HTTP/1.1 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHiipxNHcSGhedx2Kdc7i1kk-3sS7avFVG8nkdYUCM1FGridUQE-pHfq7HAGc7Jtr_ng5MWuhMI9z5e2xE-3_RdEwxTTVik5QJ_FpB8yg2SROu-SUGDuPEWB6qev6LidIKcAcBTMEXNw53fstJxZyayudRPuY50QBcAzibJPuM8BADY Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b02a27f8bc3144e484d3e39f5dfcd538 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersTestFqdnHostnames-1120461603 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b02a27f8bc3144e484d3e39f5dfcd538"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b02a27f8bc3144e484d3e39f5dfcd538"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b02a27f8bc3144e484d3e39f5dfcd538"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b02a27f8bc3144e484d3e39f5dfcd538"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersTestFqdnHostnames-1120461603 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b02a27f8bc3144e484d3e39f5dfcd538 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1120461603 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersTestFqdnHostnames-1120461603-project Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 8834410be3bd4fc59aa77b782bb01b75 Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersTestFqdnHostnames-1120461603-project Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e924c2f7-bad2-4672-bf2c-38277699cce9'} Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:48.929768 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. Oct 04 18:18:48.937455 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:18:48.947145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Returning 404 to user: Instance e924c2f7-bad2-4672-bf2c-38277699cce9 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:48.948374 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-110e174e-dfe8-42c2-84e0-86617c3373cc tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9" status: 404 len: 111 microversion: 2.1 time: 0.150676 Oct 04 18:18:48.954298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2664/5191] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/e924c2f7-bad2-4672-bf2c-38277699cce9 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:18:48.965644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf1da637-37f8-4533-8cae-0d7d03537e94 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] Calling method '.version_select at 0x7fbdbdc2d940>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.014931 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf1da637-37f8-4533-8cae-0d7d03537e94 tempest-ServersTestFqdnHostnames-1120461603 tempest-ServersTestFqdnHostnames-1120461603-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894873167" status: 202 len: 0 microversion: 2.1 time: 0.059619 Oct 04 18:18:49.015830 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2665/5192] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 18:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894873167 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:18:49.336162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-249c8391-4a3c-4454-a7fb-50b33dad7698 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:49.338619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-249c8391-4a3c-4454-a7fb-50b33dad7698 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:49.629874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-249c8391-4a3c-4454-a7fb-50b33dad7698 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.685217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-249c8391-4a3c-4454-a7fb-50b33dad7698 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1225 microversion: 2.1 time: 0.352678 Oct 04 18:18:49.752333 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2666/5193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:49 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1225 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:49.787556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:49.819257 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d04a85a5-a730-41e9-9f88-8cdfd260c1f0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 1.387182 Oct 04 18:18:49.826840 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2528/5194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:48 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:50.779966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.781572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.826308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.827071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.828450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.829507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.830467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.831124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.869177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:50.872080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:50.897451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.898756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.899391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:50.900298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:50.903226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:50.903876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:51.164706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:51.181397 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b21c5f9c-8b7c-4573-8040-08798d3f84be tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1277 microversion: 2.1 time: 0.407149 Oct 04 18:18:51.187050 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2667/5195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1277 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:51.214721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:51.230875 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d326c7c5-284b-47a2-aeb4-8e3a3de4dbc4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 0.368189 Oct 04 18:18:51.252670 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2529/5196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:50 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:52.214694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.215936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.234870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.239430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.241209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.242228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.246643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.248139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.263944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:52.265235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:52.281223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.285688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.289747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.293235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:52.298556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:52.302095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:52.714704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:52.727392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af38ea10-6805-496e-b6cd-7bdd2afc1ae2 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1283 microversion: 2.1 time: 0.517642 Oct 04 18:18:52.751933 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2668/5197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1283 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:53.315873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:53.325923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d10af0be-88c3-46c0-9c65-3f79d8b4dc67 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 1.066938 Oct 04 18:18:53.330665 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2530/5198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:52 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:18:53.760706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:53.761570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:53.781368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.781891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.782343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:53.788370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:53.788885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:53.789338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.377031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:54.378083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:54.423429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.423937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.424380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.425104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:54.425561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:54.426027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:54.838593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:54.865055 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-737af76d-cc60-45dd-bfb7-71d319eb2c26 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1283 microversion: 2.1 time: 1.108005 Oct 04 18:18:54.866045 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2669/5199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:53 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1283 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:55.057453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:55.085779 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f805a76-ff83-4e7b-b658-4543ffe6d8dc tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 0.714959 Oct 04 18:18:55.097076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2531/5200] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:54 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:55.916618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:55.920215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:55.949456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6533dc2d-bb1c-4748-b9f2-e73a261488f7", "name": "network-vif-plugged", "status": "completed", "tag": "d6e1f770-34f3-46a5-9536-6890b43dfba9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:18:55.962152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.963565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.980009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:55.981526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:55.989927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:55.991702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.013975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:56.039803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.046301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.050378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.118978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:56.132659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] Creating event network-vif-plugged:d6e1f770-34f3-46a5-9536-6890b43dfba9 for instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 on n-h1-831194-21 Oct 04 18:18:56.156707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c5fa5feb-c8c3-4369-9110-2254a5cb9d14 req-53344e0f-14ea-41c8-91ab-e40340fbbd64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216761 Oct 04 18:18:56.157905 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2532/5201] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:18:56.163656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:56.165594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:56.176477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.177229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.177967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.178887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:56.180186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:56.182839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:56.549187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:56.568218 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3f61ad9-f1b8-4096-95f1-1f5e25d0a4ed tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1283 microversion: 2.1 time: 0.662217 Oct 04 18:18:56.581136 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2670/5202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:55 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1283 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.383263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:57.426671 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc7b710b-681f-461b-a165-e187ca9ae510 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 1.263413 Oct 04 18:18:57.430859 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2533/5203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:56 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:57.605767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.615223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.655172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.661943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.662680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.664314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.667465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.669910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.787810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:57.788985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:57.826071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:57.832555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.844575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.845811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.850549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:57.851813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:57.855684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:57.942220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:57.952422 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b HTTP/1.1 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b'} Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:57.957991 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:57.966475 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:57.984309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:57.986162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2522b82f-ded5-4b9e-89a5-80ab47560cb3 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 404 len: 111 microversion: 2.20 time: 0.205801 Oct 04 18:18:57.990277 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2534/5204] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:18:57 2022] DELETE /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 111 bytes in 211 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:58.036935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.045285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.073327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.074906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.086967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.099064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.099769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.100496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.171832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b HTTP/1.1 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b'} Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.179676 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. Oct 04 18:18:58.187039 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:18:58.189502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:18:58.196455 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19e5a79a-f28a-47a2-9a95-30060470add8 tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b" status: 404 len: 111 microversion: 2.20 time: 0.193404 Oct 04 18:18:58.198372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2535/5205] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/e1d8fb19-c6cb-42f5-bc7d-7fdc62ca788b => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:18:58.468442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:58.469543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:58.531567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.532380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.533062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.534089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:58.536101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:58.537316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:58.659837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:58.689396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cec50ba0-0596-4f62-b269-17e4fbb8a005 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 1.091920 Oct 04 18:18:58.713328 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2671/5206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:57 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:59.298462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:18:59.313525 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-15905b85-6009-41e5-a691-d776afe5ee27 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1314 microversion: 2.1 time: 0.849625 Oct 04 18:18:59.314244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2536/5207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:58 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:18:59.717078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:18:59.718388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:18:59.735344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:18:59.741728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.744117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.745106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:18:59.750060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:18:59.751979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:18:59.752754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.354107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:00.354922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:00.387170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.388071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.388865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:00.404219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:00.408479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:00.409274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:01.915077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:01.933479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-881e94ff-bdc9-46ba-9e83-99f77b808186 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1502 microversion: 2.1 time: 1.583982 Oct 04 18:19:01.941388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2537/5208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:00 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1502 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:01.965124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:01.965749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:01.988962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:01.993675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.000187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.004819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:02.006118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:02.007894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:02.096161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:02.123286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed038651-ecc0-4e21-8e76-cd3d3ecd9ab8 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 2.398460 Oct 04 18:19:02.140775 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2672/5209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:18:59 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 2429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:03.091638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.network.security_group_api [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Removing security group 9e5dfd5e-fbbc-4bb9-b6ef-941e8bdb8f77 from port d6e1f770-34f3-46a5-9536-6890b43dfba9 Oct 04 18:19:03.161502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:03.163507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:03.190223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:03.229195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.245893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.247435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:03.249052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:03.250220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:03.251289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.115371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:04.135244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1b053a1-a95f-43fc-bbc6-b4a28a32057e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 0.975887 Oct 04 18:19:04.140292 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2673/5210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:03 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:04.625647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8da9290c-6cb4-4548-959c-4e8959f5fab0", "tag": "07476f66-6145-4729-9994-af46dac2450d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:04.674809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.678329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.679203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.727050 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] Creating event network-changed:07476f66-6145-4729-9994-af46dac2450d for instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 on n-h2-831194-21 Oct 04 18:19:04.746206 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-db068347-9994-4756-8c65-a4e9e2e7a488 req-e8ba8212-a59b-4712-8c4e-b2524d7a30c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127925 Oct 04 18:19:04.748835 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2674/5211] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:04.790069 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dcca21ac-c186-4ab7-b79f-834f5df70aab tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7/action" status: 202 len: 0 microversion: 2.1 time: 2.827133 Oct 04 18:19:04.791430 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2538/5212] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:01 2022] POST /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7/action => generated 0 bytes in 2833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:04.802447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:04.803370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:04.815313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6533dc2d-bb1c-4748-b9f2-e73a261488f7", "tag": "d6e1f770-34f3-46a5-9536-6890b43dfba9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:04.823130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.826532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.834609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.835656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.836293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.836905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.846161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:04.851393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:04.852097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:04.904489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] Creating event network-changed:d6e1f770-34f3-46a5-9536-6890b43dfba9 for instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 on n-h1-831194-21 Oct 04 18:19:04.914060 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4330ffac-94b9-46f1-9493-5e8e1afd988a req-64bb9e7c-cb6e-42b3-9fd8-4a981e51d226 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101833 Oct 04 18:19:04.918097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2539/5213] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:19:05.170572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.172686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.189412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.195685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.199309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.201676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.205658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.207224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.365557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:05.381060 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45d2ff38-80c7-4021-95d4-4891eedd830c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1460 microversion: 2.1 time: 0.585129 Oct 04 18:19:05.386627 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2675/5214] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:04 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1460 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:05.447271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:05.450463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:05.507774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.508652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.509789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:05.518172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:05.523326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:05.526281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:06.838919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:06.885311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc83ada0-084a-4a94-9cfa-d8f7d359c573 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.461531 Oct 04 18:19:06.898662 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2676/5215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:06.962057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:06.975238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:07.022449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.026546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.038497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:07.040127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:07.046517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:07.048782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.690936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.716890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b14f959-e581-4622-9ba6-f245d06f92c6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.764006 Oct 04 18:19:08.734098 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2677/5216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:06 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:08.762783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.764621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.788327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.795593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.798641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.805144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:08.812741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.817631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.822866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.834702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f4b2605-40de-475c-a46c-df3f3a5ba9ff tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 3.672468 Oct 04 18:19:08.851171 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2540/5217] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:05 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 3690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:08.884515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.887407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:08.911399 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e HTTP/1.1 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'cd46ae90-7c6a-4cbd-8fc3-df795d4f846e'} Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:08.914538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:08.918645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:08.924079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34a1aa82-8f79-4798-a7aa-b5796a0f740b tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 404 len: 111 microversion: 2.20 time: 0.180939 Oct 04 18:19:08.941773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.942996 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2678/5218] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:19:08 2022] DELETE /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 111 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:08.947867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.964212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.965248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:08.965822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:08.982813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:08.982923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:08.982923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] [instance: cd46ae90-7c6a-4cbd-8fc3-df795d4f846e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:09.015101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.015592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.024158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.025958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.043254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.050551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.153649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] HTTP exception thrown: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Request method failure captured: Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e HTTP/1.1 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHbkxhK_P0PGNSXQH0D6LEqPcle54Tv-5QVBamg5826ArfnE7RF4uoSyO-OBoiwILGvAv9x8879RsHAdu0HOwf67RjwvW-7-ElPhG_RKgZo7akxip_WtRoNsbKxjiHpiTSH3HFmyyvisk0Gx2MLlmgG1KFBaXoeyy7dS_moMwWZ3kY4 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.20 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_e2ed0241d5024b11b38cf1be25968ab3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: e2ed0241d5024b11b38cf1be25968ab3 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1443244747 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ec0e669bee9d4d949510d5a0c6576b70 Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1443244747-project Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'cd46ae90-7c6a-4cbd-8fc3-df795d4f846e'} Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:09.167888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:09.172724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] Returning 404 to user: Instance cd46ae90-7c6a-4cbd-8fc3-df795d4f846e could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:09.180826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6000c0f-8fd4-4ea8-9044-60bc4c5507fa tempest-AttachVolumeShelveTestJSON-1443244747 tempest-AttachVolumeShelveTestJSON-1443244747-project] 10.222.0.42 "GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e" status: 404 len: 111 microversion: 2.20 time: 0.224005 Oct 04 18:19:09.188259 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2679/5219] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/cd46ae90-7c6a-4cbd-8fc3-df795d4f846e => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:19:09.895213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:09.904413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:09.967418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.968292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.975384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:09.981189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:09.985912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:09.987019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.564151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:10.580395 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-726f81e6-45d4-45c9-927e-b612908793b6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 1.727292 Oct 04 18:19:10.581322 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2541/5220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:08 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:10.607504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2340d6a7-76e8-498b-8447-b569814c7bb1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: .version_select at 0x7fbdc1dd89d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-105059886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx+9zzBarhPB+pxa/L4FGfNFl8wpsVvlYP+PqlmMPU9/RZi4Nv5NkIUbj+Oa/Ba4GYkVUijF3rSEDlYs4CkW7t/+jN7I54kF2N+bIVfUKzlkKm3KAMbsKM9RdDxAft0Kg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:10.630070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2340d6a7-76e8-498b-8447-b569814c7bb1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:10.647092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2340d6a7-76e8-498b-8447-b569814c7bb1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:10.709237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2340d6a7-76e8-498b-8447-b569814c7bb1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.115000 Oct 04 18:19:10.713917 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2542/5221] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:19:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:10.733543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:10.739216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:10.765368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.766755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.769362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:10.773126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:10.776290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:10.776979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:11.045555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:11.060236 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b6cf9c9-a6ef-45f8-be7b-a1efd2d1dccf tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 1.191637 Oct 04 18:19:11.064186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2680/5222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:09 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 1197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:12.098843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:12.103081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:12.115855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.117175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.118753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.120415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:12.121275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:12.122378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:12.729786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:12.759132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0b96cbb-22ca-457b-9365-1f23dfb1546a tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 0.666680 Oct 04 18:19:12.760639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2681/5223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:12 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.124208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:13.148165 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89e0c02d-0887-461d-b2f1-9c14f64a9261 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 2.431748 Oct 04 18:19:13.172534 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2543/5224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:10 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:13.414360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1848110974", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5b05bd8e-240d-49e1-9616-3083c9ab006c"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:13.569157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] validate_networks() for [('5b05bd8e-240d-49e1-9616-3083c9ab006c', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:13.789524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:13.791140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:13.825627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.826787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.827751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:13.829185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:13.830277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:13.831268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:15.504447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:15.533861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-879a6eae-13ba-4789-bf38-045fbe5676ec tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 1.748115 Oct 04 18:19:15.535120 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2544/5225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:13 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 1751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:15.943985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:15.945536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:15.947801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:15.948786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:15.949771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:16.011610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.012710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.013641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.019317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.020262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.021354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.090808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:16.117392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Getting quotas for user 660c26677c2540f5a005dcd39c069e23 and project 2d3a8d459e664953940ec74e2b29e60c. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:16.168165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:16.171145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:16.327688 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-65e39ff8-0032-44af-b98c-cf5cc7b4631c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.917125 Oct 04 18:19:16.335575 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2682/5226] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:16.345585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56e3f256-1483-410d-a10b-cc9fdb74adf8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:16.348602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56e3f256-1483-410d-a10b-cc9fdb74adf8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:16.566954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:16.568109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:16.610250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.611957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.614534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.620055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:16.624771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:16.627595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:16.859047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56e3f256-1483-410d-a10b-cc9fdb74adf8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:16.899499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56e3f256-1483-410d-a10b-cc9fdb74adf8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1215 microversion: 2.1 time: 0.560059 Oct 04 18:19:16.903126 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2545/5227] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:16 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1215 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:17.581911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:17.600032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25f1f790-719e-4835-b124-428433568e44 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 1.039559 Oct 04 18:19:17.606535 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2683/5228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:16 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:17.773147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da9290c-6cb4-4548-959c-4e8959f5fab0", "name": "network-vif-plugged", "status": "completed", "tag": "07476f66-6145-4729-9994-af46dac2450d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:17.834370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:17.836487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:17.839112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:17.877562 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] Creating event network-vif-plugged:07476f66-6145-4729-9994-af46dac2450d for instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 on n-h2-831194-21 Oct 04 18:19:17.893683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6e681334-491f-4935-b6f6-2372a717492d req-c341450f-b12f-437b-99c0-6aa5962260ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123872 Oct 04 18:19:17.897752 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2546/5229] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:17.937200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-760c50e9-ab49-4c7d-9f46-9041e5255ab4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:17.938074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-760c50e9-ab49-4c7d-9f46-9041e5255ab4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:18.294504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-760c50e9-ab49-4c7d-9f46-9041e5255ab4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:18.314776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-760c50e9-ab49-4c7d-9f46-9041e5255ab4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1215 microversion: 2.1 time: 0.385493 Oct 04 18:19:18.321017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2684/5230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:17 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1215 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:18.646254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:18.647171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:18.669814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.674437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.675417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:18.678243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:18.682167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:18.683083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.095436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.112563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8658dab7-3573-4c4c-ae41-dcc43dcd245e tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 0.474425 Oct 04 18:19:19.113568 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2547/5231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:18 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:19.268513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-547816502", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "229266ad-8a43-4a00-9c71-80c4e6590b8d"}], "key_name": "tempest-TestNetworkBasicOps-105059886", "security_groups": [{"name": "tempest-secgroup-smoke-2060142734"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:19.361775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:19.362617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:19.382469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.385386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.389671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.395631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:19.398395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:19.399352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:19.826241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:19.862922 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6bb89527-42ab-4580-9218-0314459be26a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1275 microversion: 2.1 time: 0.502951 Oct 04 18:19:19.869210 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2548/5232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:19 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1275 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:20.147380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:20.148878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:20.175912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.178802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.179650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.179958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:20.180852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:20.189782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:20.295293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] validate_networks() for [('229266ad-8a43-4a00-9c71-80c4e6590b8d', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:21.063274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:21.088730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97157d45-57c0-4189-8cc4-a05c5b638f82 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1325 microversion: 2.1 time: 0.943830 Oct 04 18:19:21.098419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2549/5233] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:20 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1325 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:21.127817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:21.133042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:21.160715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.163911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.164613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.173537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:21.175643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:21.178870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:21.585270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:21.603287 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd82c17f-42e6-45d1-a492-49b7d5d2e419 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1273 microversion: 2.1 time: 0.499135 Oct 04 18:19:21.608680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2550/5234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:21 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:22.104137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:22.105578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:22.106385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:22.107436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:22.115528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.116515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.117883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:22.148968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.152256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.156108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.159956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.163904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.166432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.167405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.173849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.175280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.181773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:22.186795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:22.190381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:22.263626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=94 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:22.349641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:22.385516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:22.457349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:22.460005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:22.577751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-241fcaec-030b-478a-8696-4e562c5bf3e1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.316049 Oct 04 18:19:22.578769 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2685/5235] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 3318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:22.599421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b3e3376-5d3c-4062-ac2e-76a0799b6290 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:22.611892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b3e3376-5d3c-4062-ac2e-76a0799b6290 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:22.924732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b3e3376-5d3c-4062-ac2e-76a0799b6290 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:22.974877 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b3e3376-5d3c-4062-ac2e-76a0799b6290 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1247 microversion: 2.1 time: 0.376947 Oct 04 18:19:23.014643 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2686/5236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1247 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:23.031335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:23.033815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:23.050578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.052048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.053083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:23.056933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:23.059446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:23.060652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.002034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.027406 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f868adf-a731-4d3a-874e-13c3bfd9aae3 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1523 microversion: 2.1 time: 1.914055 Oct 04 18:19:24.031442 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2551/5237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:22 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1523 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:24.046397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.050175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.075362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.076853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.079173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.084723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.086181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.090723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.395083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.404488 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1580d335-3f9a-4afb-b480-90b705eaea01 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1243 microversion: 2.1 time: 0.370869 Oct 04 18:19:24.410744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2552/5238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1243 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.429227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.438736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.453526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:24.456191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.461395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.462459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.463615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.464281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.464823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.467392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dce4954f-aaf6-4b9d-a04b-5a86fb16d989 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 1.449712 Oct 04 18:19:24.471782 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2687/5239] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:23 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:24.549585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] HTTP exception thrown: Action 999 not found Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Request method failure captured: Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0/os-instance-actions/999 HTTP/1.1 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHkEfMD_k_TvQRq6qTyn85Fug2_BHRzx0mOpvqILb3QTRs2Q7YAK-e35pUiDKORUoXqXDVuGi2Reg1TmgEUIG4XCx1qggGdCZXNBPSre3gXvEKod9-tfyv4Jnz0kQH0mVZvEXafphs0DPn3Chenni1gwkIEUEPOPOFUtqNZDj73wZCY Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ba9d0df088774125a110b1b6390dff8a Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: exception: Action 999 not found Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '8da9290c-6cb4-4548-959c-4e8959f5fab0', 'id': '999'} Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 04 18:19:24.557214 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.563022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Returning 404 to user: Action 999 not found {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:24.563345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-863545a8-2eca-4516-82cf-0520776fcd75 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.149323 Oct 04 18:19:24.565029 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2553/5240] 10.222.0.42 () {58 vars in 1308 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0/os-instance-actions/999 => generated 66 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:19:24.577092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '.version_select at 0x7fbdbe97b3a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.577662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: a6756742-e1be-4f37-b9ca-163d37d23316] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.588462 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] HTTP exception thrown: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Request method failure captured: Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a6756742-e1be-4f37-b9ca-163d37d23316/os-instance-actions HTTP/1.1 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHkEfMD_k_TvQRq6qTyn85Fug2_BHRzx0mOpvqILb3QTRs2Q7YAK-e35pUiDKORUoXqXDVuGi2Reg1TmgEUIG4XCx1qggGdCZXNBPSre3gXvEKod9-tfyv4Jnz0kQH0mVZvEXafphs0DPn3Chenni1gwkIEUEPOPOFUtqNZDj73wZCY Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ba9d0df088774125a110b1b6390dff8a Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': 'a6756742-e1be-4f37-b9ca-163d37d23316'} Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:24.590372 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Returning 404 to user: Instance a6756742-e1be-4f37-b9ca-163d37d23316 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:24.598293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf0d42fa-d1ac-4a55-9dee-75e25895498f tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/a6756742-e1be-4f37-b9ca-163d37d23316/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.018948 Oct 04 18:19:24.603924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:24.604588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:24.619615 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2688/5241] 10.222.0.42 () {58 vars in 1296 bytes} [Tue Oct 4 18:19:24 2022] GET /compute/v2.1/servers/a6756742-e1be-4f37-b9ca-163d37d23316/os-instance-actions => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:19:24.628897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.629738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.630535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.641032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:24.641958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:24.642742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:24.741391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:24.784458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:19:25.174059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91572e70-030b-4ddd-93a5-41b493fc62cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 204 len: 0 microversion: 2.1 time: 0.573552 Oct 04 18:19:25.177808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2554/5242] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:19:24 2022] DELETE /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:19:25.198878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.204323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.232136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.232960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.233618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.235281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.237676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.239200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.438099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.439150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.453881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.454413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.454871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.458748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.459263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.462316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.597079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:25.610714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7367ed92-8b80-475d-8a0b-2f00cd7186c5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1307 microversion: 2.1 time: 0.174075 Oct 04 18:19:25.613045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2555/5243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1307 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:25.624784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:25.625428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:25.644227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.651730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.653365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:25.659264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:25.660461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:25.661088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.806571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.839210 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8c61ca2-5617-4be2-bede-c7b85056dfd0 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1529 microversion: 2.1 time: 1.656049 Oct 04 18:19:26.848032 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2689/5244] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1529 bytes in 1666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:26.889343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:26.890462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:26.892344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:26.905965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:26.924208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.927446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.928840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.938749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:26.940006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:26.941039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:26.945291 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-966ad9b4-68a6-439f-97b6-1679116f16dd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 1.328937 Oct 04 18:19:26.967489 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2556/5245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:25 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.561172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67463c20-313a-4646-9754-3aab7f8824c8", "tag": "dc0f9f75-074e-4472-81ee-db9fc98eb4a9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:27.569897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:27.596158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.611215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.616802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.664219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] Creating event network-changed:dc0f9f75-074e-4472-81ee-db9fc98eb4a9 for instance 67463c20-313a-4646-9754-3aab7f8824c8 on n-h1-831194-21 Oct 04 18:19:27.682416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b3b13aa1-9b04-451a-b419-58492658570a req-f7e1769f-3be0-483a-bec0-56133530db10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123745 Oct 04 18:19:27.690709 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2557/5246] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:27.903294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.904634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:27.927648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:27.955753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.956276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.957197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.960163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-802cd460-7f9c-4029-9219-97440537c23d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1305 microversion: 2.1 time: 1.106315 Oct 04 18:19:27.961564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2690/5247] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:26 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1305 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:27.968308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:27.976621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:27.980543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:27.994679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:27.996488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:28.027067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.033769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.034788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:28.035793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:28.036900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:28.038347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.114491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.132207 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7cb74f6-3262-4ba8-a5ca-c87e7ec75ed2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 1.152010 Oct 04 18:19:29.132207 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2691/5248] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.137508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:29.151087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:29.157993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.159106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.160110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.161626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:29.166061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:29.167053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:29.178033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.194942 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0cccf25b-df06-4b48-bb20-dfb40cc78270 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1529 microversion: 2.1 time: 1.301972 Oct 04 18:19:29.198297 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2558/5249] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:27 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1529 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:29.384402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:29.419093 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b42a31be-1d5e-458c-b5ff-b4b3e0186189 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1305 microversion: 2.1 time: 0.286332 Oct 04 18:19:29.424837 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2692/5250] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:29 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1305 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.176617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.177284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.221310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.223150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.230191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.236657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.240550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.242096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.242834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.245310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.253186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.254176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.255032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.257245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.259858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.260617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.679551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:30.794796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-410e3f28-b4b8-4b17-82a7-228036fc3423 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1487 microversion: 2.1 time: 0.548051 Oct 04 18:19:30.797589 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2693/5251] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1487 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:30.840498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:30.841339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:30.859689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.860199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.866499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:30.868019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:30.868785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:30.869390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.106474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:31.148336 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f93fe66-a362-4424-a819-5ca874472ec3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 0.957298 Oct 04 18:19:31.150323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2559/5252] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:31.184977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8da9290c-6cb4-4548-959c-4e8959f5fab0", "name": "network-vif-deleted", "tag": "07476f66-6145-4729-9994-af46dac2450d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:31.238892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.241043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.246903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.314271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] Creating event network-vif-deleted:07476f66-6145-4729-9994-af46dac2450d for instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 on n-h2-831194-21 Oct 04 18:19:31.336710 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3e1185fc-4088-4f2b-8c47-a3de86752807 req-4ab1f0bb-5a7f-4f37-9773-0a49470726d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183904 Oct 04 18:19:31.350092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2560/5253] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:31.845925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:31.847120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:31.901375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.902577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.909747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:31.911956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:31.913186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:31.913964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.078086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.079349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.080447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.081610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lazy-loading 'fault' on Instance uuid 8da9290c-6cb4-4548-959c-4e8959f5fab0 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:32.259501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:32.358667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.375288 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-457cffad-e211-4fa7-b4f6-eff7aeb116f6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 1.564328 Oct 04 18:19:32.375936 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2694/5254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:30 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 1578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:32.385772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:32.386838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:32.401122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.403801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.404277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.405418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:32.405923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:32.406372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:32.626442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba9d0df088774125a110b1b6390dff8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '818e06ad721e42f7bbc4cff6e7af44dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:32.639213 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db09395e-ebdb-4740-8693-d075c794c7cd tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 200 len: 1315 microversion: 2.1 time: 0.801604 Oct 04 18:19:32.641375 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2561/5255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:31 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:32.963662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:33.247525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:33.260985 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7b76122a-fa9e-4605-9839-0ce01ce30988 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 0.883410 Oct 04 18:19:33.266253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2695/5256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:32 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:33.427498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.433791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.468690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.469668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.470397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.473691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.475796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.477262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.698858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:33.703671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] [instance: 8da9290c-6cb4-4548-959c-4e8959f5fab0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:33.724996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:33.773092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.780049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.787961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.789698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:33.794231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:33.799046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:33.854001 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] HTTP exception thrown: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Request method failure captured: Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 HTTP/1.1 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHkEfMD_k_TvQRq6qTyn85Fug2_BHRzx0mOpvqILb3QTRs2Q7YAK-e35pUiDKORUoXqXDVuGi2Reg1TmgEUIG4XCx1qggGdCZXNBPSre3gXvEKod9-tfyv4Jnz0kQH0mVZvEXafphs0DPn3Chenni1gwkIEUEPOPOFUtqNZDj73wZCY Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_818e06ad721e42f7bbc4cff6e7af44dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 818e06ad721e42f7bbc4cff6e7af44dc Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1462910778 Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ba9d0df088774125a110b1b6390dff8a Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1462910778-project Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8da9290c-6cb4-4548-959c-4e8959f5fab0'} Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.857807 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. Oct 04 18:19:33.867108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:19:33.872673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] Returning 404 to user: Instance 8da9290c-6cb4-4548-959c-4e8959f5fab0 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:19:33.874612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f693ceb-4ae5-446c-b896-0a1f591318c6 tempest-InstanceActionsNegativeTestJSON-1462910778 tempest-InstanceActionsNegativeTestJSON-1462910778-project] 10.222.0.42 "GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0" status: 404 len: 111 microversion: 2.1 time: 0.186955 Oct 04 18:19:33.875911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2696/5257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/8da9290c-6cb4-4548-959c-4e8959f5fab0 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:19:34.317765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:34.326263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:34.351923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.353409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.354981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.356835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:34.358629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:34.359836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:34.617823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:34.632116 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eeb75d1c-1858-4ef2-a4cd-c6ffbc689cf7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 1.216033 Oct 04 18:19:34.632852 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2562/5258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:33 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:35.667883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:35.668897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:35.717097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.718311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.719257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.720441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.721256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.722032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.815716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:35.841601 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f284f07-9960-4d54-827e-b94925910a87 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 1.531123 Oct 04 18:19:35.846306 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2697/5259] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:34 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:35.862226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67463c20-313a-4646-9754-3aab7f8824c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc0f9f75-074e-4472-81ee-db9fc98eb4a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:35.911736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:35.912926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:35.914381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:35.949702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] Creating event network-vif-plugged:dc0f9f75-074e-4472-81ee-db9fc98eb4a9 for instance 67463c20-313a-4646-9754-3aab7f8824c8 on n-h1-831194-21 Oct 04 18:19:35.962752 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-89884322-67b7-4412-a32f-6a8f44f23e5f req-d1eac0fb-6947-4872-969d-40a50ef798ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113330 Oct 04 18:19:35.981597 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2698/5260] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:36.000758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df4e1c60-a85a-4f47-a357-c2b2f7aaa694", "tag": "af8486bf-8779-479d-ac2d-80a70128925b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:36.023140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.024437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.026146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.058030 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] Creating event network-changed:af8486bf-8779-479d-ac2d-80a70128925b for instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 on n-h2-831194-21 Oct 04 18:19:36.067502 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-02112f1a-4253-472a-9735-1ac6e7291bc8 req-e080b130-d2df-4fae-b7d2-514fae361648 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080660 Oct 04 18:19:36.068419 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2699/5261] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:36.572586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:36.599891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a31d94f-b547-4e39-b98c-a1ad074ec1b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.942004 Oct 04 18:19:36.613857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2563/5262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:35 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:36.890348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:36.893108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:36.897887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.898895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.899614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:36.900894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:36.901630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:36.902262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.642820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:37.644793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:37.671768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.675998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.676772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.678069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:37.679268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:37.681688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:37.790716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:37.807473 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5296ea8-ff17-4269-8be7-0539e64d6dfd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1315 microversion: 2.1 time: 0.922667 Oct 04 18:19:37.808710 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2700/5263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:36 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1315 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.409414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:38.430210 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e06db07c-9f7e-40af-b3b7-bb6dfc0db49d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.793422 Oct 04 18:19:38.432266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2564/5264] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:37 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:38.848884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:38.849605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:38.867771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.868293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.868830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:38.869571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:38.870082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:38.870583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.466486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:39.467731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:39.489268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.490702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.490702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:39.491066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:39.493338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:39.494257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.090446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:40.116845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24903f71-1e00-4b6e-93a7-c4d74119427c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1502 microversion: 2.1 time: 1.266584 Oct 04 18:19:40.119771 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2701/5265] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:38 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1502 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:40.148485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:40.150344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.165810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.171508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.174055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.184905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.184905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.185298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.419986 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f738e0b0-5087-4aa1-9831-6d1fb0f09cd6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8/action" status: 202 len: 0 microversion: 2.1 time: 0.275498 Oct 04 18:19:40.440969 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2702/5266] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:40 2022] POST /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8/action => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:40.488785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:40.504840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:40.528863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.530378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.531416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.532964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:40.534395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:40.536125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:40.990586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.042676 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-64a3c65b-779c-4c14-b2a7-b19a5743b21b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 1.580697 Oct 04 18:19:41.048782 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2565/5267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:39 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:41.221498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:41.245735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20ac4ebe-82fd-4817-851c-3ca5dc4cbf8e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1507 microversion: 2.1 time: 0.798590 Oct 04 18:19:41.251265 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2703/5268] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:40 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1507 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:42.120599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.122082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.168506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.169808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.176181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.179046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.180745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.182833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.286388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:42.287674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:42.301986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.304575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.305930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:42.307371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:42.310622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:42.311273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.383656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:43.414335 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0e85a4a5-f9a2-4900-a43c-ad6cfa8a12d4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1487 microversion: 2.1 time: 1.131599 Oct 04 18:19:43.433859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2704/5269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1487 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:43.469651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:43.470715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:43.487883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.495093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.495573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.501627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:43.502321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:43.502787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:43.642741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:43.671890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:43.702724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lazy-loading 'flavor' on Instance uuid 67463c20-313a-4646-9754-3aab7f8824c8 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:19:43.720783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-548e324d-b5ae-4273-a9fa-632b7349801f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 1.644802 Oct 04 18:19:43.731498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2566/5270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:42 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:44.387550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c023069c-3878-4d28-95bc-9503bc4e380c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8/action" status: 202 len: 0 microversion: 2.1 time: 0.921708 Oct 04 18:19:44.391173 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2705/5271] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:19:43 2022] POST /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:19:44.401708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.402984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.448939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.455662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.456638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.462440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.463461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.467397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.769710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:44.772663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:44.796313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.797181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.818284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:44.824025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:44.825079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:44.826196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:45.562577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.594567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d9629a4-8a10-499b-8e9b-eab4df720d41 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.819720 Oct 04 18:19:45.596298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2706/5272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:45.659460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:45.674197 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-578caa72-763e-48df-9e64-ff803aaf883f tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1493 microversion: 2.1 time: 1.278450 Oct 04 18:19:45.675361 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2567/5273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:44 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1493 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:46.640443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.642551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.666507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.678640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.690777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.695615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.702903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.705419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.715632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:46.716826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:46.830600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.839650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.840733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:46.853267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:46.858644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:46.866183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:47.240052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:47.304600 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45f364b2-9cb5-4b25-9298-2a608722348c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.652356 Oct 04 18:19:47.314152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2707/5274] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:47.937318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9894bd6-cd2d-402c-b7a4-a70c84a8dfd6 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2102864362", "availability_zone": "foo_zone"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:47.980724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.aggregate [None req-c9894bd6-cd2d-402c-b7a4-a70c84a8dfd6 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Generated uuid c76fbdb7-1e4a-4575-bd60-3b2410057b6b for aggregate {{(pid=128849) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 04 18:19:48.023528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:48.047522 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9894bd6-cd2d-402c-b7a4-a70c84a8dfd6 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.696464 Oct 04 18:19:48.049596 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2708/5275] 10.222.0.42 () {60 vars in 1164 bytes} [Tue Oct 4 18:19:47 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:48.080216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5782a05-2b20-4df3-ab52-4a0da1218544 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 1.365546 Oct 04 18:19:48.084866 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2568/5276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:46 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:48.091208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17ff809c-85d9-4d6e-b693-cfcf6b0a588d tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.150344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17ff809c-85d9-4d6e-b693-cfcf6b0a588d tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.083525 Oct 04 18:19:48.154444 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2709/5277] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:48.175811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.195559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.196582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.197382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.198577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.199481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.200097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.324920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1dd99a9c-4e38-4149-8cfc-f3fa52403354 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.156264 Oct 04 18:19:48.327639 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2569/5278] 10.222.0.42 () {58 vars in 1176 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:48.341071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.341470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:48.359207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a662cee-fa47-403d-8034-4b74a342f102 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:48.369105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.369626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.370452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.371464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.372393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.373001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:48.384501 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a662cee-fa47-403d-8034-4b74a342f102 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.039267 Oct 04 18:19:48.391080 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2570/5279] 10.222.0.42 () {58 vars in 1143 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:48.414157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-532e2b8d-e919-4489-8db8-785385278717 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-831194-21"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:48.436130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532e2b8d-e919-4489-8db8-785385278717 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:48.436930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532e2b8d-e919-4489-8db8-785385278717 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:48.437505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-532e2b8d-e919-4489-8db8-785385278717 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.113406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:49.158202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-532e2b8d-e919-4489-8db8-785385278717 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.760268 Oct 04 18:19:49.162830 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56bcfe33-fe39-412d-b920-5ede62dd1bd9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.825402 Oct 04 18:19:49.164030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2571/5280] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 18:19:48 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.187061 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2710/5281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:48 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:49.213195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dd9661d-3cf8-494c-8b39-e9380a889073 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.213802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.215763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:49.244501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.245419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.248372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.252099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9dd9661d-3cf8-494c-8b39-e9380a889073 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.060203 Oct 04 18:19:49.253218 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2711/5282] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.253630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:49.254777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:49.255471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:49.295623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19ecf51b-fce8-49d7-a977-453d3a0f763e tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-19057704", "availability_zone": "foo_zone"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:49.346924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:49.647156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19ecf51b-fce8-49d7-a977-453d3a0f763e tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.370127 Oct 04 18:19:49.651201 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2712/5283] 10.222.0.42 () {60 vars in 1173 bytes} [Tue Oct 4 18:19:49 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.719691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d3e1a7b-d0a2-45d8-9d57-1cde7138c088 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:49.890547 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d3e1a7b-d0a2-45d8-9d57-1cde7138c088 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.218345 Oct 04 18:19:49.908346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2713/5284] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 18:19:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.919087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d005b4b4-e1f6-4135-9a03-13635f3b64d1 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:49.945109 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d005b4b4-e1f6-4135-9a03-13635f3b64d1 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.034645 Oct 04 18:19:49.966665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2714/5285] 10.222.0.42 () {58 vars in 1152 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:49.992428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad66fad8-84e8-4252-b066-cb5d366e77e4 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-831194-21"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:50.027686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fad8-84e8-4252-b066-cb5d366e77e4 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.028663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fad8-84e8-4252-b066-cb5d366e77e4 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.030005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fad8-84e8-4252-b066-cb5d366e77e4 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.795409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad66fad8-84e8-4252-b066-cb5d366e77e4 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 339 microversion: 2.1 time: 0.824909 Oct 04 18:19:50.796321 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2715/5286] 10.222.0.42 () {60 vars in 1194 bytes} [Tue Oct 4 18:19:49 2022] POST /compute/v2.1/os-aggregates/19/action => generated 339 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:50.820627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:50.821438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:50.839524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.840857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.841939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:50.844256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:50.847226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:50.848185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.266048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.285291 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b2497ee-117d-4851-ad2a-1b41d9b0d45d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.479053 Oct 04 18:19:51.309322 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2716/5287] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:50 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:51.329275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4e1c60-a85a-4f47-a357-c2b2f7aaa694", "name": "network-vif-plugged", "status": "completed", "tag": "af8486bf-8779-479d-ac2d-80a70128925b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:51.352332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:51.353219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:51.353920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:51.370813 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] Creating event network-vif-plugged:af8486bf-8779-479d-ac2d-80a70128925b for instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 on n-h2-831194-21 Oct 04 18:19:51.380581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b6e3d3e1-815d-4cdd-a2dc-5df0dbdb3d71 req-13ced2ac-d201-4a11-978f-b86f58c4cbd0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059224 Oct 04 18:19:51.382433 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2717/5288] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:51.411703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37a533b4-c4e8-4861-a314-ed59ec810941 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:51.475008 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37a533b4-c4e8-4861-a314-ed59ec810941 tempest-TestAggregatesBasicOps-1230804548 tempest-TestAggregatesBasicOps-1230804548-project-admin] 10.222.0.42 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.089760 Oct 04 18:19:51.477230 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2718/5289] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 18:19:51 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 04 18:19:51.880057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:51.898096 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-802134a2-0295-47bb-8ef5-9131cab8a2e8 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1513 microversion: 2.1 time: 2.716116 Oct 04 18:19:51.911151 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2572/5290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:49 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1513 bytes in 2746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:52.350459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.351967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.394954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.398721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.399179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.403337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.403848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:52.412941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:52.953379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:52.958399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:52.982815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:52.992527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:52.999851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.000559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.001506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.002025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.002471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.011346 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfe1afcb-d236-49d0-9d39-71fe4564030e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1373 microversion: 2.1 time: 0.679053 Oct 04 18:19:53.012100 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2719/5291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1373 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:53.392792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-34584001", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:53.567015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:53.572924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:53.581874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:53.584680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:53.589595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:53.638279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.639444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.640287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.645705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:53.647073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:53.649144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:53.715549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Getting quotas for project 4e3566ac08bb4a6b9f1a8792adcb8ee7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:53.734444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Getting quotas for user 2b5e19d27a294db581600d6f9783a82a and project 4e3566ac08bb4a6b9f1a8792adcb8ee7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:53.800175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:53.806417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:53.914953 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c019936-4faf-473b-b1c4-6926e4f54f9e tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.896724 Oct 04 18:19:53.916315 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2720/5292] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:19:53.958619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:53.960307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.263107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.280672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.283606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.293696 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e4e84c0-2435-49f6-9c98-27e9e0e1212c tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1279 microversion: 2.47 time: 0.366936 Oct 04 18:19:54.301053 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2721/5293] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:53 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1279 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:19:54.321852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:54.329781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:54.375509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.376401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.377322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.381102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:54.389271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:54.391006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:54.775361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:54.805681 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-009d19ad-f488-455e-907a-8e6b56be2db5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 1.863961 Oct 04 18:19:54.807251 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2573/5294] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:52 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 1868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:55.163478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:55.187952 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10e4092e-00d7-478d-80da-eb841d3a74c1 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1546 microversion: 2.1 time: 0.882427 Oct 04 18:19:55.190213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2722/5295] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:54 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1546 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:55.220802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:55.224900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:55.264342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:55.271239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.274926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2091489233", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:55.275700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.276180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.276934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:55.279731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:55.282557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:55.424574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] validate_networks() for [('41c8c0c1-dfdc-4e04-a4db-a738a2848134', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:19:55.987778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.001959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f44598c9-d4f3-4c60-ae80-d806219a0241 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1546 microversion: 2.1 time: 0.787627 Oct 04 18:19:56.008813 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2723/5296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:55 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1546 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:19:56.025026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.031649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:56.052558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.058757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.064196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.065478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.067365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.067984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.318395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.334123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.345474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:56.352477 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-394779dc-cfca-4cd6-a10f-78a5892dd937 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1275 microversion: 2.47 time: 0.342170 Oct 04 18:19:56.355416 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2724/5297] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:56.372037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:56.372898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:56.397034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.397507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.397980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:56.398707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:56.399164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:56.399592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.062000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:57.090489 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0e3dcfe-0911-4301-a3fa-5db9569c067c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.733168 Oct 04 18:19:57.094253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2725/5298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:56 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:57.399946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:57.400673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:57.426618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.427136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.433602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.435877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.436499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.436960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.691473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:19:57.692363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:19:57.693111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:19:57.693743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:19:57.694708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:19:57.747284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.747835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.758551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.767111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:57.770682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:57.774051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:57.930019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Getting quotas for project d91b800263eb4b17aa644ab19fd2f1f2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:19:57.934152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:19:57.935542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Getting quotas for user f3fcc65b9bca48ba83da599eadf6d99b and project d91b800263eb4b17aa644ab19fd2f1f2. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:19:57.975255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:19:57.978369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:19:58.109572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eceb9277-12d9-44e8-8955-37b6de24aae3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.049265 Oct 04 18:19:58.123372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2574/5299] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:19:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:19:58.130798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7691da25-54ec-4918-bd9b-bbdb2d6ddb25 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.132273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7691da25-54ec-4918-bd9b-bbdb2d6ddb25 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.296494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.315095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.319529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:58.324341 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31499f5c-8ab3-4f94-8ffe-e36b87b373e4 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1331 microversion: 2.47 time: 0.928885 Oct 04 18:19:58.337863 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2726/5300] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:57 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1331 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:19:58.380373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:58.391720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:58.424683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.426355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.434584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:58.441400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:58.442227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:58.443358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.107505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:19:59.152626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7bb41eb2-4c88-46d8-b62a-2488d684bd18 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.820526 Oct 04 18:19:59.153935 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2727/5301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:19:59.199905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67463c20-313a-4646-9754-3aab7f8824c8", "name": "network-vif-plugged", "status": "completed", "tag": "dc0f9f75-074e-4472-81ee-db9fc98eb4a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:19:59.328901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.340434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.341494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.456950 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] Creating event network-vif-plugged:dc0f9f75-074e-4472-81ee-db9fc98eb4a9 for instance 67463c20-313a-4646-9754-3aab7f8824c8 on n-h1-831194-21 Oct 04 18:19:59.491828 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3c351f63-f223-4bc4-8a0b-68d24962c3bd req-59c51e0f-67f5-4a49-ba91-2e28718188e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334458 Oct 04 18:19:59.510904 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2728/5302] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:19:59.556528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:19:59.562692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:19:59.619705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.620365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.622945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:19:59.624654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:19:59.628299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:19:59.632351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.022560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7691da25-54ec-4918-bd9b-bbdb2d6ddb25 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.032105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7691da25-54ec-4918-bd9b-bbdb2d6ddb25 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1214 microversion: 2.1 time: 1.907196 Oct 04 18:20:00.039779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2575/5303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:19:58 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1214 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:00.183459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:00.190840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:00.199604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.200361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.200975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.202903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:00.203542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:00.204154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:00.920483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:00.932885 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67cf5b78-b04f-42e6-9c38-592a74894eae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.758321 Oct 04 18:20:00.933484 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2576/5304] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:00 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:01.040089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:01.071617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.072907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.099616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.102069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.102747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:01.103775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.109324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:01.113689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:01.114244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:01.114989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:01.122064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5518dd5f-6bb7-43dd-a592-012d68448269 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1337 microversion: 2.47 time: 1.605207 Oct 04 18:20:01.159401 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2729/5305] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:19:59 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1337 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:01.961184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:01.962444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:01.974975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:01.997896 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-895aecda-c7c3-4554-8ad4-4d2ba7a1af8a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1266 microversion: 2.1 time: 0.932242 Oct 04 18:20:01.998849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2577/5306] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1266 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:02.047240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.050837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.051577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.059033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.062178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.064308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.123226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:02.161201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:02.161963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:02.175037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.182096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.182998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.187979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:02.190296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:02.190956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:02.632547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.651532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.676944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.681663 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8470874-2c6d-4872-a3fc-174596ae7b65 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1337 microversion: 2.47 time: 0.524321 Oct 04 18:20:02.702093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:02.706978 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2578/5307] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:02 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1337 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:02.727243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3a6e3ba0-5103-4c81-909f-2fe8e77ed904 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.772182 Oct 04 18:20:02.738780 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2730/5308] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:01 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:03.031505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.032549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.044767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.049293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.050502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.051511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.052199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.052848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.467160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:03.486409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0da26ac-d2ce-4692-a80c-e20a3f36453d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1272 microversion: 2.1 time: 0.454263 Oct 04 18:20:03.503666 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2579/5309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1272 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:03.716557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.718118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.754694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:03.755801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:03.758680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:03.786394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.789480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.791191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.793067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.795976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.796934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.805439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.806138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:03.806802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.809391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:03.813001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:03.814306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.243603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.267354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.268841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:04.278965 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7669634a-b3e9-438d-a0bc-d30bcbdd2d19 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1358 microversion: 2.47 time: 0.567381 Oct 04 18:20:04.279905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2731/5310] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1358 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:04.323947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-367404454"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:04.326564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:04.360770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:04.362931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.363662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.364286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.371245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.371991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.374434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.857725 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-042d013e-23f6-4eee-a7fe-8f336fa92488 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "POST /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05/action" status: 202 len: 52 microversion: 2.47 time: 0.547565 Oct 04 18:20:04.867259 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2732/5311] 10.222.0.42 () {62 vars in 1319 bytes} [Tue Oct 4 18:20:04 2022] POST /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05/action => generated 52 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 364 bytes (2 switches on core 0) Oct 04 18:20:04.882340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:04.888406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:04.907504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.908273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.909149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:04.910240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:04.910986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:04.914505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.326841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:05.342702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3b69f60-e5fc-46dd-9db6-52fb078f5545 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1272 microversion: 2.1 time: 0.472096 Oct 04 18:20:05.348933 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2733/5312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:04 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1272 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:05.363634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.377525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.402021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.406649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.407946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.408730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.409211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.409659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.489175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:05.765023 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53f60790-de82-4338-80fe-0aac989e47e5 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "DELETE /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 204 len: 0 microversion: 2.47 time: 0.414479 Oct 04 18:20:05.769774 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2734/5313] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:20:05 2022] DELETE /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:20:05.789607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:05.790741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:05.843503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.844312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.845063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:05.846074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:05.846724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:05.848351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.271090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.280669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.297476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.302623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-367b91e8-dd1a-4ead-bc9b-b74ea455a528 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1364 microversion: 2.47 time: 0.525680 Oct 04 18:20:06.308675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2735/5314] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:05 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1364 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:06.379506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:06.380995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:06.400600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.404968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.405993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.406921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:06.411424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:06.413606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:06.628617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:06.651042 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80bbda16-db0f-40e4-b8ce-24f97063379a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1272 microversion: 2.1 time: 0.276778 Oct 04 18:20:06.673877 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2736/5315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:06 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1272 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:07.340874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.342742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:07.366043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.370478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.372541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.374609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.377956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.380524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.657163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.669534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.711891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6230cbd7-cc84-4af4-b087-f494f2d3ded4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 3.961767 Oct 04 18:20:07.716698 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2580/5316] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:03 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 3967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:07.718873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.724006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:07.725334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4501bf0e-f7e4-493f-bd03-aa1de3e720ec tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1364 microversion: 2.47 time: 0.391896 Oct 04 18:20:07.765058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:07.766516 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2737/5317] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:07 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1364 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:20:07.769518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:07.781700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.785812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.787146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.788266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:07.790482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:07.791248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:07.860833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:08.737322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.738065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.756971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.758129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.758746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.761658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.762364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.763537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.841236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:08.867437 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a293fa61-fcbe-4808-98fa-bb0ef815880d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.148487 Oct 04 18:20:08.885879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2581/5318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:07 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:08.893281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:08.930340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:08.956499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.957303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.957973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:08.958928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:08.959673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:08.962152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.199692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.220378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48ae4f4e-86df-4e0f-b015-5bd57b7e79e0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.487249 Oct 04 18:20:09.236727 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2738/5319] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:09.355587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.378673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.379804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2b5e19d27a294db581600d6f9783a82a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e3566ac08bb4a6b9f1a8792adcb8ee7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:09.381708 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-25a5d229-f882-4271-baa6-45ec9ea0ec8a tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 200 len: 1364 microversion: 2.47 time: 0.506147 Oct 04 18:20:09.386219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2582/5320] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:08 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 1364 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:20:09.446664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d8f431ef-ff9c-403b-959f-a4c93e3e9523 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: .version_select at 0x7fbdbd1553a0>, body: {"keypair": {"name": "tempest-keypair-1176826323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDIY/o+LMO9l8BIt8QCK5vpTFgWSUGK0mDy4h/8s0zpbLFV/ep+Hcn8YZJR2OtAwtIWGkwW6w7M167LmcHxGpvWUd9XO236ZB00x+C0vlQDBPG+T9p/fNjgCLXVuZsE/w=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:09.473068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d8f431ef-ff9c-403b-959f-a4c93e3e9523 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for project 65290c2428b14d898e10a90d66918ca0. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:09.480768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d8f431ef-ff9c-403b-959f-a4c93e3e9523 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for user 7481f17bf5b142aaadc3e41dfbc68f9c and project 65290c2428b14d898e10a90d66918ca0. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:09.527887 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d8f431ef-ff9c-403b-959f-a4c93e3e9523 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202325 Oct 04 18:20:09.528793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2739/5321] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:20:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:09.913169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:09.914522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:09.945760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.946544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.947169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:09.948118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:09.971164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:09.971756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.059843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:10.251571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:10.252932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:10.273347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.274108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.274743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:10.275686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:10.276307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:10.276888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.544897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.569780 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-678a9073-cecc-46b3-bc6b-99690a0fbda6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 1.322937 Oct 04 18:20:11.580132 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2740/5322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:10 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:11.589436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:11.616750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] [instance: 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:11.643397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.644042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.644709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.645716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:11.646260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:11.649761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:11.673605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:11.700563 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] HTTP exception thrown: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Request method failure captured: Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 HTTP/1.1 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHlIwLsET2m7UNyiTwlDXkC2t2-ALt_-0L3_1D3CrdUN0eww49ULDNNGnbSDaHj1Dtc2jl9LO2JpTQBnevhreMRAESFoGU6GQ6hMlcnRfusLL1E_7Y1blsg3BVJD2ULuuVgQ6YYmAbteJ93-nUI_Rhj8aIOG0fS8dDj0RJ24jpSXVvU Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Openstack-Nova-Api-Version: 2.47 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 4e3566ac08bb4a6b9f1a8792adcb8ee7 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAaction247Test-909423460 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/4e3566ac08bb4a6b9f1a8792adcb8ee7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e3566ac08bb4a6b9f1a8792adcb8ee7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/4e3566ac08bb4a6b9f1a8792adcb8ee7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_4e3566ac08bb4a6b9f1a8792adcb8ee7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAaction247Test-909423460 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 4e3566ac08bb4a6b9f1a8792adcb8ee7 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAaction247Test-909423460 Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAaction247Test-909423460-project Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2b5e19d27a294db581600d6f9783a82a Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAaction247Test-909423460-project Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05'} Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:11.703861 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] Returning 404 to user: Instance 15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:11.708190 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-098ff2ba-9cea-4ee6-927d-14f93896b962 tempest-ServersAaction247Test-909423460 tempest-ServersAaction247Test-909423460-project] 10.222.0.42 "GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05" status: 404 len: 111 microversion: 2.47 time: 0.124506 Oct 04 18:20:11.712029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ae41747-148e-4624-8ef6-6e2064e2c8da tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.815528 Oct 04 18:20:11.718901 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2741/5323] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:20:11 2022] GET /compute/v2.1/servers/15e51e2b-8b18-4dc6-ac46-d4afdf0dfb05 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:20:11.730058 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2583/5324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:09 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:12.600116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.601387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.615895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.621003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.622362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.624949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.626396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.631471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.736427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:12.737654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:12.750870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.757273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.758143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:12.759130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:12.759761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:12.760414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:13.012663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.023683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc6788e5-64f4-475e-967f-1170f483d292 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.428015 Oct 04 18:20:13.038597 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2742/5325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:13.859225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:13.869682 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a95931bf-e1b1-4304-b1ea-815b8be3c8f4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.138141 Oct 04 18:20:13.878831 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2584/5326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:12 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:14.056062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.056932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.111336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.112802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.114486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.123279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.133798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.135230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.755527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3195776e-6650-4052-a373-1b907e21cfe5", "tag": "bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:14.778055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.778750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:14.779281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.780338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.788210 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8d256b1-ba8e-40f0-9ab0-f08992eff426 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.740875 Oct 04 18:20:14.788824 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2743/5327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:14.816786 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] Creating event network-changed:bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175 for instance 3195776e-6650-4052-a373-1b907e21cfe5 on n-h1-831194-21 Oct 04 18:20:14.849333 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-218b42de-cf0d-4dc9-b6aa-88d1b8ebdd23 req-29ea0a6d-cab2-4925-bc48-f5fb0f3959db service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528564 Oct 04 18:20:14.852010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2585/5328] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:14.911275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:14.911942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:14.935330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.935848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.942712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:14.944044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:14.944765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:14.945232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.342341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:15.363318 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed28e8a9-fdc2-44fe-8f55-3a1ea61cff79 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.457226 Oct 04 18:20:15.382479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2744/5329] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:14 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:15.836166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:15.836901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:15.856597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.857129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.857591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:15.866175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:15.869416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:15.873313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.397433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:16.399211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:16.421530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.422347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.428757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.430318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:16.431137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:16.431743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:16.559749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.570572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca573190-5292-40ba-9317-b8f37c7d5c7d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.739607 Oct 04 18:20:16.587128 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2586/5330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:15 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:16.846573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:16.849043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:16.858385 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c511449-f640-423c-a17e-232d3734f53e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.464899 Oct 04 18:20:16.858995 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2745/5331] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:16 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:17.612508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.614448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.640681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.641567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.647113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.648480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.649358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.659708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.898442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:17.900294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:17.944584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.945296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.945906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:17.947324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:17.954307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:17.954753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:18.224519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.263975 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8e3e48c-467c-493b-8cb3-9428037ca9f5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.659994 Oct 04 18:20:18.266921 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2587/5332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:18.916387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:18.943357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31e09d0e-ee09-427d-a273-1ddee95a9eb0 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.052177 Oct 04 18:20:18.947171 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2746/5333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:17 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:19.225207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1053894547", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2144fd7-90fb-44c4-9f83-e87b9ee8cf4d"}], "security_groups": [{"name": "tempest-securitygroup--160421283"}], "key_name": "tempest-keypair-1176826323", "user_data": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:19.299049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:19.299721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:19.316956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.317534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.318043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.318840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:19.319306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:19.319742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:19.502911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:19.827287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] validate_networks() for [('b2144fd7-90fb-44c4-9f83-e87b9ee8cf4d', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:19.994840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.010103 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9414020-2437-4e7a-9153-ffe9e18ad1e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.716997 Oct 04 18:20:20.012768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2747/5334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:19 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:20.049505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:20.050175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:20.066952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.069691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.072488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.073346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:20.073730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:20.074185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:20.601969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:20.660704 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68e8f427-be41-412d-996a-a5082bae1f0d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.636852 Oct 04 18:20:20.688431 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2748/5335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:20 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.047221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.050618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.090685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.096350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.101697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.103780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.108574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.112895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.526551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:21.538991 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b81d16c-9547-4928-ae74-f0e7d9aac412 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.499761 Oct 04 18:20:21.540841 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2749/5336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:21.696109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:21.696999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:21.713268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.717522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.718210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:21.719130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:21.719742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:21.720336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.181773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:22.231003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4a16d26d-1860-48c4-b0aa-09e9f698e5f9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.537811 Oct 04 18:20:22.237695 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2750/5337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:21 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:22.507137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:22.508757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:22.509960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:22.510938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:22.511880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:22.570687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.571514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.572231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.573473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.574263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.575063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.578095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:22.598150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:22.643396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.647477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.648484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.655584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:22.656789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:22.658401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:22.665677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=80 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:22.739042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for project 65290c2428b14d898e10a90d66918ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:22.789569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for user 7481f17bf5b142aaadc3e41dfbc68f9c and project 65290c2428b14d898e10a90d66918ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:22.871405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:22.885161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:22.992683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1901919-89dd-487d-b78d-1556f6423c08 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.775167 Oct 04 18:20:22.996809 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2588/5338] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 3780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:23.011671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-278e9406-2b76-493e-905d-57b5f1c97edf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.014170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-278e9406-2b76-493e-905d-57b5f1c97edf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.325283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-278e9406-2b76-493e-905d-57b5f1c97edf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.362403 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-278e9406-2b76-493e-905d-57b5f1c97edf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1238 microversion: 2.1 time: 0.352173 Oct 04 18:20:23.379557 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2589/5339] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1238 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:23.421006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:23.426739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:23.458979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.462717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.464012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.468550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:23.471645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:23.476049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:23.942044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:23.962532 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4ddd8db2-ea29-4ec1-a2f8-87ff1d0d489a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 1.392187 Oct 04 18:20:23.964018 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2751/5340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:22 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:24.416647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-645db9d5-69d1-4a65-8210-02ef3098bae2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:24.419902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-645db9d5-69d1-4a65-8210-02ef3098bae2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:24.714775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-645db9d5-69d1-4a65-8210-02ef3098bae2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.760984 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-645db9d5-69d1-4a65-8210-02ef3098bae2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1238 microversion: 2.1 time: 0.352752 Oct 04 18:20:24.779657 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2752/5341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1238 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:24.902257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:24.929966 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71976f75-ea77-48a1-b028-3deacc3a1325 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.548342 Oct 04 18:20:24.931144 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2590/5342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:23 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:25.008682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.012742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.035804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.037742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.041260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.046124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.050080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.050752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.841973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:25.844485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:25.881380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.882493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.884209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:25.885385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:25.891336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:25.892777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.070085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.083729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-299af025-5fbd-40f4-bac1-1d281cf3d75a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 1.085642 Oct 04 18:20:26.111047 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2753/5343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:24 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:26.125513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:26.126429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:26.128832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:26.138331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.139200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.141337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.142512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:26.143201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:26.144082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:26.264520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:26.287639 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-135fb14e-937e-4224-bcba-fc18bd1a9b6b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1290 microversion: 2.1 time: 0.475224 Oct 04 18:20:26.302792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2591/5344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:25 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1290 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.131937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.132829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.167832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.168674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.168996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.169453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.170231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.181585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.182135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.202004 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a2495284-3b95-41a8-98fe-81b3edfd3f7c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 1.081090 Oct 04 18:20:27.203279 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2754/5345] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:26 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:27.329543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:27.330271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:27.355936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.360435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.361432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.381759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:27.381759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:27.381759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:27.701386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.715414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9fefb42d-d8a9-48cf-92ef-b2314bce7418 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1509 microversion: 2.1 time: 0.591412 Oct 04 18:20:27.721628 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2592/5346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1509 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:27.856672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:27.877352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f376022-499a-4259-bab6-d201b7792fc6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1296 microversion: 2.1 time: 0.552382 Oct 04 18:20:27.890570 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2755/5347] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:27 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1296 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.230642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.231487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.234559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:28.254560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.260152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.260955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.262184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.262854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.263492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.835683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195776e-6650-4052-a373-1b907e21cfe5", "name": "network-vif-plugged", "status": "completed", "tag": "bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:28.873488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.881599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.882204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:28.883380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.894600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3db17bb-0c7f-4122-a19a-f7e3835b6214 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.667710 Oct 04 18:20:28.899273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2593/5348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:28.915990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.919190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.925013 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] Creating event network-vif-plugged:bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175 for instance 3195776e-6650-4052-a373-1b907e21cfe5 on n-h1-831194-21 Oct 04 18:20:28.931967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.932795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.933496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.937770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.939382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-eb328b81-53f8-401a-8f47-92fe17166150 req-3b8f89fd-4711-418d-9a5c-4c027935d81a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.426461 Oct 04 18:20:28.940241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.940683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2756/5349] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:28.942277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.946845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:28.959010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:28.965776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.966515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.967120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:28.969892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:28.970545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:28.973263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.241052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.260669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97a36355-c34b-48ee-84cb-9c13f6e5cfe4 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1296 microversion: 2.1 time: 0.316357 Oct 04 18:20:29.275580 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2757/5350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1296 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:29.929381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:29.930858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:29.955098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.959235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.960701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.964787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:29.966896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:29.967519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:29.980851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:29.995308 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-62b7ff9c-171d-4ed0-ab25-0c8756b6013c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1506 microversion: 2.1 time: 1.093617 Oct 04 18:20:29.999051 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2594/5351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:28 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.013929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.019362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.040558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.044771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.048953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.052167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.052688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.054983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.126194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:30.277793 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-901156ac-7a49-448f-b14b-2ac771a13df7 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 204 len: 0 microversion: 2.1 time: 0.277290 Oct 04 18:20:30.279053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2595/5352] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:29 2022] DELETE /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:30.288333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.291579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.308162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.308934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.309538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.310500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.311127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.311800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.623750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.637371 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2ddb25fb-57f9-4cca-8e5b-fa6d5a52c11f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1552 microversion: 2.1 time: 0.353668 Oct 04 18:20:30.638747 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2596/5353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1552 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:30.655349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:30.656483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:30.667277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.670079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.671537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.674780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:30.675565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:30.676412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:30.808611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.816958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-55f9769f-dd48-4741-93c3-1f9dd46c4c36 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1296 microversion: 2.1 time: 0.176808 Oct 04 18:20:30.819896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2597/5354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:30 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1296 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:30.861582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:30.877926 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57eda155-102b-40e2-b8ce-99960ceb03b3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1314 microversion: 2.1 time: 0.953781 Oct 04 18:20:30.878987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2758/5355] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:29 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:31.037046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.037959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.054127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.054244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.054629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.055388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.055832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.056253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.588322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:31.597037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3481b08-4872-43f1-8cdd-02a6f960ec80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1506 microversion: 2.1 time: 0.564224 Oct 04 18:20:31.617881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2598/5356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1506 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:31.685368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.692219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.718908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.719551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.728484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.733476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.735464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.736159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.844015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:31.844670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:31.856612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.857443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.858114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:31.859078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:31.865860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:31.866848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.182092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.193710 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-334668ec-55fb-4104-99bf-82ba7aca74ec tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.353686 Oct 04 18:20:32.199849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2599/5357] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.204851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.215728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.250056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.250821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.251500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.252443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.253116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.253779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.499498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.518506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f098adf6-c179-4c65-b92b-99d6524d9893 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1500 microversion: 2.1 time: 0.317336 Oct 04 18:20:32.520274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2600/5358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.544446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:32.547289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.555421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.556295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.556957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.557969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.558645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.559297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.584567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lazy-loading 'flavor' on Instance uuid 3195776e-6650-4052-a373-1b907e21cfe5 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:32.668857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:32.681056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49e78f0c-a2dc-4dff-92f1-3850a608aeff tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "POST /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5/action" status: 200 len: 32 microversion: 2.1 time: 0.141103 Oct 04 18:20:32.682003 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2601/5359] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:32 2022] POST /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5/action => generated 32 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:20:32.687952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.688863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.695781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.696518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.697202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.698371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.698987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.699572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.914437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:32.921862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:32.925713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c245897-976f-4357-801c-93470cd0adb6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1506 microversion: 2.1 time: 0.242341 Oct 04 18:20:32.926345 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2602/5360] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:32.940583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:32.945631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:32.980067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.981053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.981732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:32.982730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:32.989463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:32.991424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.335096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.337364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:33.347035 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26ecc059-138d-4cb1-b934-f40985e4b916 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.418299 Oct 04 18:20:33.367757 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2603/5361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:32 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.375790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.375790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.385582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.385999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.386460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.387193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.387782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.388087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.500706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.515782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49205cb1-da6d-4e9e-b943-08caed382f92 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1552 microversion: 2.1 time: 1.834779 Oct 04 18:20:33.517025 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2759/5362] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:31 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1552 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.685618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67463c20-313a-4646-9754-3aab7f8824c8", "name": "network-vif-unplugged", "status": "completed", "tag": "dc0f9f75-074e-4472-81ee-db9fc98eb4a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:33.708821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.709616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.711426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.751636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:33.766913 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] Creating event network-vif-unplugged:dc0f9f75-074e-4472-81ee-db9fc98eb4a9 for instance 67463c20-313a-4646-9754-3aab7f8824c8 on n-h1-831194-21 Oct 04 18:20:33.778301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b6f73860-6584-4467-a528-4aac3de7e646 req-cc833b29-b67e-4163-8c19-74e3efbff2ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105856 Oct 04 18:20:33.779187 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2760/5363] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:20:33.783784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db6f634a-7c5e-48e3-9ae2-3ff5818cc3aa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.414633 Oct 04 18:20:33.784825 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2604/5364] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:33.953683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:33.955972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:33.976525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.981815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.982535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:33.983703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:33.984597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:33.985186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.372648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.373804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.392105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.392980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.393588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.394996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.400188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.401141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.753101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:34.848510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:34.868337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-11a2a8e5-bf2c-41a5-9aef-0abf26e0fe23 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.501469 Oct 04 18:20:34.868979 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2605/5365] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:34.890108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:34.899535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:34.917414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.919298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.919962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:34.922945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:34.923652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:34.924291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.245812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.260846 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91b76a24-4394-44e5-9076-1eaf3dd8bd6d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1552 microversion: 2.1 time: 0.387927 Oct 04 18:20:35.261863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2606/5366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:34 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1552 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.289469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.292207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.310118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.313031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.313902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.315699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.318131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.319394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.534898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.552425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eeeba709-f056-440f-b940-1f7f34e2e7e4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1506 microversion: 2.1 time: 1.603037 Oct 04 18:20:35.564870 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2761/5367] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:33 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1506 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.624522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:35.635566 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d860d2bf-9e05-4b9d-ace2-948a1abae72d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.370448 Oct 04 18:20:35.650086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2607/5368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:35.831268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df4e1c60-a85a-4f47-a357-c2b2f7aaa694", "name": "network-vif-deleted", "tag": "af8486bf-8779-479d-ac2d-80a70128925b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:35.850201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.850988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.852511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.872075 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] Creating event network-vif-deleted:af8486bf-8779-479d-ac2d-80a70128925b for instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 on n-h2-831194-21 Oct 04 18:20:35.880992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-42ec9558-0ea0-4df2-b731-d5a7e7ace018 req-2a3fddb6-b64f-4ff1-a76f-d2b19112ba67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055690 Oct 04 18:20:35.893499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:35.895240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:35.906737 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2762/5369] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:35.918322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.920849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.921777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:35.925874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:35.927653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:35.928763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.293310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.296744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.311709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.313178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.313812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.314824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.315986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.326232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.449579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.450890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.451590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.452275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lazy-loading 'fault' on Instance uuid df4e1c60-a85a-4f47-a357-c2b2f7aaa694 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:36.515937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.528424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9580485c-213d-49a6-a24c-0268e5edd41a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.640870 Oct 04 18:20:36.528914 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2608/5370] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:35 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:36.592073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.592695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.602062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.602892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.603518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.604493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.608223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.608863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.761026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:36.776067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19ea6d37-da4a-4530-a22f-2e61c7ff799b tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 200 len: 1337 microversion: 2.1 time: 0.483176 Oct 04 18:20:36.776778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2763/5371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 1337 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:36.796695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:36.797264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:36.838642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.839294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.839987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:36.860909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:36.861427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:36.861901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.140291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.157673 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-764bfcb6-6212-4069-b07c-06814674b3df tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 200 len: 1449 microversion: 2.1 time: 0.569471 Oct 04 18:20:37.161487 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2609/5372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 1449 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:37.184028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.185333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.217575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.218425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.219050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.220622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.221255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.221964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.373583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.385812 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-947d536a-91fd-46fc-ac85-7e099d4774ed tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.605413 Oct 04 18:20:37.387991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2764/5373] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:36 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.556583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.557703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.570570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.571084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.571543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.572283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.572754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.573209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.586242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:37.874960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.887508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:37.888562 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-006c3272-328b-4aa5-a6a9-49886dd30a0c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.336517 Oct 04 18:20:37.889163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2765/5374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:37.902924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:37.904770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: df4e1c60-a85a-4f47-a357-c2b2f7aaa694] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:37.915339 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b504b7fc-76a3-499e-a119-dd44b2ec17ad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.736947 Oct 04 18:20:37.915876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.916543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.929881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2610/5375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:37.929881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b417a2-ec16-492d-994c-eadb96bb831f", "tag": "0cbe3de5-e8e2-4b30-87aa-16cae8fda639"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:37.931088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.932029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.932674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.944151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.944391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:37.944391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:37.944391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:37.970814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] Creating event network-changed:0cbe3de5-e8e2-4b30-87aa-16cae8fda639 for instance 52b417a2-ec16-492d-994c-eadb96bb831f on n-h2-831194-21 Oct 04 18:20:37.980195 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-988d7f49-cc1e-40b5-a512-576095f04105 req-a1e9e659-a52a-4cbb-9fcf-e487f2bd7262 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061534 Oct 04 18:20:37.983193 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2611/5376] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:37.991348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] HTTP exception thrown: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Request method failure captured: Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 HTTP/1.1 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHisnrFV9hihsYjyUxRTD-LNtRbBwaIU9OblrrMt8acDEcJ4zjRUNbKI4WfUs7XXWZDapDm935pq7KOmPbL0Nh0WH-Ibdn1VzALnlMgsccNGiX78gCDnlKd6n2HpntBYKDdPWXQXNqf6kdu6zyfUBA_WOvpXrM2qCUAEuawy_iBd1xA Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d57cbee648654e9bba91675d9620347f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d57cbee648654e9bba91675d9620347f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ef59ce7cca054a4ab3d753723fc00505 Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'df4e1c60-a85a-4f47-a357-c2b2f7aaa694'} Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:37.994234 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. Oct 04 18:20:38.000604 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:20:38.006752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.008330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Returning 404 to user: Instance df4e1c60-a85a-4f47-a357-c2b2f7aaa694 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:38.009434 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3204590a-9edd-4c0b-8f14-7b7af9a2eb5f tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694" status: 404 len: 111 microversion: 2.1 time: 0.114174 Oct 04 18:20:38.014018 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2766/5377] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/df4e1c60-a85a-4f47-a357-c2b2f7aaa694 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:38.016058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.024563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.025364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.026018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.026977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.027597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.028236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.418031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.418685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.432893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.433406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.433878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.434611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.435081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.435527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.510860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.527166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-208fa787-b155-4cf4-9f0b-c3c9b0149e26 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.542324 Oct 04 18:20:38.533031 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2612/5378] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:37 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.566417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:38.568918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:38.587056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.588254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.593688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.598802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:38.599906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:38.600845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:38.920502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:38.940265 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0164f69-5d67-41b1-8480-fffd843130c9 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.394368 Oct 04 18:20:38.942547 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2613/5379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:38.952301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf194fdc-0145-417a-9477-d4172b3cb5b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '.version_select at 0x7fbdbd7dea60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.007629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf194fdc-0145-417a-9477-d4172b3cb5b8 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-105059886" status: 202 len: 0 microversion: 2.1 time: 0.061914 Oct 04 18:20:39.009300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2614/5380] 10.222.0.42 () {58 vars in 1254 bytes} [Tue Oct 4 18:20:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-105059886 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:39.022593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.023614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.037009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.038327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.039110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.040143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.040840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.045306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.195660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.212359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-476cf86a-5005-4135-8497-456a253b9940 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.801475 Oct 04 18:20:39.215727 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2767/5381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:38 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.223909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.228067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.243473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.244542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.245591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.246637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.247559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.248751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.612570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:39.621243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b2124db-c22e-4097-ac53-41356fd7107a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.404855 Oct 04 18:20:39.626468 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2768/5382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:39.653234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:39.678858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.679410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.686581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.769553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:20:39.889382 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4917c0ae-03b2-40f0-939e-d8c9eb7fb7b3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.241716 Oct 04 18:20:39.893688 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2769/5383] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:39 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:39.902299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:39.903270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:39.923525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.939798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.941124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:39.943152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:39.945018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:39.946266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.328695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.337786 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f69bcfb-56f7-40ff-9e5d-d8f43709b791 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 1.327049 Oct 04 18:20:40.338416 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2615/5384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:40.377198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.403885 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dce23187-e5ed-435a-a068-ba52c5e4158b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.508648 Oct 04 18:20:40.405236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2770/5385] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:39 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:40.411787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:40.412623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:40.419446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.420135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.420751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.421631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:40.422273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:40.422883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:40.462235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1254362607", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "13b22cb5-00ec-4df6-8721-2b5792a9bb98"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:40.555968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] validate_networks() for [('13b22cb5-00ec-4df6-8721-2b5792a9bb98', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:20:40.753323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:40.766011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8eaa8da-1780-4913-859f-179aa2da5e59 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.359524 Oct 04 18:20:40.781870 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2771/5386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:40 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.369459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.370778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.385422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.387203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.405901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.406995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.407649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.408403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.891672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:41.906179 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bcda9398-6071-473c-b376-f1b6b94b5345 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.543073 Oct 04 18:20:41.920884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2772/5387] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:41.928508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:41.929432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:41.948509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.950110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.950110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.950575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:41.951139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:41.952088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:41.977339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:20:41.977938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:20:41.978501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:20:41.978854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:20:41.979262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:20:42.006533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.007457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.008425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.010219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.010854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.011688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.045896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Getting quotas for project fe36c24e8aee4653bf2fe2150a23ad9d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:20:42.061867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Getting quotas for user 1d4f57d5514640f7b93eb16995bb09b6 and project fe36c24e8aee4653bf2fe2150a23ad9d. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:20:42.082413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:20:42.087384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:20:42.198744 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1569f8d-328e-404b-bba4-6b7d3a418ea3 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.846430 Oct 04 18:20:42.199869 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2616/5388] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:20:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:20:42.216611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.217725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.227379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.228228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.229130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.231962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.233467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.234648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.485126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.496183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f103436-63df-40b0-944d-516e3fe6ccbe tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.573807 Oct 04 18:20:42.503036 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2773/5389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:41 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.536221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d9b9602-aaaa-4376-aa40-8b140adb331d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.537587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6d9b9602-aaaa-4376-aa40-8b140adb331d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.704704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.730037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-566aae3f-e651-4124-85ed-9828b4ed0ea3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.516046 Oct 04 18:20:42.737296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2617/5390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.850253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6d9b9602-aaaa-4376-aa40-8b140adb331d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:42.859099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d9b9602-aaaa-4376-aa40-8b140adb331d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1216 microversion: 2.1 time: 0.343747 Oct 04 18:20:42.861639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2774/5391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1216 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:42.940132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:42.940751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:42.952648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.953167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.953632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:42.962980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:42.974116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:42.975218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.395058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:43.413863 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4b016c9-94cd-4d89-bc0e-ebacca06580f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.478208 Oct 04 18:20:43.415793 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2618/5392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:42 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:43.543131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.543131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.567575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.568656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.570042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.571768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.575307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.576240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.766948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:43.767799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:43.782947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.784968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.785932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:43.788908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:43.790232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:43.791069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.182796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.191450 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f39ae154-1f83-48ba-a96a-1f08921ff056 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.656007 Oct 04 18:20:44.192642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2775/5393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.233785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.234804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.259604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.267453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.267453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.267453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.267453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.267980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.268166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.284702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f54be38b-05d1-4bf2-a57e-378632e576a3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.521847 Oct 04 18:20:44.297906 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2619/5394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:43 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.461823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:44.463548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:44.475547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.476282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.476948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.478187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:44.478875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:44.480654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:44.486923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.534049 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9fd0eb3-af57-4fc7-861c-2d7e34bc9f4f tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1268 microversion: 2.1 time: 0.313969 Oct 04 18:20:44.535664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2776/5395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1268 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:44.715057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:44.727843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0ceb1ec5-368b-4f49-a99a-532a47c8a52f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.273248 Oct 04 18:20:44.744213 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2620/5396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:44 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.225241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.226316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.249981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.251157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.254350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.258575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.262835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.264514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.328804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.331944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:45.383437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.389821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.405419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.416272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:45.422809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:45.424021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:45.897510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.915994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:45.920052 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-829d2129-0c2c-4f4a-9c11-9cb41c1dc3a2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 0.607140 Oct 04 18:20:45.921298 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2621/5397] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.933055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:45.950749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84865d17-3873-44da-ab34-04a1167daffb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.731142 Oct 04 18:20:45.953931 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2777/5398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:45.958788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b417a2-ec16-492d-994c-eadb96bb831f", "name": "network-vif-plugged", "status": "completed", "tag": "0cbe3de5-e8e2-4b30-87aa-16cae8fda639"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:45.970552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:45.971472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.008328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.008894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.010158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.013216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.014845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.015108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.019083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.020842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.026504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.054600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] Creating event network-vif-plugged:0cbe3de5-e8e2-4b30-87aa-16cae8fda639 for instance 52b417a2-ec16-492d-994c-eadb96bb831f on n-h2-831194-21 Oct 04 18:20:46.098657 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-532e9a65-e80d-4241-b718-9c7cfbbf90ec req-0f9dc24c-360e-4a2c-85e3-9234f96651a9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168965 Oct 04 18:20:46.109609 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2622/5399] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:46.123780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.124778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.150749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.157659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.167768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.168560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.169045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.169478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.320089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.332669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e4c4b7c-45f6-4a3a-af38-0b12bf2d6c1d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1274 microversion: 2.1 time: 0.376749 Oct 04 18:20:46.334096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2778/5400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:45 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.638132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:46.650133 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f72ed09-5dd9-4d48-9185-91e500c49a1f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.537635 Oct 04 18:20:46.652235 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2623/5401] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:46.947144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.947779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.979514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.980214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.980853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:46.981633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:46.982368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:46.984619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:46.986701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:46.987338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.001123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.001635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.002110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.002864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.003325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.003756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.380420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.397473 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-913779e1-72ab-4dca-b920-35e36e455447 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 0.417670 Oct 04 18:20:47.404532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2624/5402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:47.421522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.422452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.441245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.443391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.445217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.447630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.448954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.449558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.921015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.940327 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-681f40c6-a988-47ae-b81a-b5a4c5aae495 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.534259 Oct 04 18:20:47.963770 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2625/5403] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:47.977070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:47.977712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:47.986330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.987569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:47.988182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:47.989232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:47.989915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:47.990414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.000921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.004722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f793ae71-291f-4f9b-a991-c9ef973a9628 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1363 microversion: 2.1 time: 1.063822 Oct 04 18:20:48.015916 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2779/5404] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:46 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1363 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.032495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.033028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.052446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.053789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.059725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.061430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.062380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.063807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.165377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:20:48.324830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:48.345768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:48.365434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1ea10cf-b0d1-480d-a1d6-a016a3c67615 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.400318 Oct 04 18:20:48.368806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2626/5405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:47 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:48.377428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d9bc13b-8758-4f96-86a2-a9c61e635c3e", "tag": "b8ba2456-2ae3-4799-ae55-0a7b17b9f832"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:48.398083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2050e500-5814-4628-8b58-810d82e8b209 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 204 len: 0 microversion: 2.1 time: 0.372827 Oct 04 18:20:48.412683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.413063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.413956 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2780/5406] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:20:48 2022] DELETE /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:20:48.419572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.446198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:48.446798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] Creating event network-changed:b8ba2456-2ae3-4799-ae55-0a7b17b9f832 for instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e on n-h2-831194-21 Oct 04 18:20:48.459048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:48.462510 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-0b8e3c8c-f2fc-4037-a918-c297afc9a057 req-c26fe3fe-d18b-4d08-a630-532488dddde1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090910 Oct 04 18:20:48.463171 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2627/5407] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:48.494966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.502067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.506947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:48.519522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:48.521284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:48.522647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.186906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:49.212710 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fa778bf-64f6-480e-bdd8-57720c35d8ba tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1670 microversion: 2.1 time: 0.782920 Oct 04 18:20:49.215508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2781/5408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1670 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:49.229598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.238323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.265066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.265585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.266072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.272708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.273454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.274194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.363098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:49.364473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:49.383075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.383686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.384019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:49.387495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:49.389080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:49.390232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.162801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.182225 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8852c311-b543-4124-be24-8810be11e1ae tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1681 microversion: 2.1 time: 1.714812 Oct 04 18:20:50.183650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2628/5409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:48 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1681 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.212367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.213269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.221024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.221905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.223421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.224638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.225383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.226124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.486508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.508600 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75993b15-2f6a-4f8e-b3ad-42f2bc799972 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 1.289929 Oct 04 18:20:50.514940 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2782/5410] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:49 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.531651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.533570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.555376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.558249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.559093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.560013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.562139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.562801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.815678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:50.844667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-abe69d39-3091-49cd-81f2-c8595e31629b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1548 microversion: 2.1 time: 0.648401 Oct 04 18:20:50.848699 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2629/5411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1548 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:50.860640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:50.861706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:50.903982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.904513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.906758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:50.907694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:50.909650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:50.910943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.230928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.257774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f368ed54-e35b-4f09-a18a-43fa089c0010 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.732851 Oct 04 18:20:51.258694 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2783/5412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:51.276693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.277561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.292738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.306715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.307896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.309360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.310463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.311222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.580321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-50975cd6-67d9-43bc-959b-559eca6cf124 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.319769 Oct 04 18:20:51.582084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2784/5413] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-interface => generated 284 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:51.602146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.607064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.631744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.632689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.633524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.635006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.636087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.637106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.738155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:51.750852 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-18ddd65e-1950-40fc-aad1-1dece1038667 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1670 microversion: 2.1 time: 0.900582 Oct 04 18:20:51.752006 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2630/5414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:50 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1670 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:51.775677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22b5e46e-f146-4f87-b190-5b8f45024d28", "tag": "3f42b204-82e9-4a0f-b3ce-c4ea03342a45"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:51.821994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.823394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.838582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.868759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] Creating event network-changed:3f42b204-82e9-4a0f-b3ce-c4ea03342a45 for instance 22b5e46e-f146-4f87-b190-5b8f45024d28 on n-h2-831194-21 Oct 04 18:20:51.878337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b1662583-5718-4ec8-8da5-02491d433db6 req-9bf317ed-a5fe-47aa-81a8-4fb39e918fea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124027 Oct 04 18:20:51.880411 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2631/5415] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:51.899534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:51.902402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:51.927204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:51.930587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.934252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.935190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:51.936682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:51.942937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:51.943920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.047931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:52.074435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:52.456753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.469118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa317698-6dfd-4b4c-b58f-4503c3a41579 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1658 microversion: 2.1 time: 0.885448 Oct 04 18:20:52.479033 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2785/5416] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1658 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.484646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.485654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.512233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.513116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.513778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.514901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.516640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.519925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.584084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:52.613039 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ad5ad23-45dc-46df-82cd-90f8c3ff650e tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.730465 Oct 04 18:20:52.621383 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2632/5417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:51 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:52.642495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d9bc13b-8758-4f96-86a2-a9c61e635c3e", "name": "network-vif-deleted", "tag": "b8ba2456-2ae3-4799-ae55-0a7b17b9f832"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:52.665725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.666648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.670545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.700714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] Creating event network-vif-deleted:b8ba2456-2ae3-4799-ae55-0a7b17b9f832 for instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e on n-h2-831194-21 Oct 04 18:20:52.713664 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-26e7ab10-8ec0-41b3-9f05-c00322f481b7 req-33eaa281-adb6-4bbd-9494-59dbe2a164d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090900 Oct 04 18:20:52.717182 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2633/5418] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:52.729443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:52.747429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.747958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.748452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.821495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:20:52.858666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:52.968460 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27c15010-6155-42e7-b678-3636beabfcfa tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.249643 Oct 04 18:20:52.975068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2634/5419] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:20:52 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:52.981155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:52.982204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:52.991759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.993173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.994004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:52.996094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:52.996802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:52.997409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.058308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.059300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.065014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.066625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lazy-loading 'fault' on Instance uuid 2d9bc13b-8758-4f96-86a2-a9c61e635c3e {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:20:53.131804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:53.164446 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e485781-6c5d-4f96-8d2d-fbaa07979275 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 200 len: 1338 microversion: 2.1 time: 0.175749 Oct 04 18:20:53.164446 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2635/5420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 1338 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.164446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.170575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.184494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.188944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.190891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.193727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.195489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.196261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.522477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:53.540264 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-94fe626b-65ab-4509-889d-cf656704265b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 1.059546 Oct 04 18:20:53.546683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2786/5421] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:52 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:53.653661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:53.654719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:53.667109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.667683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.668147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:53.668889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:53.675205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:53.676558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.228149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.241034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5064c1ab-b13f-4d1d-b854-914401a873a4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1667 microversion: 2.1 time: 1.086464 Oct 04 18:20:54.247935 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2636/5422] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1667 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:54.264865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.267101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2d9bc13b-8758-4f96-86a2-a9c61e635c3e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.280928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.284844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.288406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.291944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.292884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.293470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.331760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] HTTP exception thrown: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Request method failure captured: Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e HTTP/1.1 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHisnrFV9hihsYjyUxRTD-LNtRbBwaIU9OblrrMt8acDEcJ4zjRUNbKI4WfUs7XXWZDapDm935pq7KOmPbL0Nh0WH-Ibdn1VzALnlMgsccNGiX78gCDnlKd6n2HpntBYKDdPWXQXNqf6kdu6zyfUBA_WOvpXrM2qCUAEuawy_iBd1xA Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d57cbee648654e9bba91675d9620347f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d57cbee648654e9bba91675d9620347f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ef59ce7cca054a4ab3d753723fc00505 Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2d9bc13b-8758-4f96-86a2-a9c61e635c3e'} Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:20:54.340382 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. Oct 04 18:20:54.344440 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:20:54.352526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Returning 404 to user: Instance 2d9bc13b-8758-4f96-86a2-a9c61e635c3e could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:20:54.354158 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c586518-8d06-4753-bf97-80e1d9db1f4a tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e" status: 404 len: 111 microversion: 2.1 time: 0.102613 Oct 04 18:20:54.355030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2637/5423] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/2d9bc13b-8758-4f96-86a2-a9c61e635c3e => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:20:54.575139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:54.576266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:54.595575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.596759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.599226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.600364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:54.601143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:54.601893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:54.755571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:54.776933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bba41b9d-c0ff-460a-9c13-ebe84ace250d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 1.128214 Oct 04 18:20:54.782504 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2787/5424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:53 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:55.078333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:55.088374 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c219e75-aedb-418e-b47a-f38257e99e88 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.521447 Oct 04 18:20:55.089142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2638/5425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:54 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:55.282240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.282810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.293516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.294064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.294470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.295181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.301665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.302235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.669883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7de67ff4-f36c-495a-958c-6a944198d9b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '.version_select at 0x7fbdbd002160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.729795 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7de67ff4-f36c-495a-958c-6a944198d9b5 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1551706584" status: 202 len: 0 microversion: 2.1 time: 0.063542 Oct 04 18:20:55.733708 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2639/5426] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 18:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1551706584 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:20:55.813229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:55.813861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:55.831292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.833100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.833712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.834628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:55.835276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:55.836599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:55.876665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:55.898298 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e75fa57e-b24c-40f4-b518-710a046ff6d5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1667 microversion: 2.1 time: 0.612396 Oct 04 18:20:55.899728 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2788/5427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1667 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:56.079276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52b417a2-ec16-492d-994c-eadb96bb831f", "tag": "0cbe3de5-e8e2-4b30-87aa-16cae8fda639"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:20:56.110169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.115432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.119466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.163514 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] Creating event network-changed:0cbe3de5-e8e2-4b30-87aa-16cae8fda639 for instance 52b417a2-ec16-492d-994c-eadb96bb831f on n-h2-831194-21 Oct 04 18:20:56.177169 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2384594b-c06b-49ff-b181-2a42dc14264a req-860d83de-371e-48a6-9501-6255a0f3c00f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102101 Oct 04 18:20:56.183358 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2789/5428] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:56.206664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.208315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.252281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.258370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.264489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.265902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.266761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.267649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.758941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:56.767839 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ef0a195-2da1-4105-a3ac-7be037bd0d7d tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.959638 Oct 04 18:20:56.770692 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2640/5429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:55 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:56.923787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:56.924689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:56.931836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.937507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.938253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:56.942920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:56.943617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:56.944405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.005786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:57.216252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:57.257202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4883d9b7-d0c1-4e31-94be-59bb15e9df85 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 1.070366 Oct 04 18:20:57.265068 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2790/5430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.797387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:57.815310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:57.818174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:57.843987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:20:57.864564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc00ea2b-b969-4093-b49c-70ead19d3218 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1667 microversion: 2.1 time: 0.939951 Oct 04 18:20:57.875416 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2641/5431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:56 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1667 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:57.891602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.892169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.892806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:57.896553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:57.907271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:57.910975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.289797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.295145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.316833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.317871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.318504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.320855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.321553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.326852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.456886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.478262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25467426-007f-4e71-a76d-5615f0db9ab0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.677880 Oct 04 18:20:58.483298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2791/5432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:57 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:58.904663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:58.911467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:58.911852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:58.923408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.926071 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-96857d91-e205-414f-9470-7bef85c52204 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.640427 Oct 04 18:20:58.927817 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2642/5433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:58.928562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.929047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:58.929817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:58.930470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:58.930921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.162419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.203602 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-310a82f9-fbb6-46bc-b3ce-7214149b4d29 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.297942 Oct 04 18:20:59.219496 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2792/5434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:58 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:59.246920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.248212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.257805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.259009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.259899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.260836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.262013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.262669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.508742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.515240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.531860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.532410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.534945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.538334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.547079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.547741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.612794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.637428 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30090370-7224-43f4-a6ce-e8f2e371efad tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.393923 Oct 04 18:20:59.638231 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2643/5435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:20:59.760787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.764611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.765243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.766064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.766888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.767342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.767779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.796102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:20:59.796543 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-062aa75c-a683-440c-82e2-9fc7c7978dba tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.156855 Oct 04 18:20:59.804674 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc235369-1734-487f-b2be-03d41feaa0a5 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.301304 Oct 04 18:20:59.805248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2793/5436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:20:59.808554 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2644/5437] 10.222.0.42 () {58 vars in 1185 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:20:59.821766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.822518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.828946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.829453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.834161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.835985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.836487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.837161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.967465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:20:59.968299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:20:59.995332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.996087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.996596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:20:59.997396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:20:59.998158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:20:59.998602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.248683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.269743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8406ee8-51da-4088-9fdc-c20f27aafcca tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.305187 Oct 04 18:21:00.270736 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2794/5438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:00.277607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1373844714", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "availability_zone": "nova:n-h1-831194-21", "networks": [{"uuid": "072626bb-9d43-4f6a-bb8d-fab5dec7c580"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:00.286214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.299014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1380140-449b-411a-bfdf-75e323f8ff1e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.489284 Oct 04 18:21:00.301899 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2645/5439] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:20:59 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:00.334361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.335202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.349748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.351710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.357006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.358069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.358751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.359278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.385916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] validate_networks() for [('072626bb-9d43-4f6a-bb8d-fab5dec7c580', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:00.848256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:00.861062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-af736e14-c017-45db-aacc-87ce81e52f73 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.532460 Oct 04 18:21:00.867303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2646/5440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:00.872592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:00.873417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:00.888109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.888709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.889151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:00.890128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:00.890747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:00.891804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.247258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:01.248338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:01.249267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:01.249891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:01.250765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:01.267513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.268260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.268992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.271144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.272439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.273060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.312810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Getting quotas for project 05f9260127d84cd2870f64e3fae1ccc0. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:01.325913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Getting quotas for user 8ee545450d0844f7b4eda7a440a6e838 and project 05f9260127d84cd2870f64e3fae1ccc0. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:01.358943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:01.361441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:01.464649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.475191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b256f963-3680-43a3-b77b-e1afc671e5f7 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202183 Oct 04 18:21:01.476266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2795/5441] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:01.487225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.488035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.499209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.499711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.500159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.500879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.501971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.502416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.512462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-05435a7d-13a9-4f06-a422-380347a53326 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 0.643768 Oct 04 18:21:01.525712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2647/5442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:00 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.563064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:01.572418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:01.594550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.596741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.598898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.610633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:01.611513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:01.626689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:01.967854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:01.978026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16051f1d-faf8-45b9-a593-68217112d895 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.500446 Oct 04 18:21:01.978613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2796/5443] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:01.987256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b5e46e-f146-4f87-b190-5b8f45024d28", "name": "network-vif-plugged", "status": "completed", "tag": "3f42b204-82e9-4a0f-b3ce-c4ea03342a45"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:02.011307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.012106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.015972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.016848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.028905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dcc474e2-6c4f-40d0-b62b-f0eb2296c47e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1506 microversion: 2.1 time: 0.497168 Oct 04 18:21:02.044490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] Creating event network-vif-plugged:3f42b204-82e9-4a0f-b3ce-c4ea03342a45 for instance 22b5e46e-f146-4f87-b190-5b8f45024d28 on n-h2-831194-21 Oct 04 18:21:02.054123 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2648/5444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:01 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1506 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.069114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a635b206-6816-41d4-9e3d-65caf9663f4c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.070302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a635b206-6816-41d4-9e3d-65caf9663f4c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.070838 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ca145477-0f09-40d0-9b96-232d949f3155 req-b82bdace-9a02-4748-854e-0ce573ea731f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087190 Oct 04 18:21:02.071521 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2797/5445] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:02.093807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:02.110237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.133621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.134533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.135170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.136038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.136648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.137228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.189123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lazy-loading 'flavor' on Instance uuid 822485e1-d0c7-4c5a-959d-5a0ddd55d640 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:02.289030 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a635b206-6816-41d4-9e3d-65caf9663f4c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1329 microversion: 2.1 time: 0.232618 Oct 04 18:21:02.290737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2649/5446] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1329 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:02.305632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:02.360974 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d586586-1432-4dbb-b7a1-22686d467d81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.286207 Oct 04 18:21:02.365843 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2798/5447] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:02 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:02.375392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.377097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.387385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.388039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.388614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.390275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.390869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.391460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.574527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:02.577641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:02.609397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.611928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.617615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.618666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:02.619364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:02.620333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:02.758454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:02.807600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5e66987-6e25-4009-97f5-71366ced296b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1679 microversion: 2.1 time: 0.440257 Oct 04 18:21:02.808218 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2650/5448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1679 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:03.063317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.064176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.099388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.110773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.111355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.112138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.112627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.113397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.402861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.416845 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da808596-caaf-41b5-9b8c-4284b0fc8a0f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1486 microversion: 2.1 time: 0.358722 Oct 04 18:21:03.429594 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2651/5449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1486 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:03.453705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.454537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.463041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.463798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.464424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.465334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.465975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.466584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.657871 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16d1ebdf-bc56-4b2d-abac-452581503d54 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1338 microversion: 2.1 time: 0.224569 Oct 04 18:21:03.660611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2652/5450] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1338 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.837598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:03.839023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:03.867501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.873521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.876085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.877045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:03.878677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:03.884075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:03.894375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:03.933614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce720772-015d-468f-a87a-324f49128dee tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1316 microversion: 2.1 time: 1.376855 Oct 04 18:21:03.936561 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2799/5451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:02 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1316 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:03.959398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1717560116", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:04.119782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] validate_networks() for [('41c8c0c1-dfdc-4e04-a4db-a738a2848134', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:04.395036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:04.410176 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-224fd2c6-127f-4fa0-aaca-bb5036b29ba0 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1662 microversion: 2.1 time: 0.577253 Oct 04 18:21:04.414447 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2653/5452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:03 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1662 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:04.446764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:04.447316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.464289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.470017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.475266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.478284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.483491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.484721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.665982 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e39b6c42-f216-470a-afe5-302e3eace331 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action" status: 202 len: 0 microversion: 2.1 time: 0.232588 Oct 04 18:21:04.666975 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2654/5453] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:04 2022] POST /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:21:04.715851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:04.721321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:04.752502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.756277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.764854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:04.770078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:04.771214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:04.771801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.283968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:05.307281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fdde0d6e-6cb8-4724-8fe9-cb385a995620 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1668 microversion: 2.1 time: 0.623128 Oct 04 18:21:05.325566 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2655/5454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:04 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1668 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:05.337120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.340520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.360171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.361189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.364401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.371683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.374107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.375838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.648072 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44a044a1-c18d-4502-b19c-dd4fce9d4059 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1424 microversion: 2.1 time: 0.322092 Oct 04 18:21:05.654064 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2656/5455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1424 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:05.670349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:05.674393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:05.701873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.704230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.705990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:05.708776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:05.710994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:05.712490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.181464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.196211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56f15cfa-41ac-448b-9f3c-6ffae9e19649 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1504 microversion: 2.1 time: 0.539602 Oct 04 18:21:06.199130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2657/5456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:05 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1504 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:06.229456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.230078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.249076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.249721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.250283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.251090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.251628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.252177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.332744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:06.397146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:06.397716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:06.398090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:06.398576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:06.399002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:06.428001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.428661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.429167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.434287 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8d8510c3-4563-421e-8ad1-444185882535 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.208606 Oct 04 18:21:06.436570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2658/5457] 10.222.0.42 () {58 vars in 1296 bytes} [Tue Oct 4 18:21:06 2022] DELETE /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28/os-server-password => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:21:06.444928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.445176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.445617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.450086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.450750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.453322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.453859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.454517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.456015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.457256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.458127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.500271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Getting quotas for project d91b800263eb4b17aa644ab19fd2f1f2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:06.510578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Getting quotas for user f3fcc65b9bca48ba83da599eadf6d99b and project d91b800263eb4b17aa644ab19fd2f1f2. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:06.539951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:06.543440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:06.668536 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c66a027-abb1-4e7e-9490-abc8a4c8387d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.728158 Oct 04 18:21:06.670043 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2800/5458] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:03 2022] POST /compute/v2.1/servers => generated 383 bytes in 2732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:06.715474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.739609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.759002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.759513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.759961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.760681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.772073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.772687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.863622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42228987-80ce-44b5-996d-49112d46fd6a tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.190674 Oct 04 18:21:06.864128 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2801/5459] 10.222.0.42 () {58 vars in 1293 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28/os-server-password => generated 16 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:21:06.868791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.869423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:06.889436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.889975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.890416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.891145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:06.891607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:06.892047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:06.919632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:06.943641 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8d1c2e4-3759-45a0-a017-33a903e14c56 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1668 microversion: 2.1 time: 0.505839 Oct 04 18:21:06.945151 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2659/5460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1668 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:06.950165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-828eaac9-3d19-4989-a5dd-825e5eb0cf95 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:06.958895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-828eaac9-3d19-4989-a5dd-825e5eb0cf95 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.089319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-828eaac9-3d19-4989-a5dd-825e5eb0cf95 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.111287 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-828eaac9-3d19-4989-a5dd-825e5eb0cf95 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1214 microversion: 2.1 time: 0.164374 Oct 04 18:21:07.114009 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2660/5461] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1214 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.126942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.126942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.140035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.140752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.141446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.143646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.145330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.146011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.228343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:07.396992 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e96a215f-43da-4214-8934-1f8a21c42450 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "DELETE /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 204 len: 0 microversion: 2.1 time: 0.280885 Oct 04 18:21:07.398734 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b46153b3-c2c7-43c2-95d6-0391e35ee0bf tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.533472 Oct 04 18:21:07.399976 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2802/5462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:06 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.401479 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2661/5463] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:07 2022] DELETE /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:07.459053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.460094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.472619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.474880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.476134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.493097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.496844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.501359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.888103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:07.921193 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c6f7d91-43b6-4adc-8cfb-5a59f0579dc0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1510 microversion: 2.1 time: 0.498143 Oct 04 18:21:07.941859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2803/5464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1510 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:07.975279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:07.976705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:07.985453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.986279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.986937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:07.989182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:07.989861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:07.990465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.147017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.147968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.155888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.156798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.157441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.158572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.159214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.160343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.236296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.252505 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8598a228-4989-43d7-ad09-cc0e31757fcc tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1218 microversion: 2.1 time: 0.109752 Oct 04 18:21:08.258035 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2804/5465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:08.415690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:08.424496 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02eacca4-7ea9-4617-ac18-b63798cdc42c tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1668 microversion: 2.1 time: 0.454434 Oct 04 18:21:08.435707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.435707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.437934 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2662/5466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:07 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1668 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:08.439952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.441731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.442630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.443459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.444060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.444837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.618446 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-90f08bfe-827a-4f88-95ef-d97af9c8ab27 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.199513 Oct 04 18:21:08.633955 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2805/5467] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:08.762365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e3ca933-333d-4f7c-833d-5fafc517413e", "tag": "5b4d06dc-c830-4688-8980-ccd16bfe172d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:08.775605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.776522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.777123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.794947 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] Creating event network-changed:5b4d06dc-c830-4688-8980-ccd16bfe172d for instance 5e3ca933-333d-4f7c-833d-5fafc517413e on n-h1-831194-21 Oct 04 18:21:08.803121 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7fff9bdc-6eed-4611-8a8b-5cbad776db56 req-490a6bda-fef8-4a39-b52c-5309c9cc06ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044871 Oct 04 18:21:08.804019 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2663/5468] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:08.953185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:08.953764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:08.960450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.961305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.961972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:08.962931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:08.963601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:08.964234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.281324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.282079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.303573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.304077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.304806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.305235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.305690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.306326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.318963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.334791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-131d6931-29fd-4248-b25e-6a571084ad22 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1510 microversion: 2.1 time: 0.385736 Oct 04 18:21:09.335403 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2806/5469] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:08 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1510 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.411620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.420041 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72139d82-5e53-41eb-a708-19b7ef970535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1218 microversion: 2.1 time: 0.143082 Oct 04 18:21:09.432398 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2664/5470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.452668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.453972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.461197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.461749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.462278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.463080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.463608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.464105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.646358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.663451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.681532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.682380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.683182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.685740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.686446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.687038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.777682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:09.875583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:09.893099 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ceecbac2-6661-4a98-9ceb-6d49767c95b1 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.446906 Oct 04 18:21:09.894501 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2807/5471] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:09.916887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:09.917752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:09.925042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.925794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.926438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.927316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:09.927948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:09.928540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:09.946468 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-caae6d1b-b246-4a70-93c7-df22bbfdbd16 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.306277 Oct 04 18:21:09.949909 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2665/5472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:10.346617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.363402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.364473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.375122 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d30a137-e029-4873-a58b-72770b0794f3 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1671 microversion: 2.1 time: 0.461925 Oct 04 18:21:10.377702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.379670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2808/5473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:09 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1671 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:10.380586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.381197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.382140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.382794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.384206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.411000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.411155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.423572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.424074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.424515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.425291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.426988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.430052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.503920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:10.523484 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Working on deleting snapshot 908b00cd-1738-439b-81b5-3854f67d82d4 from shelved instance... Oct 04 18:21:10.677008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.692949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74f77660-7c0f-4c92-be48-fc889bb6e6c0 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1510 microversion: 2.1 time: 0.335046 Oct 04 18:21:10.697543 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2666/5474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1510 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.716858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.717642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.732318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.733670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.735320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.739136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.741502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.743524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.921427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:10.931082 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8a1a277-7800-4cab-876f-0011f79a90ac tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1274 microversion: 2.1 time: 0.230789 Oct 04 18:21:10.933127 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2667/5475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:10.973140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:10.974221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:10.995241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.995637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:10.996173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:10.999391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:10.999951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.005189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.275004 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b09f0a29-2b1c-4660-9194-da2bf0df4578 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.308297 Oct 04 18:21:11.290301 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2668/5476] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:10 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:11.484570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22b5e46e-f146-4f87-b190-5b8f45024d28", "name": "network-vif-deleted", "tag": "3f42b204-82e9-4a0f-b3ce-c4ea03342a45"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:11.497383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.499412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.505901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.521599 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] Creating event network-vif-deleted:3f42b204-82e9-4a0f-b3ce-c4ea03342a45 for instance 22b5e46e-f146-4f87-b190-5b8f45024d28 on n-h2-831194-21 Oct 04 18:21:11.543375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-440e1c53-2875-4f84-8af7-fc4450317d6f req-68611024-c57f-4f1c-8e6f-4a92eb4ea1bb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062527 Oct 04 18:21:11.544318 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2669/5477] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:11.628285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Doing local delete in cell 3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1(cell1) {{(pid=128849) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 04 18:21:11.629671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.630370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.630956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.631545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 04 18:21:11.638432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] deallocate_for_instance() {{(pid=128849) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 04 18:21:11.724237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.725557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.738593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.739405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.740060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.741150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.741986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.742588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.788212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.789126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.789735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.790400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lazy-loading 'fault' on Instance uuid 22b5e46e-f146-4f87-b190-5b8f45024d28 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:11.844386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d4f57d5514640f7b93eb16995bb09b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe36c24e8aee4653bf2fe2150a23ad9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:11.862274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28cc5a44-63cc-466e-aedc-d7469cdf9b84 tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 200 len: 1306 microversion: 2.1 time: 0.143168 Oct 04 18:21:11.863822 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2670/5478] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 1306 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:11.958514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:11.959363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:11.966270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.967046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.967677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:11.968649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:11.969457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:11.970085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.051168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:12.062316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7331e44-b5ab-492f-b04a-31ac949b223c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1272 microversion: 2.1 time: 0.108164 Oct 04 18:21:12.063242 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2671/5479] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:11 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:12.303303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.305864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.317762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.318378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.318835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.319571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.320212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.320653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.536417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5df1a7a3-cafd-418f-aa16-a1476182f8b2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.237608 Oct 04 18:21:12.538139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2672/5480] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:12.891956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:12.893395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] [instance: 22b5e46e-f146-4f87-b190-5b8f45024d28] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:12.909486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:12.914009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.915274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.916381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.918709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Updating instance_info_cache with network_info: [] {{(pid=128849) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 04 18:21:12.920125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:12.921767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:12.923734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:12.970653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] HTTP exception thrown: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Request method failure captured: Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 HTTP/1.1 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHl3_QFLO98tdtkmnrsGdk1AakGsp9FUMMNeI6ms_Wpx2MEP9ix1K6hYEkMhymc5vxtpmb3MGuaoAFrB2NiAAijcG7ZC7oqUKQWREfUCtKBrK0KTbKdtZHZK_OjbrajrLbYlxISyMqd2Io55dccP8YZgK5IoxBrZHoB8lFRxUEl6IJU Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: fe36c24e8aee4653bf2fe2150a23ad9d Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerPasswordTestJSON-2032669833 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fe36c24e8aee4653bf2fe2150a23ad9d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe36c24e8aee4653bf2fe2150a23ad9d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fe36c24e8aee4653bf2fe2150a23ad9d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fe36c24e8aee4653bf2fe2150a23ad9d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerPasswordTestJSON-2032669833 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: fe36c24e8aee4653bf2fe2150a23ad9d Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerPasswordTestJSON-2032669833 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerPasswordTestJSON-2032669833-project Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 1d4f57d5514640f7b93eb16995bb09b6 Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerPasswordTestJSON-2032669833-project Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '22b5e46e-f146-4f87-b190-5b8f45024d28'} Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:12.972917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. Oct 04 18:21:12.977076 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:12.980078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] Returning 404 to user: Instance 22b5e46e-f146-4f87-b190-5b8f45024d28 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:12.982054 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-004397d0-0d7f-4e36-87c2-3b9ac6e6e4bc tempest-ServerPasswordTestJSON-2032669833 tempest-ServerPasswordTestJSON-2032669833-project] 10.222.0.42 "GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28" status: 404 len: 111 microversion: 2.1 time: 0.094283 Oct 04 18:21:12.983290 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2673/5481] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:12 2022] GET /compute/v2.1/servers/22b5e46e-f146-4f87-b190-5b8f45024d28 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:21:13.091910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.094241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.121435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.122448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.123212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.124176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.124872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.126362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.229441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=16,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:13.257936 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8badda4-dad9-4fc4-b1ff-f2d87bd9a66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 204 len: 0 microversion: 2.1 time: 2.853082 Oct 04 18:21:13.276766 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2809/5482] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:10 2022] DELETE /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 0 bytes in 2857 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:21:13.290155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.297771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 67463c20-313a-4646-9754-3aab7f8824c8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.319166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.319988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.320622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.321553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.330656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.332035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.356927 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 HTTP/1.1 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '67463c20-313a-4646-9754-3aab7f8824c8'} Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:13.359538 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. Oct 04 18:21:13.364039 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:13.366839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 404 to user: Instance 67463c20-313a-4646-9754-3aab7f8824c8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:13.367920 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8dbd39e7-f2ca-4516-bd7c-f9ba5fd50aa4 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8" status: 404 len: 111 microversion: 2.1 time: 0.090045 Oct 04 18:21:13.369049 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2810/5483] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/67463c20-313a-4646-9754-3aab7f8824c8 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:13.379185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.386729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.401538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.402287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.402936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.403806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.404984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.405577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.435250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:13.550908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef429aa5-4c6c-44a4-8db2-4aabdf48c66d tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 204 len: 0 microversion: 2.1 time: 0.174576 Oct 04 18:21:13.552182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2811/5484] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:13 2022] DELETE /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:13.563613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.567260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.579684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.582320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.583171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.584096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.585970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.586582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.662903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.681436 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e8ddab2-cc51-4ee2-b23a-a6df227c8e9e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.594143 Oct 04 18:21:13.694833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2674/5485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.733783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:13.743035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:13.759165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.759924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.760613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.763153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.763834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.764482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.777544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:13.871134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:13.881085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-158a7373-c8f6-4775-a6fe-e8383154ad82 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1466 microversion: 2.1 time: 0.323867 Oct 04 18:21:13.885156 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2812/5486] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1466 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:13.897238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67463c20-313a-4646-9754-3aab7f8824c8", "name": "network-vif-deleted", "tag": "dc0f9f75-074e-4472-81ee-db9fc98eb4a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:13.922972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:13.924150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:13.925911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:13.950161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_external_events [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] Unable to find a host for instance 67463c20-313a-4646-9754-3aab7f8824c8. Dropping event network-vif-deleted {{(pid=128849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 18:21:13.953492 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a1ba71c2-0229-43e7-8a6c-0d09bd62fe43 req-efc8d7f6-d023-4ec0-8650-e6c060843750 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.066404 Oct 04 18:21:13.954323 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2813/5487] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 68 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 18:21:14.185438 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-062012a9-9f58-4e31-ab8b-af214c873245 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.488032 Oct 04 18:21:14.186106 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2675/5488] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:13 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:14.298760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3ca933-333d-4f7c-833d-5fafc517413e", "name": "network-vif-plugged", "status": "completed", "tag": "5b4d06dc-c830-4688-8980-ccd16bfe172d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:14.320874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.322525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.322525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.343605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] Creating event network-vif-plugged:5b4d06dc-c830-4688-8980-ccd16bfe172d for instance 5e3ca933-333d-4f7c-833d-5fafc517413e on n-h1-831194-21 Oct 04 18:21:14.360893 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3795611b-42f3-4109-a7f1-7890134fc249 req-695adaf4-d931-4fb1-869a-5a4cd76eb55d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065680 Oct 04 18:21:14.362050 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2814/5489] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:14.711663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.712342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.719879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.720658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.721303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.722767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.733902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.734806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.916864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:14.917974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:14.945514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.946168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.946513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:14.947289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:14.947690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:14.948471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.075521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.097657 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4f98295-c544-4fdc-85c5-639226c70d72 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.387527 Oct 04 18:21:15.098925 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2676/5490] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.184488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:15.196517 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3287e3f4-b36c-4bfe-8a4c-c8c631b83f8a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1466 microversion: 2.1 time: 0.288146 Oct 04 18:21:15.197121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2815/5491] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:14 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:15.217085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:15.218938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:15.233127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.233782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.234275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.235017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:15.235478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:15.235948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:15.982542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e29e83-ef82-4b95-b8d6-6a14ea576846", "tag": "9d162a66-32c8-44bd-b4ba-de44fc272c6d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:16.001853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.008671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.009425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.040181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] Creating event network-changed:9d162a66-32c8-44bd-b4ba-de44fc272c6d for instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 on n-h2-831194-21 Oct 04 18:21:16.057151 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2e7fb7fd-6de8-45f6-96ad-4234d5a609f3 req-70cbdcb0-2249-4de3-913f-dd3af37c024a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078329 Oct 04 18:21:16.060699 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2816/5492] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:16.125532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.126309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.135210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.135961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.136686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.137749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.138390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.138984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.393140 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c2ad542e-f349-4de8-812b-c32f756ec56e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 1.181482 Oct 04 18:21:16.394263 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2677/5493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:15 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.403732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:16.404656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:16.434923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.435574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.435902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.436687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:16.437148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:16.437633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:16.484513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:16.525775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:16.587254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.598055 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4605a1c-a06d-4b5d-8b34-0e4b48f9b2ba tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1466 microversion: 2.1 time: 0.202198 Oct 04 18:21:16.617332 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2678/5494] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1466 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:16.833702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:16.844454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c5f77232-eff7-4d21-bb65-056aa831b883 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.723248 Oct 04 18:21:16.845268 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2817/5495] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:16 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:17.422282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.422907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.438175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:17.440785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.441568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.442096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.445910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.446533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.447084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.627238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.629470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.657760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.665631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.666546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.671506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.672783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.673765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.908015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:17.923103 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92244f07-a49d-4ae0-a5b8-4e5dde98be80 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1466 microversion: 2.1 time: 0.299179 Oct 04 18:21:17.925579 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2818/5496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1466 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:17.947030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:17.947668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:17.977233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:17.980091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.980891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.981639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:17.983022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:17.983840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:17.984542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.217645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:18.219448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75c60607-41a2-4e02-a80a-dddd0dee7c46 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1466 microversion: 2.1 time: 0.790607 Oct 04 18:21:18.221085 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2679/5497] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1466 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.227781 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8071d709-a88c-4284-b472-da4c582ed406 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.301034 Oct 04 18:21:18.228883 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2819/5498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:17 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:18.353430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6533dc2d-bb1c-4748-b9f2-e73a261488f7", "name": "network-vif-deleted", "tag": "d6e1f770-34f3-46a5-9536-6890b43dfba9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:18.385085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.386219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.386754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.445981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] Creating event network-vif-deleted:d6e1f770-34f3-46a5-9536-6890b43dfba9 for instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 on n-h1-831194-21 Oct 04 18:21:18.453809 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-da7fcc90-6147-4eb4-b29b-2381c15b51a4 req-24f471c7-678c-4529-8311-6c9144b3a34f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106842 Oct 04 18:21:18.464489 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2680/5499] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:18.951673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:18.952321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:18.963120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.963655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.964100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:18.964989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:18.965503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:18.966139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.015289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.016042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.016641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.017542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lazy-loading 'fault' on Instance uuid 6533dc2d-bb1c-4748-b9f2-e73a261488f7 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:19.102306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.133390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23fa988a-c742-4e15-ad53-c9842404b9bb tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 200 len: 1304 microversion: 2.1 time: 0.185369 Oct 04 18:21:19.149857 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2820/5500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:18 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.254165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.257604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.273413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.274294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.277052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.277478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.278183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.278601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.279302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.280489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.310967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.319045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.321205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.324279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.324762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.353534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.647769 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e32a496-9a8a-4aa1-bd5b-ff5ed24b001e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1650 microversion: 2.1 time: 0.399095 Oct 04 18:21:19.664385 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2681/5501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1650 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.679192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.679822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.689369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.689895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.690560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.692549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.693611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.694269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.875135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:19.890992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-564dc355-a4a7-4109-bb6a-3af8a40bd19b tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.627999 Oct 04 18:21:19.891642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2821/5502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:19.922362 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1c1a32b-b5a3-439a-a0a8-f92f112af232 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1650 microversion: 2.1 time: 0.250730 Oct 04 18:21:19.923056 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2682/5503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1650 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:19.949374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:19.950066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:19.967043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.967683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.973332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:19.974731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:19.975488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:19.976173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.167825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.169001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 6533dc2d-bb1c-4748-b9f2-e73a261488f7] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.181453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.181995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.185385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.188232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.189021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.189478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.233880 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 HTTP/1.1 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6533dc2d-bb1c-4748-b9f2-e73a261488f7'} Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:20.237758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:20.241603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 404 to user: Instance 6533dc2d-bb1c-4748-b9f2-e73a261488f7 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:20.242899 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-23eac11f-1cfd-46c3-a007-12d4f46b01d2 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7" status: 404 len: 111 microversion: 2.1 time: 0.081636 Oct 04 18:21:20.243494 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2683/5504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/6533dc2d-bb1c-4748-b9f2-e73a261488f7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:20.254128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.256198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.266018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.266892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.268111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.269806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.270591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.271188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.309855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:20.320820 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66dad00e-6c2a-4624-b4b6-5f0b6859e425 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1650 microversion: 2.1 time: 0.374296 Oct 04 18:21:20.322190 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2822/5505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:19 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1650 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.428924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-495530912", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "availability_zone": "nova:n-h2-831194-21", "networks": [{"uuid": "072626bb-9d43-4f6a-bb8d-fab5dec7c580"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:20.477785 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49c30df6-9175-4d61-be46-84e19847f7db tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 204 len: 0 microversion: 2.1 time: 0.218279 Oct 04 18:21:20.479221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2684/5506] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:20 2022] DELETE /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:20.493687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.514734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.526290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.527060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.528429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.529244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.529773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.530271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.572533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] validate_networks() for [('072626bb-9d43-4f6a-bb8d-fab5dec7c580', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:20.838513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:20.851174 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7864ba41-2747-49d1-820d-60d042f487bd tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1507 microversion: 2.1 time: 0.362838 Oct 04 18:21:20.868767 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2685/5507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:20.923383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:20.924228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:20.942035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.944138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.944693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:20.946117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:20.949945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:20.961527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.484333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:21.526775 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c0da6dbf-62dc-4cba-93ff-42cb0a80cc82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.612084 Oct 04 18:21:21.542697 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2686/5508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:20 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:21.580204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e29e83-ef82-4b95-b8d6-6a14ea576846", "name": "network-vif-plugged", "status": "completed", "tag": "9d162a66-32c8-44bd-b4ba-de44fc272c6d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:21.605291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.606732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.607398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.647945 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] Creating event network-vif-plugged:9d162a66-32c8-44bd-b4ba-de44fc272c6d for instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 on n-h2-831194-21 Oct 04 18:21:21.656925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:21.657466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:21.657922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:21.658349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:21.659489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:21.674198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-42fda948-1543-4eda-9f07-6373fefb219b req-c8ed69ca-a3a8-4ba7-8c7d-053ee9c89304 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086855 Oct 04 18:21:21.677076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2687/5509] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:21.681474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.682023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.682478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.686441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.686891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.687333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.748974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Getting quotas for project 05f9260127d84cd2870f64e3fae1ccc0. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:21.758232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Getting quotas for user 8ee545450d0844f7b4eda7a440a6e838 and project 05f9260127d84cd2870f64e3fae1ccc0. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:21.779956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:21.782636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:21.882866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.885704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:21.920480 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0f67e67a-4e89-470b-8517-64138e710dce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.497380 Oct 04 18:21:21.923300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.924080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.927432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2823/5510] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:21:21.928175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.933724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:21.940435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:21.941252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:21.950404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66cd1386-13f4-45d9-9c96-4d9b3608423e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:21.951107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66cd1386-13f4-45d9-9c96-4d9b3608423e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.262987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66cd1386-13f4-45d9-9c96-4d9b3608423e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1328 microversion: 2.1 time: 0.327695 Oct 04 18:21:22.272800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2824/5511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1328 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:22.393331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:22.407700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80528af4-e59f-46a8-9661-539cc525fce6 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1507 microversion: 2.1 time: 0.531200 Oct 04 18:21:22.412255 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2688/5512] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:21 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1507 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:22.560139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:22.561664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:22.566842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dec9a353-d23f-41ed-869e-70278e013884 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: .version_select at 0x7fbdbd606700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1110446388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1G4+T735Oo7K0mnBpS8nh9PwFVsZnyX/aXF/KFpFlLEJFlCi2WnwjsdVrlQtMAXQ6NvlyKz8i49N8FemFewezqg1GN9UfN3M5haTX2u8hWZEgaEmQ0FQaTuDHaA/phRw=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:22.576723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.582104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.582853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.583955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:22.584583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:22.586199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:22.614592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-dec9a353-d23f-41ed-869e-70278e013884 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:22.659462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-dec9a353-d23f-41ed-869e-70278e013884 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:22.719932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dec9a353-d23f-41ed-869e-70278e013884 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.157816 Oct 04 18:21:22.721123 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2689/5513] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:21:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:23.200940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.214670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d085b5-9fe6-4e9e-8b95-c2ec8c46e791", "name": "network-vif-deleted", "tag": "7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:23.234600 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b69d6302-4e3f-4f0a-a3d4-51a0e6a14c5c tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1314 microversion: 2.1 time: 0.681518 Oct 04 18:21:23.235292 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2825/5514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:22 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1314 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:23.247007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.247493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.247931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.288773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.290027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.298445 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] Creating event network-vif-deleted:7a317cdf-c4bc-4cb0-a8cc-4c1f53a0ad8b for instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 on n-h1-831194-21 Oct 04 18:21:23.311899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.312613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.321098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.321901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.322389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.322828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.338034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-46c3abb0-1461-4660-9311-cabecb12690c req-8cf347a6-25b6-4723-a8d2-6f858d8528be service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172562 Oct 04 18:21:23.341079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2690/5515] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:23.432522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:23.433276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:23.448230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.448748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.449176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.450208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:23.450839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:23.451417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:23.522324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f884664a-bff7-4648-a513-399d87fb9a7a tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1337 microversion: 2.1 time: 0.238547 Oct 04 18:21:23.526914 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2826/5516] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1337 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:23.612322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:23.640137 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f02f35fa-1902-4f5f-99f6-bd67442dc0ea tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 200 len: 1299 microversion: 2.1 time: 0.209066 Oct 04 18:21:23.643683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2691/5517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:23 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:24.259410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.260022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.297169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.298448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.304391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.305466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.306008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.306564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.550876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.551442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.571189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.571900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.572813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.576292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.577435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.578306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.864837 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-38b9e49f-1d19-4859-842c-4063e0755cce tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1425 microversion: 2.1 time: 0.319143 Oct 04 18:21:24.865445 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2692/5518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1425 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:24.876374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.885421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.894148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.900083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.900778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.902367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.905580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.906143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.916873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:24.925253 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d334e525-6dff-4c36-afc0-5635dbfa9e68 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1499 microversion: 2.1 time: 0.669661 Oct 04 18:21:24.930762 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2827/5519] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1499 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:24.940658 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 HTTP/1.1 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '29d085b5-9fe6-4e9e-8b95-c2ec8c46e791'} Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:24.943087 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 404 to user: Instance 29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:24.948010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f6d7103-4cc8-4e92-bc1c-1e9d47ee264a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791" status: 404 len: 111 microversion: 2.1 time: 0.077963 Oct 04 18:21:24.954080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:24.954809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.958687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2693/5520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:24 2022] GET /compute/v2.1/servers/29d085b5-9fe6-4e9e-8b95-c2ec8c46e791 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:24.964473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:24.967450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:24.969419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.972347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.976174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.977047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.978741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.979945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.980735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.981282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.981988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:24.984302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:24.985877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:24.986399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.017229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:25.024438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lazy-loading 'flavor' on Instance uuid 34e29e83-ef82-4b95-b8d6-6a14ea576846 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:25.032413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:DELETE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:25.045741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:25.201871 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-401650f8-9def-4481-b8ee-a3d03f1f23d3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "POST /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846/action" status: 200 len: 32 microversion: 2.1 time: 0.241488 Oct 04 18:21:25.207462 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2694/5521] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:24 2022] POST /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:21:25.228775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.229875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.245736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cbf4911-5fc9-498b-a538-4ee0a0f66e42 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 204 len: 0 microversion: 2.1 time: 0.295254 Oct 04 18:21:25.246401 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2828/5522] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:24 2022] DELETE /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:25.250350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.251087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.251841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.253187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.253944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.254546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.256175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.260324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.275807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.276622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.276760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.277485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.277973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.283160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.678293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:25.697138 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b2384a4d-b86e-4e21-830f-9f5ff4a4ed19 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.482230 Oct 04 18:21:25.698518 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2695/5523] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:25.893888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:25.894723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:25.904621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.905133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.905581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:25.906335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:25.906799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:25.907229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.272037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f7cb678-c694-4c0a-aacc-bfbded332a7c tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1423 microversion: 2.1 time: 0.382819 Oct 04 18:21:26.277616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2696/5524] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1423 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.286326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-653485682", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "1dad3483-8cdf-4ecb-b91a-c5bc29b1b196"}], "key_name": "tempest-TestNetworkBasicOps-1110446388", "security_groups": [{"name": "tempest-secgroup-smoke-1669550079"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:26.553781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:26.580090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-389bdced-b191-4615-8d53-1d5307a16e81 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1495 microversion: 2.1 time: 1.328941 Oct 04 18:21:26.583355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2829/5525] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:25 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1495 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:26.720571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:26.721453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:26.731194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.736353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.737812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.738924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:26.739566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:26.740007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:26.815291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] validate_networks() for [('1dad3483-8cdf-4ecb-b91a-c5bc29b1b196', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:27.293612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:27.308486 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89f5f676-384e-4256-bc0f-65c2a09458c4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.589903 Oct 04 18:21:27.313364 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2830/5526] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:26 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.327691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.341785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.354816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.355313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.355763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.356479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.362916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.363590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.759090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:21:27.759524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:21:27.760005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:21:27.760424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:21:27.760851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:21:27.781525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.782144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.782706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.783736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.784513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.784776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.808348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:21:27.814019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Getting quotas for user ef59ce7cca054a4ab3d753723fc00505 and project d57cbee648654e9bba91675d9620347f. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:21:27.827783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:21:27.830055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:21:27.867217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a734a27-ea26-4a83-a5d4-0305937208fd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.552151 Oct 04 18:21:27.868263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2831/5527] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:27.874425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5b04bb-3145-435a-a8e3-26897544c7b2", "name": "network-vif-deleted", "tag": "328fb2b8-160e-47cb-b467-2fa5b28b01b0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:27.887254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.888951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.889432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.901173 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4276b00-fdfa-4a4e-a4e5-2ce727bbabbe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.621917 Oct 04 18:21:27.902686 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2697/5528] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:21:27.914070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] Creating event network-vif-deleted:328fb2b8-160e-47cb-b467-2fa5b28b01b0 for instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 on n-h1-831194-21 Oct 04 18:21:27.924996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f6146939-64a6-4b4e-93b7-673e39cccd80 req-7025ee64-77d2-4be0-987b-f704844570a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053201 Oct 04 18:21:27.925807 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2832/5529] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:27.935797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:27.936630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:27.943941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.944617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.945245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:27.946239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:27.946929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:27.947559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.035797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.043035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.043635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.044290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lazy-loading 'fault' on Instance uuid 1d5b04bb-3145-435a-a8e3-26897544c7b2 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:28.131001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d64c1204-3a37-48b7-9f50-963672efdc81 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] Calling method '.version_select at 0x7fbdbc90f430>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.168143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.181428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a1d5b31-04af-464f-a39c-cb4fc9475262 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 200 len: 1305 microversion: 2.1 time: 0.250249 Oct 04 18:21:28.183388 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2833/5530] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 1305 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.189729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.190886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.208099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.209177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.209727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.210523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.210954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.211570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.239532 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e339e4b9-7461-4bd6-9eab-55fefad01504 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/ips" status: 200 len: 144 microversion: 2.1 time: 0.054151 Oct 04 18:21:28.246888 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d64c1204-3a37-48b7-9f50-963672efdc81 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155/defaults" status: 200 len: 371 microversion: 2.1 time: 0.337315 Oct 04 18:21:28.247408 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2834/5531] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/ips => generated 144 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.253650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2698/5532] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 18:21:27 2022] GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155/defaults => generated 371 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.254619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-830c2dee-0fbf-44bd-91e1-aa868a49da12 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.255254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-830c2dee-0fbf-44bd-91e1-aa868a49da12 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.258853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9cacc60-c341-45d9-b521-a4ce9b7a4d5a tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] Calling method '.version_select at 0x7fbdbd755790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.349605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-830c2dee-0fbf-44bd-91e1-aa868a49da12 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.362681 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-830c2dee-0fbf-44bd-91e1-aa868a49da12 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1248 microversion: 2.1 time: 0.110861 Oct 04 18:21:28.364028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2835/5533] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1248 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.373444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.374097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.392595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.393416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.393894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.394631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.397495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.398005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.418578 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9cacc60-c341-45d9-b521-a4ce9b7a4d5a tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155" status: 200 len: 371 microversion: 2.1 time: 0.163063 Oct 04 18:21:28.430470 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2699/5534] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155 => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.443498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7f790e0-dc56-411a-9a0e-df4157a0f6e0 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] Calling method '.version_select at 0x7fbdbd827ca0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.535004 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7f790e0-dc56-411a-9a0e-df4157a0f6e0 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155/defaults" status: 200 len: 371 microversion: 2.1 time: 0.101311 Oct 04 18:21:28.536160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2700/5535] 10.222.0.42 () {58 vars in 1269 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155/defaults => generated 371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.555307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c16fe58b-5e03-44b8-a0ea-216ea76cbd21 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] Calling method '.version_select at 0x7fbdc1c895e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.664356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c16fe58b-5e03-44b8-a0ea-216ea76cbd21 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155" status: 200 len: 371 microversion: 2.1 time: 0.116197 Oct 04 18:21:28.666108 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2701/5536] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155 => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:28.670272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:28.677767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57d4cffc-3f53-44da-b3c2-01b6345afac2 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] Calling method '.version_select at 0x7fbdbc92f700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.678862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6218ed0-6e1d-4f11-895a-8250728e2329 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.313547 Oct 04 18:21:28.679453 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2836/5537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:28.835062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57d4cffc-3f53-44da-b3c2-01b6345afac2 tempest-QuotasTestJSON-751564524 tempest-QuotasTestJSON-751564524-project] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155?user_id=94af739a927442d58d2d1872414a9109" status: 200 len: 371 microversion: 2.1 time: 0.161781 Oct 04 18:21:28.835680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2702/5538] 10.222.0.42 () {58 vars in 1323 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/os-quota-sets/5330f6c496034839922be74438d17155?user_id=94af739a927442d58d2d1872414a9109 => generated 371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:28.871796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa12d96-5ef8-4737-8838-a72b3045aee3", "tag": "dbd30c62-04ea-4272-a09e-60a610b57a84"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:28.894627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.895179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.895699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.896644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:28.897915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:28.900334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:28.915415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.918312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.918932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.921207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:28.922219 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] Creating event network-changed:dbd30c62-04ea-4272-a09e-60a610b57a84 for instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 on n-h2-831194-21 Oct 04 18:21:28.922369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:28.925882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:28.934974 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e579ca42-ccb2-437f-a402-91f87e98c8d4 req-af94f4bb-a261-4814-8cc9-eaf9a70e0b42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.178233 Oct 04 18:21:28.936802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2837/5539] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:29.110273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6ec86fb-6797-42ac-b8e5-611362afd9ad tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.220020 Oct 04 18:21:29.130635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2703/5540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:28 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:29.206247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.207498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 1d5b04bb-3145-435a-a8e3-26897544c7b2] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.214567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.215299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.215891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.216749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.217350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.217968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.235392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 HTTP/1.1 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '1d5b04bb-3145-435a-a8e3-26897544c7b2'} Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:29.237820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. Oct 04 18:21:29.242384 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:21:29.244064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 404 to user: Instance 1d5b04bb-3145-435a-a8e3-26897544c7b2 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:29.245329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4341e8a1-6bb5-4691-97f8-63a02d361c05 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2" status: 404 len: 111 microversion: 2.1 time: 0.044532 Oct 04 18:21:29.246405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2838/5541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/1d5b04bb-3145-435a-a8e3-26897544c7b2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:29.255566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.256402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.264486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.264989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.265429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.266165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.266616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.267226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.298156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:29.392012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.392996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.411995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.412756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.413522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.414577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.415223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.416023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.479025 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce5fffb9-e1ba-418a-8f72-d75b63071c4b tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 204 len: 0 microversion: 2.1 time: 0.228468 Oct 04 18:21:29.479690 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2704/5542] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:29 2022] DELETE /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:29.491904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.492608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.506430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.507503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.508103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.508991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.509845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.510468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.565848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.585216 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6512ba3c-cd2d-420b-8399-41520f517dfb tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1300 microversion: 2.1 time: 0.200289 Oct 04 18:21:29.608121 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2839/5543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1300 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:29.703319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:29.703942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:29.714005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.714784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.715571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.723870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:29.728440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:29.735472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:29.863471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:29.879866 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8731b0e4-7305-4037-94d8-42b6ea1e4830 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1677 microversion: 2.1 time: 0.392054 Oct 04 18:21:29.890920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2705/5544] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1677 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.031030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.051159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-720044e4-ce40-466b-8277-270bbe42ec71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.351604 Oct 04 18:21:30.054289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2840/5545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:29 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.137383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.137967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.147101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.147714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.148233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.149116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.149654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.150185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.454942 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75df5345-a885-4d1e-b35c-2dbb541d914e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.321813 Oct 04 18:21:30.456796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2706/5546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.608562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.609187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.617629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.618491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.619315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.620636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.621261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.621958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.751099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:30.760615 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d4f5eb3-36d9-4f61-888a-cb1ba3ef3812 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1306 microversion: 2.1 time: 0.155739 Oct 04 18:21:30.768317 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2841/5547] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1306 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:30.913164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:30.914418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:30.934319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.934852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.940083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:30.942629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:30.957053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:30.958783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.087684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.088349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.109680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.110243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.112176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.113291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.114146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.118315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.248763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:31.256987 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5149c83-d8e1-40ef-99da-f1120767fbe5 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1677 microversion: 2.1 time: 0.349860 Oct 04 18:21:31.264932 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2707/5548] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:30 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1677 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:31.299672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:31.309669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c54da488-068f-4c90-8719-dbfe24ec1b1a tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.236554 Oct 04 18:21:31.310904 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2842/5549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:31.484510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.485268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.496328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.506241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.506898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.507866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.508438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.508942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.797092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:31.797709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:31.806432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da032adf-cfa4-4de1-950f-d169f76021dd tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.325645 Oct 04 18:21:31.811552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:31.815785 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2708/5550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:31.823639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.824144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.824585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:31.825305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:31.825762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:31.826223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.073430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3557ee9-1d34-42c2-8a17-1f9f01651dc5"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:32.097052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.115001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.119484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.120419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.122529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.125739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.126283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.520110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:32.529132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3dfde1f3-6e3e-48a4-bb5c-ee974c7f9067 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.740472 Oct 04 18:21:32.535097 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2843/5551] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:31 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:32.551456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.553017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.574177 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b3d6571-7d1d-45d5-9c83-3832b3deb093 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504593 Oct 04 18:21:32.581650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2709/5552] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:21:32 2022] POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:32.588568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:32.593783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.593783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.593783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.594731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.596963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:32.600192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.600725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.608871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.609761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.610843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:32.612034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:32.612737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:32.613786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.058424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.070460 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cdeee4d7-ea0b-4a98-a12c-a87db80ecc08 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.486892 Oct 04 18:21:33.089149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2710/5553] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:33.091321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2866ad1f-4e10-495a-ad65-b82dfeccaf17", "tag": "ce395a62-142c-4a6d-9bd7-35d569034f32"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:33.108716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.109331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.109894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.125009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] Creating event network-changed:ce395a62-142c-4a6d-9bd7-35d569034f32 for instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 on n-h1-831194-21 Oct 04 18:21:33.131228 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-298f7566-65ec-4ee8-bb47-d665bf5222c6 req-b13d603a-36c9-4df0-ba5d-ad81149a9bc9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055789 Oct 04 18:21:33.132040 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2711/5554] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:33.137519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.138398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.145872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.146464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.147070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.147847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.148372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.149014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.167648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:33.464614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-454854c4-f5c2-4833-bf30-2b884c0cd611 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.330940 Oct 04 18:21:33.470445 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2712/5555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:33.530344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.539878 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b31e0ab6-25fa-4eed-a29f-8794d4553312 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1677 microversion: 2.1 time: 1.002707 Oct 04 18:21:33.546443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2844/5556] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:32 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1677 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:33.569288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:33.569954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:33.580734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.581597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.582095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.582851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:33.583309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:33.588018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:33.987495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:33.997222 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06c513d3-0575-4a23-bcde-c302efff36a6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.436033 Oct 04 18:21:34.008626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2713/5557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:33 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.098849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.108617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.136576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.137818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.140185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.144027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.150628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.151581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.485264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:34.504719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.505284 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e93e57b-3e5c-425d-a6a3-c538123f9c39 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.410274 Oct 04 18:21:34.505397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.505497 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2845/5558] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.542417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.543236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.548664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.551028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.551701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.552963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.572529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:34.573173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:34.579613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.580167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.580632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.581297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.594428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.595047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.666972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:34.859876 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e77f828d-6c3f-4a02-8601-e7578d935219 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.366197 Oct 04 18:21:34.863779 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2714/5559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:34.890318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660c26677c2540f5a005dcd39c069e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d3a8d459e664953940ec74e2b29e60c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:34.902638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "822485e1-d0c7-4c5a-959d-5a0ddd55d640", "name": "network-vif-deleted", "tag": "3127bb1a-15e8-4dee-b18b-8bc672299c93"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:34.904225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1723425-408c-46c4-b90a-9203fe40e75e tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 200 len: 1609 microversion: 2.1 time: 0.335327 Oct 04 18:21:34.910571 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2846/5560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:34 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 1609 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:34.941053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:34.941189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:34.941566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:34.971694 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] Creating event network-vif-deleted:3127bb1a-15e8-4dee-b18b-8bc672299c93 for instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 on n-h2-831194-21 Oct 04 18:21:34.988558 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7351917b-0c52-410f-94a5-6126676b9832 req-c6d099d6-5f39-4d7e-9bda-2187d2b76c34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109003 Oct 04 18:21:34.994306 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2715/5561] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:35.023599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.024412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.041634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.313111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.327693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c99d6aa-4a7c-4858-96ba-fa4e174efe9c tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.306328 Oct 04 18:21:35.328966 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2847/5562] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:35.532148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.532761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.541192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.542269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.542926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.543994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.544652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.545294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.675262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa12d96-5ef8-4737-8838-a72b3045aee3", "name": "network-vif-plugged", "status": "completed", "tag": "dbd30c62-04ea-4272-a09e-60a610b57a84"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:35.702006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.702530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.702974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.719641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] Creating event network-vif-plugged:dbd30c62-04ea-4272-a09e-60a610b57a84 for instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 on n-h2-831194-21 Oct 04 18:21:35.733628 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-67e703cf-a6e6-4da8-8ec2-2d74e28d9cc5 req-6b572530-fb08-40c1-abdf-7ab270d2f490 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062553 Oct 04 18:21:35.735224 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2848/5563] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:35.883196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:35.888196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.889956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.897594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d1a21cd-71b0-496e-96b2-8339b958a5e6 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.370700 Oct 04 18:21:35.898744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2716/5564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:35.906669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.915810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.917693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.919774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.920642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.928295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.933364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:35.934542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] [instance: 822485e1-d0c7-4c5a-959d-5a0ddd55d640] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:35.950723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.952913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.953446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:35.955429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:35.960096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:35.960888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.010606 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] HTTP exception thrown: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Request method failure captured: Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 HTTP/1.1 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHcnOuDdASleYlzp2tIZE38CifNAZ22JEv--G3zoRqoQ6fy9YuccKzQL8M7asQjqp3GQgNehcm9CoYBeEskn2C6_e7hKTJMSWyGjT-hLO_w2cK17lYlHi-a_I7qR043lNtRMu3psLedV8hRXmeXS24XX5hEdzSq4lTvKnRRbI5fbmAU Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2d3a8d459e664953940ec74e2b29e60c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2d3a8d459e664953940ec74e2b29e60c Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1926388753 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 660c26677c2540f5a005dcd39c069e23 Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1926388753-project Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '822485e1-d0c7-4c5a-959d-5a0ddd55d640'} Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:36.016095 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Returning 404 to user: Instance 822485e1-d0c7-4c5a-959d-5a0ddd55d640 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8a55f5b-039c-4095-a88a-23145bb2df9a tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640" status: 404 len: 111 microversion: 2.1 time: 0.089004 Oct 04 18:21:36.021700 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2717/5565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/822485e1-d0c7-4c5a-959d-5a0ddd55d640 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:36.029019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ec6503a-cf5a-4412-a684-6d09ddeefb28 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] Calling method '.version_select at 0x7fbdbc9319d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.085764 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ec6503a-cf5a-4412-a684-6d09ddeefb28 tempest-ServerActionsTestJSON-1926388753 tempest-ServerActionsTestJSON-1926388753-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945524168" status: 202 len: 0 microversion: 2.1 time: 0.060396 Oct 04 18:21:36.086822 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2718/5566] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:21:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1945524168 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:36.357264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.358015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.379586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.380321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.382551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.383456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.383931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.384372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.397626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f41d2018-00a8-4665-9e7a-3da20a0ee389 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.514397 Oct 04 18:21:36.398272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2849/5567] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:35 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:36.817280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:36.840526 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cffbd16d-d41c-4d6e-8241-c36f291bbb52 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.486336 Oct 04 18:21:36.842353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2719/5568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:36.927617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:36.928237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:36.937444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.938045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.938731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:36.943608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:36.944510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:36.945342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.155377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:37.164183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7991a07b-ce81-41cf-ade3-224e4bfbb139 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.242534 Oct 04 18:21:37.165790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2850/5569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:36 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:37.421413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.422198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.429354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.429870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.430491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.431376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.431981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.432555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.800242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:37.851529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdb05f2e-7c4e-45c4-a7f9-16604ac18f61 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1465 microversion: 2.1 time: 0.434410 Oct 04 18:21:37.852912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2720/5570] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1465 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:37.865724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:37.866760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:37.873585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.874140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.874588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:37.875313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:37.875840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:37.876317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.139137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.149278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d256c5db-d10f-4467-b7bc-27f52577de7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.288133 Oct 04 18:21:38.154701 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2851/5571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:37 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.194523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.195162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.205663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.208886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.209595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.213049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.213705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.214966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.494891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:38.515697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cb2766a-145b-45c2-8b79-ad79d16a6dc2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.325035 Oct 04 18:21:38.516509 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2721/5572] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:38.877435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:38.878455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:38.881233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:38.888337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.889321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.890136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:38.891344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:38.891964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:38.892665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.178111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.178771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.181567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=18 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:39.193244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.204619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.205976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.206774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.224663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.225247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.537622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-874c01c4-d7e7-4b9b-a273-4c45a725c27e tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1649 microversion: 2.1 time: 0.664902 Oct 04 18:21:39.540564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2852/5573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:38 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1649 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:39.558144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.560261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.571034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.571529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.572034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.572748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.572864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:39.573202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.573628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.583229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d8c7b6b-14b8-4c5b-9ea9-57acf70f93d2 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.411773 Oct 04 18:21:39.587914 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2722/5574] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:39.592945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.593564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.600757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.601503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.602178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.603094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.603795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.604434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.766304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:39.778537 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-841ff17d-ee5a-44b4-80d0-976288fa4517 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.235548 Oct 04 18:21:39.779917 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2853/5575] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:39.829232 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-acbdb9a3-29fe-49b3-8c26-664f3b122c39 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1649 microversion: 2.1 time: 0.239681 Oct 04 18:21:39.830588 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2723/5576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1649 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:39.867332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:39.868318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:39.871040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:39.887696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.888313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.888891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:39.889720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:39.890275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:39.890780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.360614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e00c15d0-12e4-420e-9925-e2b96d1da6ab tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1649 microversion: 2.1 time: 0.498919 Oct 04 18:21:40.361334 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2854/5577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:39 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1649 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:40.390252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.397496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.417759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.420573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.422468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.425557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.426651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.427633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.494344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:40.622356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.623584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.637629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.638602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.639827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.642968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.643841 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3731ee05-eeac-48d0-8ecc-ae706ce34ef9 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 204 len: 0 microversion: 2.1 time: 0.259660 Oct 04 18:21:40.644427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.647270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.648062 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2724/5578] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:40 2022] DELETE /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:40.673004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.676276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.685215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.686332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.688106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.689158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.690310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.690828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.945706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c0d5b7d-1e18-457a-94b0-412b82898ade tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1655 microversion: 2.1 time: 0.293675 Oct 04 18:21:40.951531 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2725/5579] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1655 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:40.973087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:40.974888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:40.980754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:40.983304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.984055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.984726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.986491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:40.987134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:40.988173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:40.996585 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21739c78-1608-47bd-818c-83b7480d6bfe tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.381205 Oct 04 18:21:40.997971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2855/5580] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:41.009944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2866ad1f-4e10-495a-ad65-b82dfeccaf17", "name": "network-vif-plugged", "status": "completed", "tag": "ce395a62-142c-4a6d-9bd7-35d569034f32"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:41.028165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:41.028165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:41.028493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:41.043880 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] Creating event network-vif-plugged:ce395a62-142c-4a6d-9bd7-35d569034f32 for instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 on n-h1-831194-21 Oct 04 18:21:41.071248 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3eccbdae-6fbe-459e-829b-2361af6a652c req-ea7dfcb7-b366-4b26-8f1f-365de8dc1276 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065260 Oct 04 18:21:41.072497 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2856/5581] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:41.263226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:41.272856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ceda458b-804c-49c9-b1c3-627c416baaeb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.319996 Oct 04 18:21:41.274115 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2726/5582] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:40 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:41.989796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:41.991238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.007236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.008285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.009883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.016890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.027129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.028554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.035055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.043897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.053647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.059255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.068297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.070215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.074130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.090291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.503353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:42.515414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-730d3e19-34a2-4dd9-91b1-e9af6a9e89c6 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1374 microversion: 2.1 time: 0.492062 Oct 04 18:21:42.518937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2727/5583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:42 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1374 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:42.528377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:42.529901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:42.576705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c6f9f3a-699a-4efc-9af0-4b39a76b0065 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1655 microversion: 2.1 time: 0.600338 Oct 04 18:21:42.578442 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2857/5584] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:41 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1655 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:42.593211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.593802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.594368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:42.596108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:42.596914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:42.597634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.014980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:43.044555 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d42e0265-f6ba-4bfe-baa6-a27fe05f2002 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.521082 Oct 04 18:21:43.045288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2728/5585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:42 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:43.429413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa12d96-5ef8-4737-8838-a72b3045aee3", "name": "network-vif-deleted", "tag": "dbd30c62-04ea-4272-a09e-60a610b57a84"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:43.458954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.480797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.481963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.512138 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] Creating event network-vif-deleted:dbd30c62-04ea-4272-a09e-60a610b57a84 for instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 on n-h2-831194-21 Oct 04 18:21:43.545749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.546333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.562679 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-054bfed1-6696-4ba3-8f74-1e7c5d7a7a7c req-1e47982c-a172-4952-973b-ebf0dee18be8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138319 Oct 04 18:21:43.566122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.568194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.568895 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2858/5586] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:43.569218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.570140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.570734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.571176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.615865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:43.616827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:43.647440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.648014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.652474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.653501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.654219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.654835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.752016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:43.752518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:43.755652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:43.757869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lazy-loading 'fault' on Instance uuid 4fa12d96-5ef8-4737-8838-a72b3045aee3 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:43.932370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4c2a61a-ba89-4fd7-acc9-aaab04079e9b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 200 len: 1455 microversion: 2.1 time: 0.322030 Oct 04 18:21:43.932989 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2859/5587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 1455 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:44.070544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.071185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.078362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.079253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.080084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.084592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.085074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.085556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.471186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.485471 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd310819-fbb3-4543-bc3b-daa3e4e539f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.415773 Oct 04 18:21:44.506690 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2860/5588] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.549355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.554345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:44.566577 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60efc1e7-b1d4-4177-8fd3-3812ee27533d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1547 microversion: 2.1 time: 1.025463 Oct 04 18:21:44.568584 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2729/5589] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:43 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1547 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.590467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.591721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.599209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.599905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.600500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.601522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.602205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.602939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.772564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:44.781911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23a15775-45b9-4647-943a-9d4b09e4f939 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1547 microversion: 2.1 time: 0.195249 Oct 04 18:21:44.794479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2861/5590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1547 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:44.964253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:44.965019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 4fa12d96-5ef8-4737-8838-a72b3045aee3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:44.979813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.980569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.981229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:44.984546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:44.985227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:44.986105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.008817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] HTTP exception thrown: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Request method failure captured: Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 HTTP/1.1 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHmL6JmmT-6TkGWpBwh03OWZunzs0_A5KZT2tlZiDYKVF-xdLFjtIqtJwEFYDpyTXt-gM_pfhojmLhf5H1zsL1SAljURWE94hDIg9XjQtgJEVs_xjCNhrZAEN2Ti9M7rOqTLsl17YCxGs-O-kXTgoCPWsPztYC9BAws9nPBqNIWYhxs Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 05f9260127d84cd2870f64e3fae1ccc0 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestServerMultinode-1669114797 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestServerMultinode-1669114797 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 05f9260127d84cd2870f64e3fae1ccc0 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestServerMultinode-1669114797 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestServerMultinode-1669114797-project-admin Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 8ee545450d0844f7b4eda7a440a6e838 Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestServerMultinode-1669114797-project-admin Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4fa12d96-5ef8-4737-8838-a72b3045aee3'} Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:45.011482 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. Oct 04 18:21:45.016933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:45.020273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Returning 404 to user: Instance 4fa12d96-5ef8-4737-8838-a72b3045aee3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:45.021516 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80da4dc6-bbff-4e5a-871d-d935ca2c25a4 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3" status: 404 len: 111 microversion: 2.1 time: 0.060822 Oct 04 18:21:45.022794 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2730/5591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:44 2022] GET /compute/v2.1/servers/4fa12d96-5ef8-4737-8838-a72b3045aee3 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:21:45.032588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.033095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.046832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.047333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.050665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.051528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.052012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.052451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.122969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:21:45.243516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c612644-4413-490f-a002-a4c19ee4555b tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "DELETE /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 204 len: 0 microversion: 2.1 time: 0.213639 Oct 04 18:21:45.245059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2862/5592] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:21:45 2022] DELETE /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:21:45.253510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.254449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.265348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.266075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.267397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.268307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.274836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.275509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.507300 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec3803ea-0bd7-4b73-ae47-3f1c071b3296 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1656 microversion: 2.1 time: 0.257904 Oct 04 18:21:45.509865 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2731/5593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1656 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:45.527022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:45.527885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:45.538403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.540863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.541332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.542112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:45.547784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:45.549506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:45.554425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:45.901860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:45.917980 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d345dee2-8370-4486-b0d2-78dc28f20594 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.407585 Oct 04 18:21:45.918576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2863/5594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:45 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.537412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:46.538307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.550055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.551087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.575487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.578681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.583066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.584187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.809024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82a1719f-f1b1-4810-b856-135e7174d273 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1656 microversion: 2.1 time: 0.276341 Oct 04 18:21:46.822622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2732/5595] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:46 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1656 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:46.943216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:46.944678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:46.967430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.968362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.971562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:46.973377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:46.977598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:46.978427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.473028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:47.493190 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1512fc5c-59ff-477c-88b5-fcafb4fd5526 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.555556 Oct 04 18:21:47.493801 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2864/5596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:46 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:47.835068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:47.835972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:47.849316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.850131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.850658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:47.857008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:47.857599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:47.858142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.065193 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e999f9d-d9d6-4db8-bdd2-7c4522ed1bb2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1614 microversion: 2.1 time: 0.232517 Oct 04 18:21:48.108934 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2733/5597] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:47 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1614 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:48.179409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e3ca933-333d-4f7c-833d-5fafc517413e", "name": "network-vif-deleted", "tag": "5b4d06dc-c830-4688-8980-ccd16bfe172d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:48.194512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.195311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.196111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.210922 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] Creating event network-vif-deleted:5b4d06dc-c830-4688-8980-ccd16bfe172d for instance 5e3ca933-333d-4f7c-833d-5fafc517413e on n-h1-831194-21 Oct 04 18:21:48.219064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0a4d0992-a30a-40fe-b115-272f299dc154 req-4be6110c-5557-415d-820c-61dd74b61acb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044274 Oct 04 18:21:48.220020 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2865/5598] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:21:48.529787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:48.530686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:48.540466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.543819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.544922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.547437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.550277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.551228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:48.819718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:48.834068 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-846688ae-0c38-4684-b6d7-88e7997ca4c2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.310154 Oct 04 18:21:48.837460 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2734/5599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:48 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:48.894328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2866ad1f-4e10-495a-ad65-b82dfeccaf17", "tag": "ce395a62-142c-4a6d-9bd7-35d569034f32"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:48.942416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:48.950380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:48.957218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.045406 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] Creating event network-changed:ce395a62-142c-4a6d-9bd7-35d569034f32 for instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 on n-h1-831194-21 Oct 04 18:21:49.096745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.098376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.109897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0eb51ce9-f9af-4635-aaa4-4442ce67640e req-8414b2c4-d3cc-4898-97eb-0f77ec8182af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.227767 Oct 04 18:21:49.111600 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2866/5600] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:21:49.132561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.134470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.135240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.138774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.140141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.145304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.254933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.258107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.258570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.259047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lazy-loading 'fault' on Instance uuid 5e3ca933-333d-4f7c-833d-5fafc517413e {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:21:49.427522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c95fff13-5e6e-497f-8380-5f1340804862 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 200 len: 1456 microversion: 2.1 time: 0.332161 Oct 04 18:21:49.429221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2735/5601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 1456 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:49.658999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:49.697343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.698419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.699926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.783419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:21:49.863312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.865384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.879431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.880994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.881819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.899413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.902064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.903858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.912397 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9aca0b83-aa9e-4c7e-8b2d-13de3014dcac tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action" status: 202 len: 0 microversion: 2.1 time: 0.265502 Oct 04 18:21:49.927598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2867/5602] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:49 2022] POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:21:49.944842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:49.945602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:49.969348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.972742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.973462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:49.977043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:49.978149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:49.978756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.284766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.295194 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-194fca16-0c60-42ae-94de-bd0344373600 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.438464 Oct 04 18:21:50.296566 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2736/5603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:50.456706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:50.457444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] [instance: 5e3ca933-333d-4f7c-833d-5fafc517413e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:50.469410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.472490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.473771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.475578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:50.476254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:50.476880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:50.511913 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] HTTP exception thrown: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Request method failure captured: Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e HTTP/1.1 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHmL6JmmT-6TkGWpBwh03OWZunzs0_A5KZT2tlZiDYKVF-xdLFjtIqtJwEFYDpyTXt-gM_pfhojmLhf5H1zsL1SAljURWE94hDIg9XjQtgJEVs_xjCNhrZAEN2Ti9M7rOqTLsl17YCxGs-O-kXTgoCPWsPztYC9BAws9nPBqNIWYhxs Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 05f9260127d84cd2870f64e3fae1ccc0 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestServerMultinode-1669114797 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_05f9260127d84cd2870f64e3fae1ccc0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestServerMultinode-1669114797 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 05f9260127d84cd2870f64e3fae1ccc0 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestServerMultinode-1669114797 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestServerMultinode-1669114797-project-admin Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 8ee545450d0844f7b4eda7a440a6e838 Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestServerMultinode-1669114797-project-admin Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5e3ca933-333d-4f7c-833d-5fafc517413e'} Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:21:50.516269 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. Oct 04 18:21:50.520648 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:21:50.524138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] Returning 404 to user: Instance 5e3ca933-333d-4f7c-833d-5fafc517413e could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:21:50.526416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6db5ba0d-18d0-43d9-8f2c-d10020caf3f2 tempest-TestServerMultinode-1669114797 tempest-TestServerMultinode-1669114797-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e" status: 404 len: 111 microversion: 2.1 time: 0.075708 Oct 04 18:21:50.531715 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2737/5604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:50 2022] GET /compute/v2.1/servers/5e3ca933-333d-4f7c-833d-5fafc517413e => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:21:50.690020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:50.703690 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bedcfeb4-5374-4a6d-bdde-fcfaa8394faa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.774660 Oct 04 18:21:50.708250 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2868/5605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:49 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:51.319448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:51.320121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:51.332169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.332664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.333125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.333801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.334288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.334713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.732654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:51.733265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:51.738090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:51.740240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.740734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.741162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.747856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:51.748520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:51.749485 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f36401f4-b0e6-41f6-b1e1-e9b8a1e18b75 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.433562 Oct 04 18:21:51.750156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:51.750734 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2738/5606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:51 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:52.691090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:52.700703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06e04cb4-96ea-4174-9466-29d68917e5d7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.971885 Oct 04 18:21:52.709778 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2869/5607] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:51 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:52.775001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:52.775828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:52.786143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.799027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.799678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:52.800733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:52.801451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:52.802178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.004936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:53.014086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b33dedaf-d55a-4eac-875b-d0d3158328f5 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.242790 Oct 04 18:21:53.014717 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2739/5608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:52 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:53.737142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:53.737902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:53.745659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.746446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.748833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:53.749865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:53.750700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:53.751406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.039386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:54.040777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:54.067858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.070847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.072940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.077794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:54.086166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:54.087189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:54.090203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.121072 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b03b79d-3869-4b04-a0fd-8fcfc4505835 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.388261 Oct 04 18:21:54.124220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2870/5609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:53 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:54.376903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:54.387576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-59e3d0ef-85ce-4a6e-8d1f-34d91410f31f tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.352345 Oct 04 18:21:54.389128 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2740/5610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:54 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:55.150160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.151024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.160111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.160813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.161421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.163103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.164267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.165992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.426817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:55.431568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:55.470327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.471175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.472308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:55.474400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:55.478879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:55.481144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:56.269429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.284768 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b374887e-a176-4883-b73d-af48c3b13c0d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 1.139525 Oct 04 18:21:56.285401 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2871/5611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:56.479779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:56.492832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8a3b464-ed0a-44f4-9a19-c8362ea920f3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 1.082679 Oct 04 18:21:56.495039 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2741/5612] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:55 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:57.309269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.309813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.334389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.340597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.341430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.345075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.350721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.350872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.521336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:57.522706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:57.540566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.548778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.549536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.550468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:57.552384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:57.553170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:57.935327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:57.964763 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-40d1f695-ee81-4436-8a16-eec3a4c86a2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.653296 Oct 04 18:21:57.967639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2872/5613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:58.725368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:58.734545 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0907cbb2-b665-4c12-a615-d5a403296f12 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1485 microversion: 2.1 time: 1.217893 Oct 04 18:21:58.737592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2742/5614] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:57 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1485 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:21:58.766778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:58.767129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.781513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.782333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.783128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.784068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.784694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.785883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.821187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-927587214", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "301f6002-b4b7-4e26-83a7-df34f5f5024f"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:21:58.921458 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-343621c0-ec64-4e4c-a6b4-4392f314ce82 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "POST /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846/action" status: 202 len: 0 microversion: 2.1 time: 0.157038 Oct 04 18:21:58.927851 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2743/5615] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:21:58 2022] POST /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:21:58.940563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:58.941422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:58.950189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.950776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.951311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.952342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:58.952868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:58.953363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:58.957110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] validate_networks() for [('301f6002-b4b7-4e26-83a7-df34f5f5024f', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:21:59.559817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:21:59.573687 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3829fd8-d1fc-402b-bb1d-85c3e3da7b1e tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1493 microversion: 2.1 time: 0.643000 Oct 04 18:21:59.576956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2744/5616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:58 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1493 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:21:59.590059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:21:59.590059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:21:59.598209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:21:59.615011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.617370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.619281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:21:59.622434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:21:59.627416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:21:59.628714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.126765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.170161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b173689-4248-4d4a-ac68-1fd777061822 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.590295 Oct 04 18:22:00.174382 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2745/5617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:21:59 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:00.199222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:00.199682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:00.200102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:00.200513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:00.200928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:00.222791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.223300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.223742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.224489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.224952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.225381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.287179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Getting quotas for project 8d23407c916041519b70f35937fc31ce. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:00.296426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Getting quotas for user 6b58d89e8fbc40a79683c03eeb1e7174 and project 8d23407c916041519b70f35937fc31ce. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:00.320812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:00.323601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:00.415377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-02fe1d8f-661c-4ed8-bed9-94befc8e3278 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.113333 Oct 04 18:22:00.418220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2873/5618] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:21:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2117 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:00.428714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fad44acc-118a-4f88-b260-78bccebdc321 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.429335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fad44acc-118a-4f88-b260-78bccebdc321 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.540243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fad44acc-118a-4f88-b260-78bccebdc321 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:00.557272 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fad44acc-118a-4f88-b260-78bccebdc321 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1216 microversion: 2.1 time: 0.132656 Oct 04 18:22:00.569853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2746/5619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:00.610064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:00.611142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:00.628704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.632891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.634600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:00.635391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:00.635875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:00.636315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.000830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.021296 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2160f0d1-30a6-4c80-9fdb-cacba07f8b71 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1493 microversion: 2.1 time: 0.418632 Oct 04 18:22:01.022104 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2874/5620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:00 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1493 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:01.212955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.213589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.236724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.237302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.237760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.238554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.239018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.239439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.306213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:01.573290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.585329 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a60a09c-1225-4fa1-9ade-dcb7f9c3a8fa tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.386548 Oct 04 18:22:01.585566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:01.586290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:01.601195 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2747/5621] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:01.601404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.601404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.601404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.601404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:01.601404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:01.601799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:01.722058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:01.731723 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb98484f-402e-4d90-8d1e-ee5bdd38845f tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1212 microversion: 2.1 time: 0.151220 Oct 04 18:22:01.747091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2875/5622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:01 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.045432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.046483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.068491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.069005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.069470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.070237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.070693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.071119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.366703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.378001 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bbd3b821-96ea-4e31-8a3a-aacad23477a3 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1499 microversion: 2.1 time: 0.336105 Oct 04 18:22:02.412432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.413447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.415874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2748/5623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1499 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.443680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.447561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.448289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.449052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.451120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.451621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.539802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:02.616267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.617316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.633900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.634920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.635582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.637415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.638210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.639125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.764429 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f21a6133-d8e6-41cb-9c72-b7b7e0c5bef2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "DELETE /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 204 len: 0 microversion: 2.1 time: 0.358028 Oct 04 18:22:02.770081 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2876/5624] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:02 2022] DELETE /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:02.777410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.778569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.788180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.789083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.789762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.790930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.799520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.800406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.917903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:02.931044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e64f198d-ef97-4484-bbcc-0bd1610facc9 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1286 microversion: 2.1 time: 0.158972 Oct 04 18:22:02.935078 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2877/5625] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:02.944351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:02.949557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:02.974560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.976050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.980437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:02.981409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:02.983987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:02.984796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.313647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:03.313647 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56abe132-bd41-4257-a1b8-bcdb614778eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.574838 Oct 04 18:22:03.313647 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2749/5626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:03.401759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:03.420092 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0c123dd2-ea4b-4593-ac2b-cf20f9799bdb tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.481434 Oct 04 18:22:03.421001 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2878/5627] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:02 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:03.964145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:03.969281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:03.987267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.990999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.991461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:03.994775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:03.995275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:03.995726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.195408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.217298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.217937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.233618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.236630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.237203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.239122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.239613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.241891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.242117 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aac21a1c-e0a2-46f1-a623-aa8d44548404 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1274 microversion: 2.1 time: 0.280257 Oct 04 18:22:04.246055 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2750/5628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:03 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1274 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:04.254212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:04.453104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:04.454447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:04.475812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.476520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.477132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.478066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:04.478827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:04.479561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:04.551089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:04.566578 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d9ad3682-c81f-4100-adae-e1308466f61e tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.355357 Oct 04 18:22:04.567950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2879/5629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:05.175758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.196338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00856b31-cc88-41bd-a736-7c16ad01cac8 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.753196 Oct 04 18:22:05.197502 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2751/5630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:04 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:05.276095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.277941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.314003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.317668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.320202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.321061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.324006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.324902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.594817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:05.595608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:05.602493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.604953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.607122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.609454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:05.615772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:05.618656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:05.621865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:05.650426 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c905a5fe-07f2-4a32-acd7-69dead90bd9e tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.385261 Oct 04 18:22:05.655539 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2880/5631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:06.082402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.092742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-74a439b3-5aad-4a6c-a759-f43cdd3c75dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.502015 Oct 04 18:22:06.093349 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2752/5632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:05 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.228234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.229588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.242237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.244180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.245172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.248370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.248909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.249364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.492991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:06.507505 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1c94614e-687b-452b-a9f6-9c75fff3c1d4 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1505 microversion: 2.1 time: 0.284486 Oct 04 18:22:06.513882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2881/5633] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:06.679383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:06.680016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:06.689458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.694335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.694809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.695578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.696054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.696489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.891381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e29e83-ef82-4b95-b8d6-6a14ea576846", "name": "network-vif-deleted", "tag": "9d162a66-32c8-44bd-b4ba-de44fc272c6d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:06.910384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:06.914350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:06.915152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:06.945883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] Creating event network-vif-deleted:9d162a66-32c8-44bd-b4ba-de44fc272c6d for instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 on n-h2-831194-21 Oct 04 18:22:06.952884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-edc5d733-6246-4d46-a9bd-f744e46ceb6f req-f5a2b7a7-e4f5-475a-9f41-619b9286828d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066843 Oct 04 18:22:06.961407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2882/5634] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:07.120977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.121722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.135789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.136389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.136855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.138340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.140055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.140520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.362076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.372120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fdb77d5-05cb-4a21-b6ae-b435f1b04d19 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.697379 Oct 04 18:22:07.400081 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2753/5635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:06 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.507055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.516132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-792f1286-a42b-4f57-bf1a-e70afce6930a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.402425 Oct 04 18:22:07.525927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2883/5636] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:07.538872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:07.539478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:07.545661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.546401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.546877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.548218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.548691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.549109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.650312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:07.650807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:07.651419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:07.652018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lazy-loading 'fault' on Instance uuid 34e29e83-ef82-4b95-b8d6-6a14ea576846 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:07.795537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:07.841642 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e2515ec-b4e6-4ed0-b671-e619cbe51d3d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 200 len: 1304 microversion: 2.1 time: 0.305837 Oct 04 18:22:07.845743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2754/5637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:07 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 1304 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:08.052861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e38bd99-6201-46cd-82c5-9050e6b4a0dd", "tag": "1a6ce8e6-0784-44ce-9965-d65d8aab03aa"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:08.089026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.091578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.117700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.153393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] Creating event network-changed:1a6ce8e6-0784-44ce-9965-d65d8aab03aa for instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd on n-h1-831194-21 Oct 04 18:22:08.164896 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-34e9635b-efe1-420b-b469-5fab7d1df771 req-68cf6b89-2b3b-412a-a4fa-0c5c862fec62 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116088 Oct 04 18:22:08.165613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2884/5638] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:08.401688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.402717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.411560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.412317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.412993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.414022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.414762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.415432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.552965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.554573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.566101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.566847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.567456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.569016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.569667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.570335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.779287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:08.788402 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd83cf44-99a5-4915-86ce-98fb0be6a7d5 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.390453 Oct 04 18:22:08.789283 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2755/5639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:08.807758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:08.823175 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-512ec3f1-fc39-4dc2-a5c3-b5bfae60c6e3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.271750 Oct 04 18:22:08.837812 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2885/5640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:08.870479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.871114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 34e29e83-ef82-4b95-b8d6-6a14ea576846] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.884145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.884662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.885144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.886792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.887684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.888351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.915820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] HTTP exception thrown: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Request method failure captured: Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 HTTP/1.1 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHlKAuzvr80-j6_LMUOrLGyRmMprxy7-26okGIUv7Bt4kCKA11pySlzKLLw_yRPH2p3uHw8ObHPNTky7wB67__MtVeFdRe5JUQQu1Bv289GITVU7LNo5oEhkfsWqvLUzNok8bU8P-6phIC54onYRuH5M5WrTpWgqR68GDkSkGrBQyDY Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d91b800263eb4b17aa644ab19fd2f1f2 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d91b800263eb4b17aa644ab19fd2f1f2 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueTestJSON-1137090519-project Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f3fcc65b9bca48ba83da599eadf6d99b Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueTestJSON-1137090519-project Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '34e29e83-ef82-4b95-b8d6-6a14ea576846'} Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:08.917523 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Returning 404 to user: Instance 34e29e83-ef82-4b95-b8d6-6a14ea576846 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-21ae786f-01c8-42f5-848f-c818146ba563 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846" status: 404 len: 111 microversion: 2.1 time: 0.053511 Oct 04 18:22:08.922456 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2756/5641] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:08 2022] GET /compute/v2.1/servers/34e29e83-ef82-4b95-b8d6-6a14ea576846 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:08.929491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:08.930108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:08.936501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.937117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.940081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.940812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:08.941297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:08.941757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:08.972103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:09.078349 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-646ec806-c04e-465e-a9d2-a8765bf496c9 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 204 len: 0 microversion: 2.1 time: 0.153027 Oct 04 18:22:09.080047 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2886/5642] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:08 2022] DELETE /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:09.088753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.089522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.097078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.098004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.098669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.099713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.100190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.100835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.310187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:09.316069 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84e19f24-c82e-4844-92fb-dca8a0bc0535 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1492 microversion: 2.1 time: 0.231894 Oct 04 18:22:09.319164 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2757/5643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1492 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:09.814789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.815588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.818646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:09.826244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.827082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.827702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.829686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.830206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.830647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.864697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:09.870373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:09.905479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.905479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.906867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:09.907944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:09.908425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:09.908885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.252889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.254537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:10.272413 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eed00b26-adf7-4980-92d3-5a7f66023246 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.418918 Oct 04 18:22:10.287134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2758/5644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.290684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.300753 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1c3c78d-b143-4e5c-a196-34d36ec77067 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.492206 Oct 04 18:22:10.308932 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2887/5645] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:09 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.346816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:10.347571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.357972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.359119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.360272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.361210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.362125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.362833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.547989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:10.595770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:10.610208 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab15ebdb-ece7-4e20-a68d-c00c426a210d tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1492 microversion: 2.1 time: 0.269307 Oct 04 18:22:10.621863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2759/5646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:10 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1492 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:10.854617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:10.857084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:10.864326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:10.868075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.868662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.869457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:10.873888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:10.876264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:10.876802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.315883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.316671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.325513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.326140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.326609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.327280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.327983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.328879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.527660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.538156 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d7be07b-cd69-45cf-8cd1-838085e4d3ca tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.228882 Oct 04 18:22:11.539755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2760/5647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:11.544674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.545565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.560952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.562005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.563344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.564108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.564609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.565126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.742561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.751641 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6fbc2543-53f4-4312-8261-0aa8e2c7837a tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.210589 Oct 04 18:22:11.752500 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2761/5648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:11.757196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:11.757801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:11.764014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.764530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.765173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.765941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:11.766560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:11.767188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:11.927084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:11.936564 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4334a58-83d3-4b6f-adb3-174f30c66b43 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1492 microversion: 2.1 time: 0.182768 Oct 04 18:22:11.937172 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2762/5649] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:11 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1492 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.310309 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e1618da-29aa-443d-b0ff-c97e3538134e tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17/action" status: 200 len: 24569 microversion: 2.1 time: 1.460007 Oct 04 18:22:12.317879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2888/5650] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:10 2022] POST /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17/action => generated 24569 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:12.566347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.567797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.580041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.581244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.582136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.583390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.584346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.586522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.783860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.784959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.793325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.794017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.794618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.795538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.796155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.796856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.957586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.966432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-38e268b8-74e8-4a99-8a69-e22172519679 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.406857 Oct 04 18:22:12.978093 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2763/5651] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:12.978346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:12.978461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:12.978461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:12.984691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34581530-0010-4657-a13b-8a3b04964464 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.213513 Oct 04 18:22:12.986183 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2889/5652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:12.991513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:12.992234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:12.992832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:12.993698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.007173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.007913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.033148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:13.659615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:13.673736 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d846ac2d-1a09-419a-8f2e-fc39b3fb6ac2 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1492 microversion: 2.1 time: 0.700535 Oct 04 18:22:13.674921 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2764/5653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:12 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1492 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:13.949802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3195776e-6650-4052-a373-1b907e21cfe5", "name": "network-vif-deleted", "tag": "bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:13.974335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:13.975524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:13.976623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:13.993362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:13.994049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:13.998275 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] Creating event network-vif-deleted:bee1b7fd-3cfd-4c3f-b2c7-2eaa2ad72175 for instance 3195776e-6650-4052-a373-1b907e21cfe5 on n-h1-831194-21 Oct 04 18:22:14.003804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.008372 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cbaf7517-cd60-4dec-bb4c-e04da1455601 req-13e6668a-ac6a-4d4e-90b8-a2a389105dcf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066677 Oct 04 18:22:14.008734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.009358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.010217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2890/5654] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:14.010335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.010805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.011244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.019273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.031119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.084920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.085969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.086158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.087296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.092896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.094301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.314929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.346216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a9cc3d3-e41f-4fc5-8b0c-1ed93abb6c5c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.356301 Oct 04 18:22:14.363457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2765/5655] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:13 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.372336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.375783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e38bd99-6201-46cd-82c5-9050e6b4a0dd", "name": "network-vif-plugged", "status": "completed", "tag": "1a6ce8e6-0784-44ce-9965-d65d8aab03aa"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:14.386782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.387555 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a555c040-3926-4422-b069-1c756f953717 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.373399 Oct 04 18:22:14.387754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.388335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.388821 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2891/5656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:14.403772 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] Creating event network-vif-plugged:1a6ce8e6-0784-44ce-9965-d65d8aab03aa for instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd on n-h1-831194-21 Oct 04 18:22:14.413282 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-06dd2535-3294-4665-8829-5ba719e08963 req-59b884af-0a0b-4fd5-bd1a-52968e766bcf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047159 Oct 04 18:22:14.414504 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2766/5657] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:14.700621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:14.702215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:14.711563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.712408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.713419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.714681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.715551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.716157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.805378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:14.805918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:14.806371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:14.807056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lazy-loading 'fault' on Instance uuid 3195776e-6650-4052-a373-1b907e21cfe5 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:14.862820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3fcc65b9bca48ba83da599eadf6d99b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd91b800263eb4b17aa644ab19fd2f1f2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:14.871565 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72fb84f4-f7ea-47c4-aa6e-fd3df4f91666 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 200 len: 1304 microversion: 2.1 time: 0.175623 Oct 04 18:22:14.872325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2892/5658] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:14 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 1304 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:15.379065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.380785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.387532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.388050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.388517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.389286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.389839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.391040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.416085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.416700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.423995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.424486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.424919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.425618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.426102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.426524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.552430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.562046 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb21e86a-736f-4919-aaa4-cf4d79b1a1c1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.189067 Oct 04 18:22:15.563609 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2767/5659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:15.614282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:15.622736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f98b9d58-cbc3-4261-a674-74d7d312fe0b tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1316 microversion: 2.1 time: 0.210534 Oct 04 18:22:15.623399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2893/5660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:15.896323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:15.896952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] [instance: 3195776e-6650-4052-a373-1b907e21cfe5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:15.903490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.903996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.904442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.905152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:15.905609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:15.906653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:15.921144 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] HTTP exception thrown: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Request method failure captured: Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 HTTP/1.1 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHlKAuzvr80-j6_LMUOrLGyRmMprxy7-26okGIUv7Bt4kCKA11pySlzKLLw_yRPH2p3uHw8ObHPNTky7wB67__MtVeFdRe5JUQQu1Bv289GITVU7LNo5oEhkfsWqvLUzNok8bU8P-6phIC54onYRuH5M5WrTpWgqR68GDkSkGrBQyDY Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d91b800263eb4b17aa644ab19fd2f1f2 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d91b800263eb4b17aa644ab19fd2f1f2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d91b800263eb4b17aa644ab19fd2f1f2 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueTestJSON-1137090519 Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueTestJSON-1137090519-project Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f3fcc65b9bca48ba83da599eadf6d99b Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueTestJSON-1137090519-project Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3195776e-6650-4052-a373-1b907e21cfe5'} Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:15.923503 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] Returning 404 to user: Instance 3195776e-6650-4052-a373-1b907e21cfe5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a02013ca-d190-46f8-8273-ce2884f2ce78 tempest-ServerRescueTestJSON-1137090519 tempest-ServerRescueTestJSON-1137090519-project] 10.222.0.42 "GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5" status: 404 len: 111 microversion: 2.1 time: 0.032771 Oct 04 18:22:15.928457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2768/5661] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:15 2022] GET /compute/v2.1/servers/3195776e-6650-4052-a373-1b907e21cfe5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:16.592598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.598094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.606985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.607702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.608420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.609427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.610412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.611278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.651831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.652522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.666048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.669327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.670156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.671206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.673594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.674208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.893253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:16.910655 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-607718e2-20fa-4da3-88d8-2e890f0517fa tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1504 microversion: 2.1 time: 0.266944 Oct 04 18:22:16.911615 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2769/5662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1504 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:16.939370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:16.940224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:16.948118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.949582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.950663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.952563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:16.954846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:16.955520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:16.989678 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c25b401-9229-4d9a-bf1a-42f3e356bc70 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips" status: 200 len: 108 microversion: 2.1 time: 0.055282 Oct 04 18:22:16.990426 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2770/5663] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips => generated 108 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:17.004012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.004840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.012497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.013927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.014971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.016214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.016855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.017440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.050357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d9b3d45-30d6-4746-b542-7120edc30950 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips" status: 200 len: 108 microversion: 2.1 time: 0.050853 Oct 04 18:22:17.051917 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2771/5664] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips => generated 108 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:17.069354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.070200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.087514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.088114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.088817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.089669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.090243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.091003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.104370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.116339 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07f38a15-b817-4686-b2bd-d80e5e97d449 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.531580 Oct 04 18:22:17.117251 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2894/5665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:16 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:17.137250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee4c2866-34ae-4d96-be9a-d1a66ac90f6c tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips/tempest-ServerAddressesTestJSON-693027275-network" status: 200 len: 93 microversion: 2.1 time: 0.077269 Oct 04 18:22:17.138191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2772/5666] 10.222.0.42 () {58 vars in 1398 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd/ips/tempest-ServerAddressesTestJSON-693027275-network => generated 93 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:22:17.152960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.153650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.166088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.166816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.167412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.168616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.169309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.169911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.219131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:17.246967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:17.351906 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2a15b57-d004-4b89-a6eb-7d2c428d1f50 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 204 len: 0 microversion: 2.1 time: 0.203762 Oct 04 18:22:17.353022 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2895/5667] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:17 2022] DELETE /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:17.376611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:17.378225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:17.390070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.391814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.393154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.394660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:17.395615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:17.396555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:17.612005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:17.622149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c474d66-a4b7-467a-8634-f81ce302ec25 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1510 microversion: 2.1 time: 0.264511 Oct 04 18:22:17.639050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2773/5668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:17 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1510 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:18.144433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.146241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.155846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.157355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.158147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.159208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.159967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.160719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.525476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.549774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a364f59-551a-4e2c-9cd8-3d055a90c80a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.411687 Oct 04 18:22:18.564254 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2896/5669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:18.651089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:18.651703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:18.660415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.661768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.663189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.664822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:18.665515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:18.666189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:18.910188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:18.945495 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e25009b0-2088-454e-9135-040fe33aabfd tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1510 microversion: 2.1 time: 0.297860 Oct 04 18:22:18.945881 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2774/5670] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:18 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:19.577090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:19.580273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:19.595034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.597619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.598500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.601350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.603890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.604891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.835702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e38bd99-6201-46cd-82c5-9050e6b4a0dd", "name": "network-vif-deleted", "tag": "1a6ce8e6-0784-44ce-9965-d65d8aab03aa"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:19.850680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:19.852365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:19.853139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:19.867846 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] Creating event network-vif-deleted:1a6ce8e6-0784-44ce-9965-d65d8aab03aa for instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd on n-h1-831194-21 Oct 04 18:22:19.887370 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1c51fc8f-824c-4849-b727-84a5833c8e6c req-2aaa7447-c76d-42a5-acf9-b8d270ab7f6b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060149 Oct 04 18:22:19.888766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2775/5671] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:19.983056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:19.983770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:20.005215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.008642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.010123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.012216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.013627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.014119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.030608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.051087 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4cb1aca-f179-4ace-879a-2f994a5a6f72 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1722 microversion: 2.1 time: 0.476221 Oct 04 18:22:20.052100 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2897/5672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:19 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1722 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:20.098841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:20.100077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:20.100913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:20.101713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lazy-loading 'fault' on Instance uuid 6e38bd99-6201-46cd-82c5-9050e6b4a0dd {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:20.159343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b58d89e8fbc40a79683c03eeb1e7174', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d23407c916041519b70f35937fc31ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:20.168544 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f2d93a28-06e4-4425-a621-30941f4c669d tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 200 len: 1306 microversion: 2.1 time: 0.190172 Oct 04 18:22:20.169553 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2776/5673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:19 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 1306 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.075332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.077599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.086330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.086942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.087646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.088674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.089235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.090113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.198869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.207442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] [instance: 6e38bd99-6201-46cd-82c5-9050e6b4a0dd] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.227046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.228274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.229254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.230840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.231867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.232651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.269968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] HTTP exception thrown: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Request method failure captured: Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd HTTP/1.1 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHnF9Saby1C3MqNrz2tlYT8q7csRAsQ-66INxODb7DsTmBgqLbCH4cwLHO_YTyWddHdXSsxKV4TuDeZhNA6n2a5-8y8hKchhTkcpxmbHMmeLmjnI0IbjAxWzGGNY6vN2tCILAyPMycsRmLn7Oc3ZX1gavLqqQ5lA6COc-hMywJ0l2N0 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 8d23407c916041519b70f35937fc31ce Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerAddressesTestJSON-899955927 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/8d23407c916041519b70f35937fc31ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d23407c916041519b70f35937fc31ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/8d23407c916041519b70f35937fc31ce"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_8d23407c916041519b70f35937fc31ce"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerAddressesTestJSON-899955927 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 8d23407c916041519b70f35937fc31ce Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerAddressesTestJSON-899955927 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerAddressesTestJSON-899955927-project Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6b58d89e8fbc40a79683c03eeb1e7174 Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerAddressesTestJSON-899955927-project Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '6e38bd99-6201-46cd-82c5-9050e6b4a0dd'} Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:21.275459 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] Returning 404 to user: Instance 6e38bd99-6201-46cd-82c5-9050e6b4a0dd could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d8485a9-49f3-41e5-a919-650d87a21d53 tempest-ServerAddressesTestJSON-899955927 tempest-ServerAddressesTestJSON-899955927-project] 10.222.0.42 "GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd" status: 404 len: 111 microversion: 2.1 time: 0.084146 Oct 04 18:22:21.279517 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2777/5674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/6e38bd99-6201-46cd-82c5-9050e6b4a0dd => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:22:21.372260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:21.396791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99cea8e9-17ef-4e3a-955f-daa329a288be tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1699 microversion: 2.1 time: 0.325741 Oct 04 18:22:21.397567 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2898/5675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1699 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:21.425172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:21.434962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.435940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.437256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.497205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:22:21.587080 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2642ced5-4674-4c4a-8bcf-1b685a9f7f85 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action" status: 202 len: 0 microversion: 2.1 time: 0.167691 Oct 04 18:22:21.589217 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2778/5676] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:21 2022] POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:21.599136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:21.600402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:21.627356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.630122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.631923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:21.640737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:21.642760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:21.644907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:22.185463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:22.202350 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8402b1d9-a64b-47e8-a2d5-2efcc33a3eb6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1708 microversion: 2.1 time: 0.610206 Oct 04 18:22:22.205996 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2899/5677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:21 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1708 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:23.229626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:23.231226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:23.260065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.260959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.261565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.263428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:23.264008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:23.264536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:23.665706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:23.677448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-59617c5b-0109-4b4b-aee7-e3f7b1c418cf tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1708 microversion: 2.1 time: 0.452197 Oct 04 18:22:23.684372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2779/5678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:23 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1708 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:24.417046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:24.420971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.440791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.443201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.443694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.444436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.446844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.448954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.575573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8486448c-1aab-49df-bafd-7fe9a8a4e2c9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "POST /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17/action" status: 200 len: 32636 microversion: 2.1 time: 0.164061 Oct 04 18:22:24.585265 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2900/5679] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:24 2022] POST /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17/action => generated 32636 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:22:24.715850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:24.716649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:24.745559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.746398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.750373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:24.752166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:24.753610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:24.754361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:25.041760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:25.052087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17012d65-558c-4c71-8f08-4cd149ecba2b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1712 microversion: 2.1 time: 0.341270 Oct 04 18:22:25.052697 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2780/5680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:24 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1712 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:27.954279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:27.955750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:27.972068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.974440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:27.977304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:27.979956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:27.992300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.004047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.047383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2866ad1f-4e10-495a-ad65-b82dfeccaf17", "tag": "ce395a62-142c-4a6d-9bd7-35d569034f32"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:28.068439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:22:28.103597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.104506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.105267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.150280 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] Creating event network-changed:ce395a62-142c-4a6d-9bd7-35d569034f32 for instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 on n-h1-831194-21 Oct 04 18:22:28.162305 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f2d36372-b057-4cb3-ba03-256d2db9e283 req-9698ca76-a56b-41b2-b1f1-dfabda521432 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116486 Oct 04 18:22:28.168266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2781/5681] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:28.382903 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d30ea08b-43f3-48d1-9e8d-8de7bd4bbd06 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 204 len: 0 microversion: 2.1 time: 0.431679 Oct 04 18:22:28.390658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2901/5682] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:22:27 2022] DELETE /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:22:28.397683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:28.398618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:28.412269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.413007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.413625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.414563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:28.415197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:28.415785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:28.790383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:28.802266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7cdc4c70-1dba-4871-9fff-d8004836af91 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1672 microversion: 2.1 time: 0.409442 Oct 04 18:22:28.802871 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2782/5683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:28 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1672 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:28.973154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44ecbcb9-ebbf-47d4-a2b7-f65464b64831 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Action: 'create', calling method: .version_select at 0x7fbdbd1b5a60>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-839959570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGowY0oO/aj1rxGrETCVgzehVh/fUkqlnOnr0bXet1YxR48RUSZMhGMwjpZUpuO/UAG3tylvjCJpopR+eiojRa1LQ8wPlNOoUn1Wex/7OcPU9y/vH808rQVgUfwADRE3HQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:29.016644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-44ecbcb9-ebbf-47d4-a2b7-f65464b64831 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Getting quotas for project b14ec729c6b848c39590ce3dc68a3c93. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:29.030239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-44ecbcb9-ebbf-47d4-a2b7-f65464b64831 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Getting quotas for user d33afdba85ee434996078cf082dd4f63 and project b14ec729c6b848c39590ce3dc68a3c93. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:29.086261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44ecbcb9-ebbf-47d4-a2b7-f65464b64831 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.120638 Oct 04 18:22:29.087260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2902/5684] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:22:28 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:29.832531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:29.834174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:29.844427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=82 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:29.859085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.859655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.861274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:29.864383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:29.864843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:29.865302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:30.350862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:30.366967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bc4fe8f-35de-44e8-9ee4-ada39ede86ef tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1672 microversion: 2.1 time: 0.541111 Oct 04 18:22:30.380680 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2783/5685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:29 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1672 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.401922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:31.402837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:31.420572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.424295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.424861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.425637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.426203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.426740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.610624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:31.636519 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-703c0184-538a-4a24-914f-cc5fc9651f58 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1485 microversion: 2.1 time: 0.236574 Oct 04 18:22:31.643800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2903/5686] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:31 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1485 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:31.798702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2866ad1f-4e10-495a-ad65-b82dfeccaf17", "name": "network-vif-deleted", "tag": "ce395a62-142c-4a6d-9bd7-35d569034f32"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:31.820277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:31.820821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:31.821277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:31.833744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:31.852683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] Creating event network-vif-deleted:ce395a62-142c-4a6d-9bd7-35d569034f32 for instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 on n-h1-831194-21 Oct 04 18:22:31.861949 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-90aa13c6-bab7-4936-88ef-1f05a6a437b9 req-9916d9f9-7754-4681-9170-c31bb0995e75 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067607 Oct 04 18:22:31.863415 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2784/5687] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:32.003621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1781099990", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "a5cff40e-e001-44b5-a6d8-9ad2e005e17b", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-839959570", "security_groups": [{"name": "tempest-secgroup-smoke-4897665"}], "networks": [{"uuid": "85208617-8c9b-42c2-8627-b3a099524f35"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:32.359069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] validate_networks() for [('85208617-8c9b-42c2-8627-b3a099524f35', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:32.687391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:32.690463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:32.699835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.700638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.701234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.702997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.703710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.704776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.789924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:32.791075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:32.791773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:32.792396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lazy-loading 'fault' on Instance uuid 2866ad1f-4e10-495a-ad65-b82dfeccaf17 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:32.914953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef59ce7cca054a4ab3d753723fc00505', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd57cbee648654e9bba91675d9620347f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:32.950202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-70c2a94a-90ab-4f46-bed6-9cf928e387e9 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 200 len: 1338 microversion: 2.1 time: 0.274441 Oct 04 18:22:32.970822 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2785/5688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:32 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 1338 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:33.534690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:33.535615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:33.537912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:33.538345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:33.538763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:33.551739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.552438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.553771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.555432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.557248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:33.558450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:33.587244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Getting quotas for project b14ec729c6b848c39590ce3dc68a3c93. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:33.594252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Getting quotas for user d33afdba85ee434996078cf082dd4f63 and project b14ec729c6b848c39590ce3dc68a3c93. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:33.679175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:33.681966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a5cff40e-e001-44b5-a6d8-9ad2e005e17b',volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:33.985041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:33.986315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] [instance: 2866ad1f-4e10-495a-ad65-b82dfeccaf17] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:33.996997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80ad2883-35fe-469b-9a42-168c7bebd4ec tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.997751 Oct 04 18:22:33.998533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:33.999249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.001555 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2904/5689] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:31 2022] POST /compute/v2.1/servers => generated 403 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:34.008568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.009349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:34.009901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:34.010290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:34.021924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-670cc102-8194-4368-9198-0d07d42a2b79 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:34.023077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-670cc102-8194-4368-9198-0d07d42a2b79 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:34.048762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] HTTP exception thrown: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Request method failure captured: Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 HTTP/1.1 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHisnrFV9hihsYjyUxRTD-LNtRbBwaIU9OblrrMt8acDEcJ4zjRUNbKI4WfUs7XXWZDapDm935pq7KOmPbL0Nh0WH-Ibdn1VzALnlMgsccNGiX78gCDnlKd6n2HpntBYKDdPWXQXNqf6kdu6zyfUBA_WOvpXrM2qCUAEuawy_iBd1xA Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d57cbee648654e9bba91675d9620347f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d57cbee648654e9bba91675d9620347f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d57cbee648654e9bba91675d9620347f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d57cbee648654e9bba91675d9620347f Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkBasicOps-2146261322 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ef59ce7cca054a4ab3d753723fc00505 Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkBasicOps-2146261322-project Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2866ad1f-4e10-495a-ad65-b82dfeccaf17'} Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:22:34.058897 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. Oct 04 18:22:34.064361 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:22:34.069334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Returning 404 to user: Instance 2866ad1f-4e10-495a-ad65-b82dfeccaf17 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:22:34.070872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e272e24d-431a-40ae-a916-f04533819a7d tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17" status: 404 len: 111 microversion: 2.1 time: 0.090499 Oct 04 18:22:34.093913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2786/5690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:33 2022] GET /compute/v2.1/servers/2866ad1f-4e10-495a-ad65-b82dfeccaf17 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:22:34.267085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-670cc102-8194-4368-9198-0d07d42a2b79 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:34.275002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-670cc102-8194-4368-9198-0d07d42a2b79 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1098 microversion: 2.1 time: 0.263010 Oct 04 18:22:34.275670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2905/5691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:34 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1098 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:34.988610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ed5ee37-7a0a-42d4-984b-1c299db510c4 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] Calling method '.version_select at 0x7fbdbc872550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.070397 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ed5ee37-7a0a-42d4-984b-1c299db510c4 tempest-TestNetworkBasicOps-2146261322 tempest-TestNetworkBasicOps-2146261322-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1110446388" status: 202 len: 0 microversion: 2.1 time: 0.086866 Oct 04 18:22:35.074778 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2787/5692] 10.222.0.42 () {58 vars in 1257 bytes} [Tue Oct 4 18:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1110446388 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:22:35.301820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:35.302736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:35.322277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.322620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.324218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.325184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:35.328297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:35.329732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:35.572124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-296231792", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:35.584094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:35.609028 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3026a402-8dc7-42ca-92c3-58e0bf509d2e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1196 microversion: 2.1 time: 0.303918 Oct 04 18:22:35.612001 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2788/5693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:35 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1196 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:35.705360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] validate_networks() for [('26add75d-657d-4fe4-b138-af37bd1ebf20', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:36.639005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:36.640397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:36.654472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.655038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.655617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:36.656313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:36.656764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:36.663858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:37.092201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:37.115518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6fa6ce4b-18b8-469c-aaf7-04fda5fb0cf6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.480701 Oct 04 18:22:37.118598 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2789/5694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:36 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:38.145600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.146295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:38.157564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.158094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.158542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.159281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.159727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.160236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.459989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:38.469530 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9756bbd-d309-4df4-962f-44c9c98b884a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.327633 Oct 04 18:22:38.470153 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2790/5695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:38.559033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:38.560265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:38.560265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:38.560487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:38.561426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:38.592769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.594652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.596053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.602176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.606041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.611850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.644154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:38.663031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:38.664011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:38.666519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:38.673578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:38.693619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for user 40182dcde092424f8a56c3effd3b40e2 and project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:38.694710 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] Creating event network-changed:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:22:38.707793 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bda3537e-53bf-4de0-8db4-d428f54d3558 req-9d47a111-1747-4fa5-b9be-2366fdb7cf1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068731 Oct 04 18:22:38.708882 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2791/5696] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:38.745243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:38.750529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:38.867904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9cd4f48b-6a8b-4413-a0ab-91da8bbe50f1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.632610 Oct 04 18:22:38.868560 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2906/5697] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:38.882297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7b64221-c6f6-4a06-befc-2d703e502e93 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:38.883458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7b64221-c6f6-4a06-befc-2d703e502e93 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.133455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7b64221-c6f6-4a06-befc-2d703e502e93 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:39.143722 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7b64221-c6f6-4a06-befc-2d703e502e93 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1221 microversion: 2.1 time: 0.266345 Oct 04 18:22:39.149559 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2792/5698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:38 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:39.443516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1336057595", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:39.496510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:39.497662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:39.528103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.531056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.533112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.536505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:39.539127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:39.539801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:39.592825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] validate_networks() for [('26add75d-657d-4fe4-b138-af37bd1ebf20', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:40.345749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:40.357559 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13018629-7618-4719-bb2c-0a40007bdd2c tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.866876 Oct 04 18:22:40.380187 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2793/5699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:39 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:41.393168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:41.395624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:41.421517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.422808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.424157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:41.426172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:41.427357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:41.430181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.131637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:42.148245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdbcb397-d6d6-48c7-ba9b-02ce31dc462e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.760030 Oct 04 18:22:42.174689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2794/5700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:41 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:42.818011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Calling method '.version_select at 0x7fbdc1c58670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:42.837760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.838469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.838923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.892100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.893050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.894196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.912549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.913416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.916660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:42.917100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:42.922398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:42.923476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:42.924239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:42.927000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.934362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:42.938174 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f390eee-748e-46a4-a4ef-a8896703bbb3 tempest-PortsAdminExtendedAttrsTestJSON-180755390 tempest-PortsAdminExtendedAttrsTestJSON-180755390-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.361916 Oct 04 18:22:42.940460 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2795/5701] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:22:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:42.960130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.960651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.961078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:42.970684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:42.971199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:42.974461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.047139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:43.064100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for user 40182dcde092424f8a56c3effd3b40e2 and project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:43.113635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:43.116437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:43.182918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.183673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.198120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.199885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.202590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.205087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:43.206432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:43.208632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:43.237644 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d07b5165-a846-4e81-8f28-b326d035ec3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.799129 Oct 04 18:22:43.238341 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2907/5702] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:39 2022] POST /compute/v2.1/servers => generated 383 bytes in 3801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:43.254993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6630106-2d58-43ec-a90e-b8433f8fb0f8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:43.254993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6630106-2d58-43ec-a90e-b8433f8fb0f8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:43.663494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6630106-2d58-43ec-a90e-b8433f8fb0f8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.679646 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6630106-2d58-43ec-a90e-b8433f8fb0f8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1222 microversion: 2.1 time: 0.429337 Oct 04 18:22:43.680240 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2908/5703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1222 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:43.911136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:43.923367 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d0e5298-edee-4cb6-86e3-19a2cf883874 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.748200 Oct 04 18:22:43.931107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2796/5704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:43 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:44.707333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.707947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.741108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.742303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.764623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.765488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.766085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.766530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.958589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:44.959278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:44.971033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.971539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.971981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:44.982903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:44.984162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:44.985694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:45.064522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.099731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17820cb9-b3da-4592-99fc-2e9be6e6913e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1274 microversion: 2.1 time: 0.398333 Oct 04 18:22:45.103795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2909/5705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1274 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:45.546271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:45.560699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5cfc741e-354e-4e90-85c0-4c2097d71879 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1279 microversion: 2.1 time: 0.608091 Oct 04 18:22:45.562348 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2797/5706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:44 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1279 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:46.125820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.126456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.158514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.163035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.164042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.165347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.166197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.167401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.371448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:46.382363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b31c66f-63f5-4033-bee8-7971f30ec4fa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1280 microversion: 2.1 time: 0.261445 Oct 04 18:22:46.383396 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2910/5707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1280 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:46.588112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:46.590155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:46.598528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.599037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.599482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:46.600395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:46.600861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:46.601577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.181428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.196335 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8baa97a-839a-4878-9bf1-efa47dac011e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.608393 Oct 04 18:22:47.197192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2798/5708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:46 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:47.412818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:47.413533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:47.427233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.429941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.430603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.431586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.432275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.432874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.438189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:47.601881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:47.611667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e07d0e95-8800-443a-8cb4-195be0e8bc18 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1280 microversion: 2.1 time: 0.203355 Oct 04 18:22:47.612870 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2911/5709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:47 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1280 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:47.708607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c53909e8-a644-4ce3-8164-d59baf978557", "tag": "3705ded7-2e4c-46f1-a72e-935d0df2a1ae"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:47.731746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:47.735670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:47.739799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:47.785240 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] Creating event network-changed:3705ded7-2e4c-46f1-a72e-935d0df2a1ae for instance c53909e8-a644-4ce3-8164-d59baf978557 on n-h2-831194-21 Oct 04 18:22:47.792070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-00690259-a0f1-4808-bc4a-b78726c77701 req-926c9b3d-018e-404d-984a-2bbc6274e554 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088411 Oct 04 18:22:47.800813 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2799/5710] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:22:48.045004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1964784814", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "b93d755e-ac1f-4662-80d2-56f69520f755"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:48.128083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] validate_networks() for [('b93d755e-ac1f-4662-80d2-56f69520f755', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:22:48.222152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:48.223244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:48.239410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.240370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.244314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.245277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.246371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.252643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.976870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:22:48.977532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:22:48.978310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:22:48.978943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:22:48.979560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:22:48.995441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:48.995929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:48.996367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:48.998151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.000276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.008101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.008651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.018135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8888f45d-0cd4-46d1-afb9-e85b926f7204 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.801438 Oct 04 18:22:49.022996 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2800/5711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:48 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:49.028643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Getting quotas for project a31f62b92ee64a09b99018e518ae13da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:22:49.033194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.034904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Getting quotas for user 3e4b1dcdc53848d0893126b30c814daa and project a31f62b92ee64a09b99018e518ae13da. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:22:49.037814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.048838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:22:49.051343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:22:49.052921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.055185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.055914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.056863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:49.057784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:49.058552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:49.140085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:49.154213 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-86b87cae-a376-441a-852e-c2ae40fd6801 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206247 Oct 04 18:22:49.155998 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2912/5712] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:22:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:22:49.175942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-170ffc58-74b2-461c-a456-40b4597af740 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:49.176851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-170ffc58-74b2-461c-a456-40b4597af740 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:49.286411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-170ffc58-74b2-461c-a456-40b4597af740 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.299847 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-170ffc58-74b2-461c-a456-40b4597af740 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1225 microversion: 2.1 time: 0.127937 Oct 04 18:22:49.300606 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2913/5713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:49.495243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:49.509933 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54c1d59a-b9a6-4120-96bd-7f62433fac8e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.482534 Oct 04 18:22:49.514273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2801/5714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:49 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.034296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a796768-00c2-4396-afb5-3c5d861fe579", "tag": "67b51619-ac1d-455f-a5ca-e27c877c07d1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:50.057808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.059605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.081738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.082732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.083057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.086083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.086724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.087557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.092526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.093038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.093503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.123916 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] Creating event network-changed:67b51619-ac1d-455f-a5ca-e27c877c07d1 for instance 2a796768-00c2-4396-afb5-3c5d861fe579 on n-h1-831194-21 Oct 04 18:22:50.142711 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cbf70f05-d721-4428-be35-caa7d9dede2f req-4c2e2b27-4576-4ffc-8e4e-56c0da2e4aac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111972 Oct 04 18:22:50.143343 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2914/5715] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:50.331693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.332416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.354601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.355109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.355559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.356293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.357143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.362479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.517911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.528130 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea9d48ea-bf23-4a74-9d83-b40be3939f79 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1229 microversion: 2.1 time: 0.202846 Oct 04 18:22:50.529496 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2915/5716] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1229 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:50.547643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:50.548798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:50.572580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.573315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.573778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.574587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:50.580168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:50.586226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:50.587051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:50.609493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6c7ab26-4b58-4876-96b6-6d9e85e969bf tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.560390 Oct 04 18:22:50.611912 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2802/5717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:51.323246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.338539 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57dd1873-660d-41ac-a39c-d4a6cefe0859 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.805759 Oct 04 18:22:51.354271 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2916/5718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:50 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:51.557421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.558076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.577192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.578004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.578641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.579536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.580371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.580981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.637898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:51.638936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:51.648998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.652467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.655652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.657014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:51.657742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:51.658578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:51.680761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:51.691435 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63db6baf-425e-4036-bef5-befed537a197 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1277 microversion: 2.1 time: 0.140045 Oct 04 18:22:51.693090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2803/5719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1277 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.020836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.034023 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-258eb549-f56d-4819-9c26-e7ba43164215 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.401325 Oct 04 18:22:52.046069 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2917/5720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:51 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.371669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.372294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.379090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.379464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.380073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.380795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.381264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.381701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.689288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:52.698086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd63e303-fcd8-422e-bce5-c4b7814e4f54 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.330805 Oct 04 18:22:52.706267 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2804/5721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:52.719311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:52.720471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:52.728502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.729518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.730042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:52.730789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:52.731257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:52.731672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.058456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.059651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.071227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.074576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.076204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.077532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.078309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.078919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.095963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:53.208279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.234273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88458c30-a8b1-44f7-a443-9497d058d616 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.519413 Oct 04 18:22:53.235047 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2918/5722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:52 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:53.284773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.293440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc1e68c9-1f21-49aa-baca-3414eaf5899e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.239497 Oct 04 18:22:53.294183 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2805/5723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:53.687727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53909e8-a644-4ce3-8164-d59baf978557", "name": "network-vif-plugged", "status": "completed", "tag": "3705ded7-2e4c-46f1-a72e-935d0df2a1ae"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:53.701494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.702515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.703151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.720183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] Creating event network-vif-plugged:3705ded7-2e4c-46f1-a72e-935d0df2a1ae for instance c53909e8-a644-4ce3-8164-d59baf978557 on n-h2-831194-21 Oct 04 18:22:53.728838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:53.729466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:53.730294 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b3d12197-4d7e-4eed-83f7-53877ba025ee req-2c6e195b-acc3-4529-bec9-ccd81600ef14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045442 Oct 04 18:22:53.731075 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2919/5724] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:53.744130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.744889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.745506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.746491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:53.747139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:53.747769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:53.947191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:53.956280 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7315b4a5-0dcc-4f4f-8fd5-b2ca32ca8461 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.231429 Oct 04 18:22:53.970786 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2806/5725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:53 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:54.267059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.272545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.285287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.286160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.287405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.289080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.289888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.293302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.318646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.319338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.328814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.330365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.333006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.334156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.336807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.337960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.569447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.579816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58cc61ae-095d-41d9-b357-12629b8ec95f tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.324233 Oct 04 18:22:54.594915 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2920/5726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.603267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfe22220-47f8-4d5d-8b3a-3c240689ad18", "tag": "132bba48-f749-4906-8a02-a9a6114b5ca4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:54.613999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.614491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.614936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.628425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] Creating event network-changed:132bba48-f749-4906-8a02-a9a6114b5ca4 for instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 on n-h2-831194-21 Oct 04 18:22:54.633745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-bc353f19-a97c-49ab-96ae-c9f454014b49 req-560f064a-9e3a-4ad2-a0db-84c9940e9dc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036820 Oct 04 18:22:54.634407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2921/5727] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:54.860281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:54.871531 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61c55971-79f2-4472-967e-5331b0fe08fe tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.557617 Oct 04 18:22:54.887884 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2807/5728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:54.981446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:54.983115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:54.991176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.991962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.992587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:54.994236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:54.994902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:54.995340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.217785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.228376 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0087c6d-b34c-4864-94e0-c609ae3b78c5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.251099 Oct 04 18:22:55.229977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2922/5729] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:54 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.607777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.608573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.614963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.615449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.616085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.616955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.617750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.618360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.773195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:55.783398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-352582a0-58d8-4575-a23f-7fcba0c630a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.179399 Oct 04 18:22:55.784874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2808/5730] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:55.898940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:55.899894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:55.908127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.909331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.909858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:55.910654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:55.911373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:55.911806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.112776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.121577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db5bc512-d8fc-4282-b851-60f4b5ea90fa tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.226844 Oct 04 18:22:56.123405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2923/5731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:55 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.255466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.256172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.263159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.264713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.265237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.266105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.266572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.267034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.307539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a796768-00c2-4396-afb5-3c5d861fe579", "name": "network-vif-plugged", "status": "completed", "tag": "67b51619-ac1d-455f-a5ca-e27c877c07d1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:56.343284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.343785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.344439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.356319 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] Creating event network-vif-plugged:67b51619-ac1d-455f-a5ca-e27c877c07d1 for instance 2a796768-00c2-4396-afb5-3c5d861fe579 on n-h1-831194-21 Oct 04 18:22:56.361656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cdb0ef85-288c-440e-ab40-0aa6824da2d9 req-2252d99f-870e-4352-bc86-94f1dcf9d6fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058054 Oct 04 18:22:56.362980 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2924/5732] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:56.488623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.498205 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a63ef24f-a673-433b-8941-48e6fd8a3e1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.248749 Oct 04 18:22:56.499849 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2809/5733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:56.812576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:56.813364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:56.819583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.820424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.820656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.821204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:56.821667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:56.822128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:56.965511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:56.973692 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a91b8e9-e027-4b47-83df-c4f29383d975 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.166358 Oct 04 18:22:56.974283 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2925/5734] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:56 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.147955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.148579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.156096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.156656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.157093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.157799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.158275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.158691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.309296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.319159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8977195b-e1ba-4639-8905-99f625f5ebb6 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.175024 Oct 04 18:22:57.319861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2810/5735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.528623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.529460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:57.535464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.535963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.536402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.537175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:57.537639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:57.538103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:57.703802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:57.711992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dcfc8029-9136-4c6d-96f2-a3e2cbdc707c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1322 microversion: 2.1 time: 0.191269 Oct 04 18:22:57.712655 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2926/5736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:57.998898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:57.999752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.015020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.015885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.016350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.017429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.018050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.018501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.174144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.184538 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc8555e5-4337-4786-a4c7-f87886a661a0 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.191573 Oct 04 18:22:58.185709 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2811/5737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:57 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:58.345212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.346361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.349368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.350058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.355164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.355691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.356138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.357002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.357446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.357700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.357931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.358909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.360193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.361305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.363977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.364665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.469429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lazy-loading 'services' on Instance uuid 52b417a2-ec16-492d-994c-eadb96bb831f {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:58.584219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0666dd93-a3cb-4ed7-b8fb-8f8d080c6285 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments/b3557ee9-1d34-42c2-8a17-1f9f01651dc5" status: 202 len: 0 microversion: 2.1 time: 0.239114 Oct 04 18:22:58.588574 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2812/5738] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:22:58 2022] DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments/b3557ee9-1d34-42c2-8a17-1f9f01651dc5 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:22:58.595793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "name": "network-vif-plugged", "status": "completed", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:58.610113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.610806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.611374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.621485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.627506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] Creating event network-vif-plugged:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:22:58.633390 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4bc44e4d-241f-4f8f-b41c-2a8134f45b28 req-17c6c547-db8b-4271-8da8-a301a8dd8822 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042809 Oct 04 18:22:58.634901 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2813/5739] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:22:58.638586 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd943e04-bca8-4bb0-96a1-eca100b7a935 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.297908 Oct 04 18:22:58.645151 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2927/5740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:58.737762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:58.738813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:58.746643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.747985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.748838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.750061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:58.751067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:58.751657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:58.965738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:58.974926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2fea6f39-9c25-40fd-a3f7-2a474b2c2c59 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1515 microversion: 2.1 time: 0.242996 Oct 04 18:22:58.990314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2814/5741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:58 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1515 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.004677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:22:59.007364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.016932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.017798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.018276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.018997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.019803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.020244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.021190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:59.052419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'flavor' on Instance uuid 2a796768-00c2-4396-afb5-3c5d861fe579 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:22:59.145690 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8227d48-ebd1-4954-a9aa-07178b16f7c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action" status: 200 len: 32 microversion: 2.1 time: 0.145353 Oct 04 18:22:59.147432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2928/5742] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:22:58 2022] POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action => generated 32 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:22:59.161658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.162343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.173612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.178215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.178728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.181201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.181712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.183333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.211872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.212708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.224346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.225175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.225801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.226819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.228978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.229775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.291600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=34 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:22:59.471176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.486243 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-252ba363-91d4-4ff4-973a-d9492ad9991e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.331092 Oct 04 18:22:59.494343 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2815/5743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:22:59.605113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:22:59.632761 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-67c6cb23-d9b8-4309-8496-fb5ec6fbdec1 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.426869 Oct 04 18:22:59.647017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2929/5744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:22:59.666869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:22:59.667933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:22:59.681585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.682323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.682767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:22:59.683476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:22:59.686283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:22:59.686755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.160564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.171262 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e818f6c7-8587-4f50-bb6e-10c0c382f63e tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1267 microversion: 2.1 time: 0.508462 Oct 04 18:23:00.171861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2816/5745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:22:59 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1267 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.513169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.514583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.522422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.523333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.524091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.526100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.526767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.530556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.573300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:00.673399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:00.674612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:00.680963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:00.686876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.687727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.688347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.689275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:00.689924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:00.690524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:00.891931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.899950 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1be466a-0265-4d83-8c2c-54242d815bd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.391984 Oct 04 18:23:00.906231 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2930/5746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:00.914912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:00.925004 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04f7bcdf-cf71-45ff-8825-014ea2fac8ba tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.256168 Oct 04 18:23:00.926012 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2817/5747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:00 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:01.194528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.196039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.204901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.205655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.206286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.207226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.210124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.210961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.418629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.432118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6242721b-54c3-454a-a664-c490e3fe3b51 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1455 microversion: 2.1 time: 0.242353 Oct 04 18:23:01.433017 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2931/5748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1455 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.457567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.458641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.468077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.469420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.470148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.471021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.471687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.472274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.741249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:01.751011 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04aeee76-1329-48a6-b8e7-ddac0a1659a8 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1455 microversion: 2.1 time: 0.298424 Oct 04 18:23:01.752896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2818/5749] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1455 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:01.927045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.927752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.944998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.945932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.946374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.947090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.947548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.947975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.950159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:01.951741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:01.967053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.968492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.969303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:01.972268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:01.973026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:01.974044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.228675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.238376 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9da6b1e1-5355-46ab-a0a2-5a80912c77bd tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.315856 Oct 04 18:23:02.242678 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2932/5750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:02.248558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe22220-47f8-4d5d-8b3a-3c240689ad18", "name": "network-vif-plugged", "status": "completed", "tag": "132bba48-f749-4906-8a02-a9a6114b5ca4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:02.266569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:02.273390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:02.285413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:02.300183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] Creating event network-vif-plugged:132bba48-f749-4906-8a02-a9a6114b5ca4 for instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 on n-h2-831194-21 Oct 04 18:23:02.309721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d7c41d16-33bd-43bd-bdaa-fd3a6ed6d3dc req-e2550291-0b4d-431a-adc1-6f858310e2d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065207 Oct 04 18:23:02.316042 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2933/5751] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:02.665291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:02.689226 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5edefe3c-3030-4359-ae48-a2067d04f8bf tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1325 microversion: 2.1 time: 0.745611 Oct 04 18:23:02.689874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2819/5752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:01 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1325 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:03.272181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.273657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.287618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.291439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.292664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.295387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.297114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.297667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.611603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:03.625176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-467ee89b-ecbf-4644-bbb3-ab1d4fb9d7c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.357701 Oct 04 18:23:03.630608 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2934/5753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:03.718158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:03.718808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:03.726291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.726789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.727421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:03.728297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:03.729119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:03.729762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.139247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.150358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-026accf8-a879-46c4-9f7b-9673f20ec000 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1522 microversion: 2.1 time: 0.438637 Oct 04 18:23:04.151546 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2820/5754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:03 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1522 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.175776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.176262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.185665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.189257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.189734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.191575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.194631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.195345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.238552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] HTTP exception thrown: Instance is not a member of specified network Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Request method failure captured: Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18/ips/invalid HTTP/1.1 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHn369H1LBV1Xt6EZ2t_7KvqRNCL7P_58af_t2d7PJ7_t9vFq6AHNNYCpRRm89Mi2h5IyaruWi0jw4Om5syuA_7b035PwEvndn8n_qyMTL3Hojse2WLJnyAsaP1FeMZMDoAdqAXj-rrkMt7B4JXvOaBBdkBRUuy-oUr-Pb18GFSmrF0 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3e4b1dcdc53848d0893126b30c814daa Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance is not a member of specified network Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': 'cfe22220-47f8-4d5d-8b3a-3c240689ad18', 'id': 'invalid'} Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 04 18:23:04.257081 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.265588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:04.267283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b870dfbb-ccaa-4262-9046-9e5d68c99c30 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.095499 Oct 04 18:23:04.280333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.281097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Failed to fetch instance by id 999 {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 04 18:23:04.281796 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] HTTP exception thrown: Instance 999 could not be found. Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Request method failure captured: Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHn369H1LBV1Xt6EZ2t_7KvqRNCL7P_58af_t2d7PJ7_t9vFq6AHNNYCpRRm89Mi2h5IyaruWi0jw4Om5syuA_7b035PwEvndn8n_qyMTL3Hojse2WLJnyAsaP1FeMZMDoAdqAXj-rrkMt7B4JXvOaBBdkBRUuy-oUr-Pb18GFSmrF0 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3e4b1dcdc53848d0893126b30c814daa Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 999 could not be found. Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '999'} Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 04 18:23:04.283933 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:04.290271 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2935/5755] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18/ips/invalid => generated 91 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:23:04.293049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:04.294268 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b489827-d835-4638-bb94-67e09d833831 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.020259 Oct 04 18:23:04.301478 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2821/5756] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:23:04.306097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.306614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.325974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.326604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.326882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.327617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.328077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.328506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.370099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:04.469598 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc921c82-9d2f-4fe7-a78e-3aef3b899c39 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 204 len: 0 microversion: 2.1 time: 0.166986 Oct 04 18:23:04.471089 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2936/5757] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:04 2022] DELETE /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:04.479032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.479929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.489858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.491033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.491494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.492247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.499150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.500672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.661999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:04.663243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:04.682192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.685504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.687159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.688157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:04.690070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:04.690896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:04.740349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:04.742679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:04.754931 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ddd78b38-aad6-466b-b836-563aa4e92680 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1528 microversion: 2.1 time: 0.279744 Oct 04 18:23:04.773196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2822/5758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1528 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:04.989347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:05.001626 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ce1b220-7ea7-4447-834e-1c92e0a1088b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.345561 Oct 04 18:23:05.014760 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2937/5759] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:04 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:05.497864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:05.515018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.515885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.517148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.533324 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] Creating event network-changed:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:23:05.542674 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3db142ca-a72f-4e6e-9d3c-89aae3dff656 req-75253f05-eec7-453e-9b02-ac68324ac77b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051997 Oct 04 18:23:05.543574 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2823/5760] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:05.781115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:05.782391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:05.799720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.800225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.800875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:05.801763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:05.802404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:05.802998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.027347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.028243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.042322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.043193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.043843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.044776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.045409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.046083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.470796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.485457 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd9a446c-47e7-484f-958b-7137a6d66bf2 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1528 microversion: 2.1 time: 0.708771 Oct 04 18:23:06.522855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2938/5761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:05 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1528 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:06.530515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:06.539686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:06.542862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.543653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.545282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.611199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Going to try to stop instance {{(pid=128849) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:23:06.704864 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-76bb192c-c5b0-4fed-ae54-b96e60ed2e02 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action" status: 202 len: 0 microversion: 2.1 time: 0.179414 Oct 04 18:23:06.705921 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2939/5762] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:06 2022] POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:06.707942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:06.715240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:06.717607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:06.728853 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8af9f0cf-6770-4568-a49d-65c94c519954 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.706048 Oct 04 18:23:06.732291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.732624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.733265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:06.734091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:06.736400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2824/5763] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:06.756602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:06.757076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.290662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.307496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd633998-f46d-4d85-8e1d-b5c27b201790 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.596928 Oct 04 18:23:07.308298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2940/5764] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:06 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:07.515540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.516903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.525763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.526828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.527532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.530270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.531026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.531697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.663257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4b1dcdc53848d0893126b30c814daa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a31f62b92ee64a09b99018e518ae13da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:07.687676 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57a65020-e147-43a3-bd6c-a02357ed3185 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 200 len: 1486 microversion: 2.1 time: 0.176713 Oct 04 18:23:07.687939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfe22220-47f8-4d5d-8b3a-3c240689ad18", "name": "network-vif-deleted", "tag": "132bba48-f749-4906-8a02-a9a6114b5ca4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:07.695250 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2825/5765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 1486 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:07.710114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.710885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.711479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.728669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] Creating event network-vif-deleted:132bba48-f749-4906-8a02-a9a6114b5ca4 for instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 on n-h2-831194-21 Oct 04 18:23:07.736460 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b7f480ab-b09e-4267-89b7-46adbe7ceecb req-c00f450f-b6ee-4028-954b-3ad05c1cd458 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055483 Oct 04 18:23:07.737764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2941/5766] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:07.763821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:07.765373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:07.772163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.773215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.773962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:07.774956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:07.775644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:07.776315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.175989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.184866 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ecf439d-4dd6-4b0f-a0a4-356e0877c08c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.425359 Oct 04 18:23:08.186569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2826/5767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:07 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.335797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.336562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.343906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.344404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.344853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.345567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.346100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.346700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.589181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:08.600915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10bf08c2-bfd7-49cf-98d0-781f28b89745 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.270153 Oct 04 18:23:08.618019 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2942/5768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:08.719035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:08.720202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] [instance: cfe22220-47f8-4d5d-8b3a-3c240689ad18] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:08.728992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.729667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.730583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.731511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:08.732137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:08.732745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:08.749653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] HTTP exception thrown: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Request method failure captured: Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 HTTP/1.1 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHn369H1LBV1Xt6EZ2t_7KvqRNCL7P_58af_t2d7PJ7_t9vFq6AHNNYCpRRm89Mi2h5IyaruWi0jw4Om5syuA_7b035PwEvndn8n_qyMTL3Hojse2WLJnyAsaP1FeMZMDoAdqAXj-rrkMt7B4JXvOaBBdkBRUuy-oUr-Pb18GFSmrF0 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a31f62b92ee64a09b99018e518ae13da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a31f62b92ee64a09b99018e518ae13da Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-510766794 Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3e4b1dcdc53848d0893126b30c814daa Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-510766794-project Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'cfe22220-47f8-4d5d-8b3a-3c240689ad18'} Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.752209 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. Oct 04 18:23:08.756955 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:08.758356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] Returning 404 to user: Instance cfe22220-47f8-4d5d-8b3a-3c240689ad18 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:08.759426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b785b44d-705d-47ef-8163-5ae360f0d880 tempest-ServerAddressesNegativeTestJSON-510766794 tempest-ServerAddressesNegativeTestJSON-510766794-project] 10.222.0.42 "GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18" status: 404 len: 111 microversion: 2.1 time: 0.046230 Oct 04 18:23:08.764776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2827/5769] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:08 2022] GET /compute/v2.1/servers/cfe22220-47f8-4d5d-8b3a-3c240689ad18 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:09.210923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.211704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.219693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.220367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.220928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.221994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.222582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.223119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.630401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:09.631037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:09.645929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.647229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.648260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.651372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.653074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.655728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.838326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.854355 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b30595dc-0ba1-4903-ae40-dd254aa28c7e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.648664 Oct 04 18:23:09.866065 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2943/5770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:09.873287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}, {"name": "network-changed", "server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:09.884512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:09.885313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:09.885898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:09.907365 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Creating event network-changed:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:23:09.921567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] Creating event network-changed:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:23:09.931378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:09.931883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-60bc4d22-0abe-4753-8851-755a467ff5e0 req-24eeb9d2-4d9c-4879-833d-32512ff2a9f4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.064872 Oct 04 18:23:09.932649 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2944/5771] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:09.946623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0af195b9-6f09-4ed5-aada-f7aab4259c00 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.318630 Oct 04 18:23:09.962586 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2828/5772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:09 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:10.891064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.892930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:10.908282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.909111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.909808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.910877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:10.912239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:10.912858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:10.987455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:10.988298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:11.005756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.006614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.007297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.008474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:11.009042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:11.009576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:11.346242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.369537 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2db118ea-34f1-46ea-898a-3a6ab11f6220 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.394067 Oct 04 18:23:11.388313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2829/5773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:11.414319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:11.427020 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e228f1d-7a83-4d4a-bc4f-58f70c6b453b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.549651 Oct 04 18:23:11.430219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2945/5774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:10 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.405642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.406485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.413658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.414256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.414701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.415418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.415883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.416317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.459492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:12.460129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:12.468215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.468754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.469236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.470079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:12.470734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:12.471787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:12.489009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:12.564596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.573199 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5432842f-1ffb-4cb7-8aec-8c8c2653e380 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.173512 Oct 04 18:23:12.573964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2830/5775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:12.727014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:12.748242 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9457f60b-6d89-44f2-ae03-23add475fdfc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.291290 Oct 04 18:23:12.761854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2946/5776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:12 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:13.601298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.602966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.612100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.612914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.613366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.614182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.614798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.615372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.777914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:13.779761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:13.788513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.789529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.790198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.791253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:13.791915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:13.792726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:13.858951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:13.869116 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-07b48b41-83ff-4859-b3ac-a5b9f405b50a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.273266 Oct 04 18:23:13.870122 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2831/5777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.155177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:14.166620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9062ccba-afc7-4109-91d6-70cabac883cf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.393049 Oct 04 18:23:14.167391 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2947/5778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:13 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:14.908411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:14.909964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:14.923853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.927085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.928426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:14.932398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:14.933174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:14.935230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.203074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.209333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:15.214529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:15.241932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.242457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.242899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.243797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28c1fdda-6a60-44ce-9f76-801183be4551 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.337775 Oct 04 18:23:15.244348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:15.244885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:15.245334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:15.264989 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2832/5779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:14 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:15.602506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:15.612936 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-294700dc-1cdb-4821-9150-480980c7803a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.426069 Oct 04 18:23:15.613757 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2948/5780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:15 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:16.286073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.287179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.302939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.303537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.304080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.305026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.309104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.310338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.497257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-2137329826", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": "none"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:16.527167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.537702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f2625969-31bd-46c8-b3ff-44f09c5b9959 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1676 microversion: 2.1 time: 0.255960 Oct 04 18:23:16.539289 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2833/5781] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1676 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:16.568538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:16.568974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:16.569462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:16.569919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:16.570341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:16.580882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.581483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.582033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.582849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.583388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.583876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.605406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Getting quotas for project 2a557f92dec44c25b85a0823437e522d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:16.612035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Getting quotas for user 5ef1d51aa44640e6b4a56d8c2d9fb8ed and project 2a557f92dec44c25b85a0823437e522d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:16.629194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:23:16.632432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:23:16.639652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.640786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.651957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.652581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.659966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.661325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:16.662067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:16.662728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:16.745170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63f8aa36-45f0-4abc-a766-067fbd61c199 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.412376 Oct 04 18:23:16.746340 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2949/5782] 10.222.0.42 () {62 vars in 1188 bytes} [Tue Oct 4 18:23:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 04 18:23:16.762529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:16.764375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:16.844483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.856419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.862322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.867272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17543db9-c15b-4680-b36e-bc5a0da5a7d9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1278 microversion: 2.54 time: 0.105144 Oct 04 18:23:16.883073 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2950/5783] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:16.931233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:16.952739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3fce8ab2-074d-42d4-9a04-9726ce06546c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.317792 Oct 04 18:23:16.971541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2834/5784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:16 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:17.565667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.567475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.577364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.577894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.578547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.579338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.579782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.580216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.808931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:17.819483 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c22088a0-8a70-4249-8819-ce1a7c2daa9f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1653 microversion: 2.1 time: 0.259145 Oct 04 18:23:17.820074 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2951/5785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1653 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:17.849382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:17.857249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.857773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.858283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.886128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:23:17.898081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.899088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.907089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.908240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.908925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.909707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.910409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.915167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.970814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98b74450-80b8-4900-bc36-ed9f6b749d87 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action" status: 202 len: 0 microversion: 2.1 time: 0.123781 Oct 04 18:23:17.971804 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2835/5786] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:17 2022] POST /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:17.985552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:17.986296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:17.996396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.997011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.997728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:17.998747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:17.999371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:17.999948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.045275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.062644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.064141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.070814 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d211c0f-d3a5-4b4d-bd76-a4225716e259 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1330 microversion: 2.54 time: 0.175515 Oct 04 18:23:18.072815 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2952/5787] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1330 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:18.083313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:18.084885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:18.098973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.099487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.099946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.101348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:18.101348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:18.105705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:18.242448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.255515 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b317a393-bcb4-4826-8dd6-863ee290b2af tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.275766 Oct 04 18:23:18.257913 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2836/5788] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:17 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:18.502234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:18.512953 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3bcbb1e-36c6-4ed0-8b57-bf0e4ceff059 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1662 microversion: 2.1 time: 0.437488 Oct 04 18:23:18.513960 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2953/5789] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:18 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1662 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:19.102794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.104158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.113919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.114808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.115297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.116019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.116524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.116954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.203670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.213076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.214921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.216841 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eb6e0e5d-3521-4ae1-9bfa-f3460d824d4f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1336 microversion: 2.54 time: 0.118089 Oct 04 18:23:19.217901 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2837/5790] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:19.282565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.283132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.291091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.291766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.292971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.295004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.296069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.296553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.511299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.520324 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e07c5dbd-4df2-4d89-a00c-9ad2fb0029ac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.243400 Oct 04 18:23:19.538319 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2954/5791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:19.546052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:19.547251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:19.554578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.555489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.556169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.557146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:19.557874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:19.558553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:19.819370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:19.829318 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30126a07-eef2-4ea3-ae08-3cca44c14746 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1662 microversion: 2.1 time: 0.287672 Oct 04 18:23:19.830284 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2838/5792] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:19 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1662 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.250147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.250764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.257077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.257955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.258485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.259480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.260096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.260668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.376428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.386167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.388538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.389726 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-039031ff-ff27-4525-9776-ef5884eb3f83 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1336 microversion: 2.54 time: 0.145270 Oct 04 18:23:20.403598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2955/5793] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1336 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:20.551648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.553530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.561316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.561819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.562304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.563024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.563489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.563926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.767886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:20.770215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:20.778686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b20782d-a9d0-4cee-9e50-baa3f0807a8c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.232496 Oct 04 18:23:20.778686 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2839/5794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:20.854473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:20.855462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:20.865474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.867854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.868907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:20.869877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:20.870556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:20.871053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.048455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.060158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81a93c74-89ac-4d42-8c95-04509cfb1dd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1662 microversion: 2.1 time: 0.208869 Oct 04 18:23:21.061874 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2956/5795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:20 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1662 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:21.418248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.418949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.427471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.427979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.428424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.429135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.429598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.430070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.525066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.534764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.538541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:21.540011 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-287f3759-b716-498f-b48b-f9d5dfa472eb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1357 microversion: 2.54 time: 0.125791 Oct 04 18:23:21.540770 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2840/5796] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1357 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:21.579569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28e138cc-f430-4f9b-a978-04d5499116e1 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Action: 'create', calling method: .version_select at 0x7fbdbc4b8a60>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1699512558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK52ST7Vl28iDzjiCbCu4ufO+gEuRMFJW5UgfYkWEmkUMFYCRN0/4xC+LZpdbUHiDN/6wgO/Lm4HP0hEUbEybewenMSbQ7Ripk+ttIf4iDh71y5tLc3iVdd1lUIX9UZ7mQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:21.595781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-28e138cc-f430-4f9b-a978-04d5499116e1 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Getting quotas for project 2a557f92dec44c25b85a0823437e522d. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:23:21.602346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-28e138cc-f430-4f9b-a978-04d5499116e1 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Getting quotas for user 5ef1d51aa44640e6b4a56d8c2d9fb8ed and project 2a557f92dec44c25b85a0823437e522d. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:23:21.629669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28e138cc-f430-4f9b-a978-04d5499116e1 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.055219 Oct 04 18:23:21.630465 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2957/5797] 10.222.0.42 () {62 vars in 1200 bytes} [Tue Oct 4 18:23:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 04 18:23:21.642472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1699512558", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:21.645673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.653211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.653985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.654345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.655081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.655542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.655976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.744989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:23:21.745425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:23:21.745938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:23:21.746489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:23:21.746979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:23:21.804784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.805413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.819330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.820293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.821567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.823160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.825326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.826043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.853077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.862041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.862534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.864005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.864971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.865604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.866238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.897629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b57d74b7-ec03-4d6c-93c8-3003a591bce6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "POST /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68/action" status: 202 len: 1140 microversion: 2.54 time: 0.259602 Oct 04 18:23:21.898650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2841/5798] 10.222.0.42 () {62 vars in 1320 bytes} [Tue Oct 4 18:23:21 2022] POST /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68/action => generated 1140 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 04 18:23:21.923003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:21.923968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:21.930412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.931226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.931864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:21.933102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:21.933321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:21.933813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.029941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.039313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.041259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.043164 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da77426e-48cc-4fa4-95a1-18893cb87634 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.125885 Oct 04 18:23:22.044201 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2842/5799] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:22.093428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:22.094461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:22.101822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.102603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.103059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.103999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:22.104704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:22.105388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:22.154432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.175824 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64278655-0b8a-4a67-892a-eca543feafb5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.375093 Oct 04 18:23:22.176554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2958/5800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:21 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:22.309985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:22.319047 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-283fbf2f-1e36-4902-9d13-8c8072a01dd2 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1666 microversion: 2.1 time: 0.233398 Oct 04 18:23:22.319742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2843/5801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:22 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1666 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:23.072632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.073405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.084007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.085341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.086130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.087436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.088158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.088829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.213073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.222640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:23.223812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:23.257700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.261720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.262735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.265653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.266641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.269549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:23.270797 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dce59734-f77d-4c28-95b6-bbabd9f74e7d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.200646 Oct 04 18:23:23.272300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:23.272833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:23.274028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2959/5802] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:23.562944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:23.584542 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00de8915-7754-4057-9560-02ad2eaabc73 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.377900 Oct 04 18:23:23.585762 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2844/5803] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:23 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:24.306309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.308351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.318887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.319745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.320400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.321672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.323241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.323956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.401220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.410622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.412584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.414144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69edc289-e816-4855-815f-e31dc616f9b6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.115125 Oct 04 18:23:24.414733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2960/5804] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:24 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:24.614091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:24.615314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:24.630608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.635064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.635861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.637080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:24.638116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:24.638792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:24.846677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:24.857904 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cba56902-595a-4434-b79e-591a9e0bd902 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.249864 Oct 04 18:23:24.859550 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2845/5805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:24 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:25.446257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.447086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.455259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.456043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.456544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.457465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.458155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.458784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.786232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.796739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.798732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:25.800052 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa5d586a-6c28-4555-8a61-00b82a9e41f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.358403 Oct 04 18:23:25.810402 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2961/5806] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:25.889137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:25.889868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:25.898426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.899245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.899880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:25.900617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:25.901086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:25.901522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.092573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:26.109590 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cff55511-2be5-4644-ab22-a8176572ebc3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.225928 Oct 04 18:23:26.122590 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2846/5807] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:25 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:26.829740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:26.830662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:26.833746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:26.842403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.842910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.843355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:26.844225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:26.844979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:26.845564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.009312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.019745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.021905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.023530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6f4f664-d715-4b86-807b-779000745d54 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.199200 Oct 04 18:23:27.024610 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2962/5808] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:26 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:27.161488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:27.162800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:27.171565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.172056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.172693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.173399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:27.173914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:27.174518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:27.353053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:27.372855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-91d66e89-7348-40a8-8fe6-4a96ff597fe1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1521 microversion: 2.1 time: 0.215183 Oct 04 18:23:27.374427 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2847/5809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:27 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:28.055397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.057076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.067160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.068014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.068625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.069668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.070498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.071494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.189878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.201441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.203434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.204862 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4138a47e-cff6-4676-897c-cb1d4cf89092 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.154919 Oct 04 18:23:28.205793 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2963/5810] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:28.399518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.400132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.408984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.409723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.410257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.412044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.412591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.413097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.863414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:28.876572 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e532f5dc-5723-42f5-a213-bf500ae9d38e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1501 microversion: 2.1 time: 0.481774 Oct 04 18:23:28.877452 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2848/5811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1501 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:28.903463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:28.904374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:28.911351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.912131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.912749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:28.913459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:28.913941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:28.914366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.142449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.158521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7bafaaa-b61a-4464-ba46-ec71ef305314 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1515 microversion: 2.1 time: 0.259340 Oct 04 18:23:29.175473 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2964/5812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:28 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1515 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:29.196758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:29.200610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 34a8d9b6-e424-46be-9bf5-fe40f0253220] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.209680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/34a8d9b6-e424-46be-9bf5-fe40f0253220/action HTTP/1.1 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 14 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: {"rescue": {}} Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '34a8d9b6-e424-46be-9bf5-fe40f0253220', 'body': {'rescue': {}}} Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:29.219624 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 404 to user: Instance 34a8d9b6-e424-46be-9bf5-fe40f0253220 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6c57910-f755-45e1-b8ac-829ea151a721 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/34a8d9b6-e424-46be-9bf5-fe40f0253220/action" status: 404 len: 111 microversion: 2.1 time: 0.029298 Oct 04 18:23:29.231047 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2849/5813] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:29 2022] POST /compute/v2.1/servers/34a8d9b6-e424-46be-9bf5-fe40f0253220/action => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:23:29.240213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.240626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:29.241113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.241637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.252181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.252856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.253047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.253744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.254485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.254926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.255605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.255961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.256346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.257183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.257962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.258894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.313270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:29.368749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.394537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.397093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.398586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1668e9f1-a253-4d30-9fe0-99bc0099222b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.164900 Oct 04 18:23:29.399576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2850/5814] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:29.406756 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82afb085-ab55-4865-8de9-53da4c46580e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action" status: 202 len: 0 microversion: 2.1 time: 0.168261 Oct 04 18:23:29.415389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2965/5815] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:29 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:29.423744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:29.425397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:29.435555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.436062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.436649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.437952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:29.438750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:29.439398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:29.703668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:29.721441 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1634cf7b-4dc0-4b80-812c-39a043186ed9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1520 microversion: 2.1 time: 0.303957 Oct 04 18:23:29.737973 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2851/5816] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:29 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:30.436798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.437783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.449664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.450548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.451169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.452070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.452766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.453394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.541552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.554216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.556060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.557316 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c3945ed-c25a-4d0c-84fb-120e23c24e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.131727 Oct 04 18:23:30.558029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2966/5817] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:30.755380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:30.756054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:30.760805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=74 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:30.767196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.767702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.768153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.768863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:30.769328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:30.769762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:30.956026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:30.973135 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ae943b1-be47-4ee9-803d-e68f47fede55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1500 microversion: 2.1 time: 0.221831 Oct 04 18:23:30.973674 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2852/5818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:30 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1500 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.002643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:31.005871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.014227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.014765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.015220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.015948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.016413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.016850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.047431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'flavor' on Instance uuid c53909e8-a644-4ce3-8164-d59baf978557 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:31.063764 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Cannot 'rescue' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state paused Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action HTTP/1.1 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 14 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: {"rescue": {}} Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'rescue' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state paused Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c53909e8-a644-4ce3-8164-d59baf978557', 'body': {'rescue': {}}} Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c53909e8-a644-4ce3-8164-d59baf978557 in vm_state paused. Cannot rescue while the instance is in this state. Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state paused Oct 04 18:23:31.065796 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state paused Oct 04 18:23:31.071019 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:31.073236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 409 to user: Cannot 'rescue' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state paused {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:31.074556 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fe404b3-4440-45e9-90d5-623773a15706 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action" status: 409 len: 144 microversion: 2.1 time: 0.077024 Oct 04 18:23:31.075800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2967/5819] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:30 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action => generated 144 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:23:31.085294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:31.085294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.092135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.092879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.093570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.094465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.095001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.095540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.204794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce7aede7-1289-43b1-a595-1e0474ad9bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action" status: 202 len: 0 microversion: 2.1 time: 0.119453 Oct 04 18:23:31.207796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2853/5820] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:31 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:31.216786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.217597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.225649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.226534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.227416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.228345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.229013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.229654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.587247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.590238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:31.592207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:31.599543 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-86f1bc9f-8e67-4f73-b05c-8f747042dee3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1507 microversion: 2.1 time: 0.387528 Oct 04 18:23:31.600259 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2968/5821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1507 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:31.606582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.607596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.608791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.610476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:31.622032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:31.623206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:31.643618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:31.755570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.768819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.770324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:31.771618 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e590530-1b73-4aab-bbf3-bdd471a10123 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.190009 Oct 04 18:23:31.772384 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2854/5822] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:31 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:32.625167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.626035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.630176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:32.638188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.638687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.639537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.640316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.641068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.641793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.799873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:32.801123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:32.811712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.812577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.813232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.814477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:32.815135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:32.815782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:32.822112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.832082 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26c50348-bbb9-4793-880d-dde5cd5f0a39 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1515 microversion: 2.1 time: 0.212166 Oct 04 18:23:32.833064 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2969/5823] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1515 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:32.901549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.919675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.922776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:32.924235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b127494-9942-4a3f-98fb-6236b7cad236 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.128360 Oct 04 18:23:32.938174 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2855/5824] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:32 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:33.964254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:33.966246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:33.974077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.974576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.975021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:33.975732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:33.976197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:33.976628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.072413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.096855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.100667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.106441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b6929e7-3b6d-4238-84f6-9ac8ee628198 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.143569 Oct 04 18:23:34.110565 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2970/5825] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:33 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:34.478800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:34.482125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:34.490301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.490836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.491326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.492106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.492575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.493267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.530186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'flavor' on Instance uuid c53909e8-a644-4ce3-8164-d59baf978557 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:34.647599 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-162c07ca-c834-4305-abaa-bd4a5b2a8228 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action" status: 200 len: 32 microversion: 2.1 time: 0.173785 Oct 04 18:23:34.648806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2856/5826] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:23:34 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:34.658858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:34.659877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:34.668611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.669421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.670073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.671100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:34.671777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:34.672377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:34.963478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:34.979899 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e77601c-3c0c-49f7-ab5f-f3aadfed87ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.324895 Oct 04 18:23:34.981711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2971/5827] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:34 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:35.144716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:35.144716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:35.144716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.146000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.146000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.146176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:35.146580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:35.147553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:35.250636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:35.266635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:35.268178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:35.269414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db69d76e-10b1-4c03-87a1-247ec1069a7e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.137598 Oct 04 18:23:35.270346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2857/5828] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:36.005311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:36.006060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:36.014424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.015093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.015642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.016452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.017185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.017717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.174018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.185745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6b19974-dac6-4c4a-a81b-62abb41fd321 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.182392 Oct 04 18:23:36.186645 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2972/5829] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:35 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:36.301850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:36.302601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:36.312880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.313373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.314290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.315306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:36.315983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:36.316485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:36.407687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.416744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.418553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:36.419776 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-228f7b09-af57-4755-bc9c-653bb5b83178 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.126531 Oct 04 18:23:36.420491 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2858/5830] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:36 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:37.211377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.212070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.217091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:37.221049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.221539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.222031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.222736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.223188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.223611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.374715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:37.385911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2932612-6877-4f57-a17f-1bb41e65b102 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.179158 Oct 04 18:23:37.386862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2973/5831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:37.451509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:37.453755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:37.463653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.464126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.465279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.465983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:37.466440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:37.466866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:37.547187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:37.555322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:37.556769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:37.557965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-833b7415-5fe6-4172-b9f8-eeac89f4059d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.115483 Oct 04 18:23:37.559086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2859/5832] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:37 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:38.421112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:38.422514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:38.431758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.432537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.434788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.434788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.435511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.436038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.583885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:38.584514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:38.593461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.594117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.594570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.599602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:38.600765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:38.601283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:38.616480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.636185 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f352d0f9-8fa0-4060-b373-c787aedf371c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.219998 Oct 04 18:23:38.637664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2974/5833] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:38 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:38.753177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.762846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.764778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:38.766028 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3581328d-451c-4be9-b74f-26a03156a1e7 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.186324 Oct 04 18:23:38.766789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2860/5834] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:38 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:39.665259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.666712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.677739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.678794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.679564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.681455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.682237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.683641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.801718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:39.803024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:39.819457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.820135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.820596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.821372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:39.821982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:39.822397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:39.905729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.915747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.917705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:39.919242 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-131d3e8a-12be-485e-86eb-18f320f95d0f tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.129570 Oct 04 18:23:39.919824 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2861/5835] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:40.331968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:40.344287 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1ca8d9c-1623-4ffb-96ad-57de5d6d1c28 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.685952 Oct 04 18:23:40.344956 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2975/5836] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:39 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:40.949367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:40.952699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:40.969956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.970833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.971516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:40.972476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:40.973199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:40.973873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.071458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.086147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.088242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.088919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fc3920f-ae55-4db1-92ac-6c60c165b911 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.145379 Oct 04 18:23:41.090052 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2862/5837] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:40 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:41.375852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.377252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.397245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.398543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.398543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.399448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.400754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.400754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.607573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.608088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.628930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.629407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.629905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.630919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.631637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.632276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.666281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:41.671292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:41.676370 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6689720-b0f0-4447-9cfb-9a0c5befd5db tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.309789 Oct 04 18:23:41.677407 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2976/5838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:41.682866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:41.702530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.704859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.705630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.723656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] Creating event network-changed:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:23:41.732086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-935c44af-a295-46d4-87a4-1147f1b24df9 req-648daaff-1ddd-4f86-9f68-f7f03f467054 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052530 Oct 04 18:23:41.733454 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2977/5839] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:41.782897 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-012dd1e2-6265-4acf-a5d1-f6694ddfa64a tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "DELETE /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 204 len: 0 microversion: 2.1 time: 0.179693 Oct 04 18:23:41.784300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2863/5840] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:41 2022] DELETE /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:23:41.795760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:41.796788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:41.805215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.806031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.806781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:41.807976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:41.808646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:41.809604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.036907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.049015 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d88aba5c-b761-444b-8423-8d2498f8bd05 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1580 microversion: 2.1 time: 0.259018 Oct 04 18:23:42.050550 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2978/5841] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:41 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1580 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:42.126707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.130280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.142099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.142590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.143011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.144005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.144662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.145270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.277658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.298086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.307275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.311333 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1600a0bd-7122-4cc7-ab4f-77452eef56c8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.194139 Oct 04 18:23:42.312759 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2864/5842] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:42.705520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:42.706216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:42.723023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.723532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.723979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.724706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:42.725171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:42.725604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:42.894352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:42.904393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b93643d-f02e-4bb7-ac94-53bc7a6fe192 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.203890 Oct 04 18:23:42.905561 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2979/5843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:42 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.081490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.082412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.098238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.098833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.100110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.102652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.108563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.109020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.340590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.341616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.351033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.352043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.352941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.354275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.355264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.356228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.368462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.388761 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f18f461d-4428-40ef-a37e-a8e3da00a920 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1580 microversion: 2.1 time: 0.311296 Oct 04 18:23:43.389671 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2865/5844] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1580 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:43.494382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.518447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.520088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:43.521531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e043dad-afc2-4e9f-a837-3b743e2c7d32 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.185341 Oct 04 18:23:43.526325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2980/5845] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:43.928747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:43.929380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:43.940721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.941254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.941705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:43.942460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:43.942921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:43.944204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.260781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.277622 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-144b64c9-6748-4061-8cef-81480aa862d5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.352164 Oct 04 18:23:44.290149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2866/5846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:43 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:44.432265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:44.433697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:44.452323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.453148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.454529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.455581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.456786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.457889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.551836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:44.552446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:44.566372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.567310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.567995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.568991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.569690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.570356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.574141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:44.655247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.671244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.673991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.676253 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7793cea7-59aa-4e3b-a374-5532bfa904cf tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.131427 Oct 04 18:23:44.677372 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2867/5847] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:44 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:44.755951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:44.765796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-929206bf-e3ad-4c9b-b7f1-05788f9f57cc tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1580 microversion: 2.1 time: 0.338779 Oct 04 18:23:44.766404 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2981/5848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:44 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1580 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:44.794463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f75db8-313a-40e5-a799-44fcebae9d57", "name": "network-vif-deleted", "tag": "87fdc580-fa31-4852-9e37-6f41724e677f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:23:44.804539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:44.805027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:44.805472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:44.819254 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] Creating event network-vif-deleted:87fdc580-fa31-4852-9e37-6f41724e677f for instance 39f75db8-313a-40e5-a799-44fcebae9d57 on n-h1-831194-21 Oct 04 18:23:44.825196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6157232c-4556-487a-913e-78ddb3eee7ad req-65b1cb7c-7cb6-46fd-9510-5c2bcf96533f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036046 Oct 04 18:23:44.825661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2868/5849] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:23:45.307149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.307857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.319689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.320098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.320539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.321302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.321691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.322141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.328259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:45.550117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.560303 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8048d925-b335-4eea-b472-b07ed16f3fe7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.257433 Oct 04 18:23:45.561015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2982/5850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:45.719297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.720050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.745018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.746399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.748009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.749086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.751192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.752232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.793589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:45.794898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:45.804128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.805517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.806664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.808919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:45.809804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:45.811635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:45.881375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.908815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.910925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:45.912433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8fc35d53-0ada-4c8a-89dc-d55809a6ec9c tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.212890 Oct 04 18:23:45.913421 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2869/5851] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:46.299945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:46.314151 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4dd919d3-79db-48eb-8807-c2d20acde558 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1229 microversion: 2.1 time: 0.525640 Oct 04 18:23:46.327173 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2983/5852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:45 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1229 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:46.586184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:46.586822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:46.610183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.610705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.611155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.611875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.612339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.612768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.951128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:46.952389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:46.963548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.969986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.973301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:46.976136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:46.978675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:46.980074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.211412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.230796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.233157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.243305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-edb743d0-c520-429d-884b-c590e7a1262e tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.289150 Oct 04 18:23:47.244413 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2984/5853] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:46 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:47.250253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.258277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f67c55c7-817f-4fca-9fec-113bfa3cb742 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.676783 Oct 04 18:23:47.261346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2870/5854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:46 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:47.351650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:47.352292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:47.367181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.370905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.371661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.372706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:47.373187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:47.373624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:47.529998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:47.547409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e423a30-7d72-4955-bf06-ceee21b7d5d1 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1229 microversion: 2.1 time: 0.202352 Oct 04 18:23:47.548675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2985/5855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:47 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1229 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:48.277378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.278717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.289043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.290391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.309842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.310960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.311670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.312338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.313579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.314239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.315165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.317106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.317904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.318643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.319078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.322887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.436064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.449487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.451902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.453685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cffb4c4a-2429-408e-848e-d54e686f9efb tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.183370 Oct 04 18:23:48.454884 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2871/5856] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:48.571642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:48.572626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:48.580031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.580853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.581524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.582493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:48.583244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:48.583935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:48.680204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:48.689608 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c69e9232-530c-4530-9d9e-993e5ffff3d2 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1229 microversion: 2.1 time: 0.121831 Oct 04 18:23:48.690576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2872/5857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1229 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:49.149562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.160318 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81cd45e2-4e5a-4138-bf19-52e05f13ba71 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.876901 Oct 04 18:23:49.161506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2986/5858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:48 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:49.480378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.481001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.492065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.498580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.499336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.500402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.501037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.501653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.577574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.593844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.599372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.602434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1fc3a6c-46ca-41fc-994e-ac3321e486f9 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.125709 Oct 04 18:23:49.603508 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2873/5859] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:49.712921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:49.713559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:49.729560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.730111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.730690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.731433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:49.731908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:49.732340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:49.829609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:49.837997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c389d695-504f-4583-bc99-34946f186f67 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1229 microversion: 2.1 time: 0.128958 Oct 04 18:23:49.838523 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2987/5860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:49 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:50.188717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.190148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.199843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.200702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.201592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.202924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.203901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.204859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.483161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.510861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b17f5784-7df1-4252-a316-07d6863c8a09 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.323272 Oct 04 18:23:50.511803 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2874/5861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:50.634921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.636306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.644666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.645180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.645633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.646386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.646854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.647395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.749036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.757934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.759871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:50.761554 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-597f40bc-d7c1-41a3-9eb4-9299e63232a5 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.132571 Oct 04 18:23:50.762763 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2988/5862] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:50.865530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:50.866135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:50.903864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.906895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.908548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:50.910917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:50.914030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:50.914498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.041966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.042807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.043457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.044147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lazy-loading 'fault' on Instance uuid 39f75db8-313a-40e5-a799-44fcebae9d57 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:23:51.129931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd33afdba85ee434996078cf082dd4f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14ec729c6b848c39590ce3dc68a3c93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.140148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f405643-84ac-42c6-a901-1cd5c4643e29 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 200 len: 1188 microversion: 2.1 time: 0.280131 Oct 04 18:23:51.146465 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2875/5863] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:50 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 1188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:51.538065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.539621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.549920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.550712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.552183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.553361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.553905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.554592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.783542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.790283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:51.790909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:51.799163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8757851c-a16c-480b-a5aa-8ff2acb46a2b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.262540 Oct 04 18:23:51.800390 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2989/5864] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:23:51.805262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.807326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.808864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.809649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:51.814979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:51.815520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:51.894841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.904403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.906069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:51.907478 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7dffd37-90fc-4bc6-9037-43ee353042f8 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.121741 Oct 04 18:23:51.909043 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2876/5865] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:51 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:52.173106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.173867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] [instance: 39f75db8-313a-40e5-a799-44fcebae9d57] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.180257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.181044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.181672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.182470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.182934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.183535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.198961 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] HTTP exception thrown: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Request method failure captured: Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 HTTP/1.1 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHjpzlSFTeu5j5AlOj3QzqWccoJ5BOuKyZ3HLA1AZ63YVQAKJxCGacNCoJ4l7HZQQdZqpmDgovoQ1AxBrnk1vQlxz7ORGVAPOySHgMT6YMinUas_Z0Nb8FsktqDK6R0m9AVXqDwFNThbSD_Vbaj00DZ7tsFNLTvYk_aaZ0OCKtbkTuk Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b14ec729c6b848c39590ce3dc68a3c93 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBackupRestore-2078850351 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b14ec729c6b848c39590ce3dc68a3c93"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b14ec729c6b848c39590ce3dc68a3c93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b14ec729c6b848c39590ce3dc68a3c93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b14ec729c6b848c39590ce3dc68a3c93"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBackupRestore-2078850351 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b14ec729c6b848c39590ce3dc68a3c93 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBackupRestore-2078850351 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBackupRestore-2078850351-project Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d33afdba85ee434996078cf082dd4f63 Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBackupRestore-2078850351-project Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '39f75db8-313a-40e5-a799-44fcebae9d57'} Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:23:52.200852 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Returning 404 to user: Instance 39f75db8-313a-40e5-a799-44fcebae9d57 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:23:52.206531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ade75a3-9d22-43f9-81e7-9762bf954f24 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57" status: 404 len: 111 microversion: 2.1 time: 0.033432 Oct 04 18:23:52.216020 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2990/5866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/39f75db8-313a-40e5-a799-44fcebae9d57 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:23:52.399220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6caf6804-10b3-4e38-8f22-92792f971021 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] Calling method '.version_select at 0x7fbdbc6f43a0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.427974 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6caf6804-10b3-4e38-8f22-92792f971021 tempest-TestVolumeBackupRestore-2078850351 tempest-TestVolumeBackupRestore-2078850351-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-839959570" status: 202 len: 0 microversion: 2.1 time: 0.032667 Oct 04 18:23:52.430200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2877/5867] 10.222.0.42 () {58 vars in 1266 bytes} [Tue Oct 4 18:23:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-839959570 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:23:52.827540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.828944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.849275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.849763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.850238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.853378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.854610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.855256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.947102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:52.951663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:52.970479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.972812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.973295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:52.975093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:52.975507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:52.975949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:53.154741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.166532 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce75a3ab-54c5-4d1c-8c30-bfd1e5f43618 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.344367 Oct 04 18:23:53.168011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2991/5868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:53.212227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.238679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.241756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:53.245460 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b75166f-d813-4524-b8b9-ed418272c1ed tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1409 microversion: 2.54 time: 0.314218 Oct 04 18:23:53.247210 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2878/5869] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:52 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1409 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:54.193920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.194738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.205071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.205993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.227146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.228652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.230652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.232235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.277772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:54.279901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:54.301351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.302496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.304955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.305978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:54.308313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:54.309090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:54.736600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.764637 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06915229-2d47-4ada-b9fa-61dbecda3636 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.576662 Oct 04 18:23:54.764867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.766959 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2992/5870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:54.792244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.794270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:54.795637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28223fa2-185a-47e7-9dc8-9d3c69bb838d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1415 microversion: 2.54 time: 0.523960 Oct 04 18:23:54.796663 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2879/5871] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:54 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1415 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 04 18:23:55.795098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.795778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.820561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.821073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.821525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.822930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:55.823584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:55.825800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.826334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.826791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.839937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.840448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.840910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.844546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:55.845076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:55.846044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:55.928712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.940458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.944001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:55.945474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b3ff255-4212-43f9-816e-0122e45bee79 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1415 microversion: 2.54 time: 0.127114 Oct 04 18:23:55.946551 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2880/5872] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1415 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:56.156371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:56.169938 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5bcf4f6f-b1d6-4276-8153-66ff063a42a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.380973 Oct 04 18:23:56.171060 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2993/5873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:55 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:56.347196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.350001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.372952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.373704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.374398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.375306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.375931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.376523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.480847 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-db59e35e-9837-4d6b-a73b-f3eec58258eb tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.149292 Oct 04 18:23:56.500694 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2881/5874] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:23:56.633867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.641270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.661626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.664890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.665684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.667637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.668529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.669303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.718808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:56.909386 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1a3ee8f-ae44-4bc5-a201-f0e4ede0f194 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 204 len: 0 microversion: 2.1 time: 0.278781 Oct 04 18:23:56.911026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2994/5875] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:23:56 2022] DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:23:56.928892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.938563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.974473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:56.975580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:56.980680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.981414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.982078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.983765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.986338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.987692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.993999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:56.995407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:56.996024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:56.997153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.001436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.002137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.325642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.344845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.351637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.352924 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-29871e49-f561-439a-987d-047dc37c2e50 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1415 microversion: 2.54 time: 0.383146 Oct 04 18:23:57.358761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2995/5876] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1415 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:57.367600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:57.371721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:57.388212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.389480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.393966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.398264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:57.398781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:57.404626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:57.443570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.457582 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04d51763-01a6-4334-8547-1b65eaac6cb0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1672 microversion: 2.1 time: 0.541683 Oct 04 18:23:57.458893 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2882/5877] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:56 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1672 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:57.701613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:57.714912 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-914f62d3-43b1-4cd8-b059-9792d6911e0e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.353299 Oct 04 18:23:57.717014 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2996/5878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:57 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:58.405945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.406571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.413752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.414677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.415472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.416321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.416858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.417289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.483961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.485916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.508845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.511331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.517282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.520551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.521946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.524144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.539672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.550190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.553306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.555063 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f6213cc-b547-4b79-b6ef-8bd3d5a0412b tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1400 microversion: 2.54 time: 0.155499 Oct 04 18:23:58.555844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2883/5879] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1400 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:58.591032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8073c018-13fe-4b01-af4f-9e66c2d392e6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '.version_select at 0x7fbdbc8c1a60>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.615664 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8073c018-13fe-4b01-af4f-9e66c2d392e6 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1699512558" status: 204 len: 0 microversion: 2.54 time: 0.029955 Oct 04 18:23:58.623629 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2884/5880] 10.222.0.42 () {60 vars in 1319 bytes} [Tue Oct 4 18:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1699512558 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 04 18:23:58.634309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.635849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.643784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.644751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.645473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.646469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.647130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.647874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.685143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:23:58.705470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.788079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.792337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:23:58.799609 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c009ddc-eba7-4df2-a223-05f35c8122a0 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1672 microversion: 2.1 time: 0.320869 Oct 04 18:23:58.808830 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7ba6621-8440-4b75-aad0-f63c7aa64f89 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 204 len: 0 microversion: 2.54 time: 0.179290 Oct 04 18:23:58.810137 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2997/5882] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1672 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:58.813403 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2885/5882] 10.222.0.42 () {60 vars in 1280 bytes} [Tue Oct 4 18:23:58 2022] DELETE /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 04 18:23:58.817409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.818189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.821941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:58.823777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:58.831571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.832369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.832984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.833730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.834266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.834444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.835008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.835617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.836267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.842193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:58.842932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:58.843636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:58.925973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.938170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.939498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:58.941451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24d665da-ffd6-46f9-82ff-47f99553a056 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1406 microversion: 2.54 time: 0.125132 Oct 04 18:23:58.955274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2886/5883] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1406 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:23:59.177731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:23:59.196782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b82f9a42-fc65-43b8-985c-580ab07e5e1d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.385220 Oct 04 18:23:59.214544 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2998/5884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:58 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:23:59.841182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.844091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.855344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.856188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.856816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.859163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.860176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.860914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.973110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:23:59.974367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:23:59.991457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.991976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.992433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:23:59.995310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:23:59.995803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:23:59.996249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.134161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.151180 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b404cc0-5dca-421a-b696-0b616f76cd90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1672 microversion: 2.1 time: 0.317037 Oct 04 18:24:00.163220 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2887/5885] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1672 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:00.224627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:00.225545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:00.228497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.250800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.253229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.253907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.254587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.255906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.260730 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-387a9784-5046-4eac-8d96-069983d68e3d tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1406 microversion: 2.54 time: 0.290979 Oct 04 18:24:00.262414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:00.262937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:00.263396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:00.291013 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 2999/5886] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:23:59 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1406 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:00.504634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:00.516874 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdb0a8b1-8636-42b2-9b96-9b2658340310 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.296025 Oct 04 18:24:00.517978 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2888/5887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:00 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.176951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.177856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.185890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.187019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.187570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.188557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.189238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.189926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.292602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.293671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.296879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:01.304550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.305205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.305822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.307330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.308424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.309145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.424700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.450377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.453789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5ef1d51aa44640e6b4a56d8c2d9fb8ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a557f92dec44c25b85a0823437e522d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.456238 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8e864c15-acd2-41a7-b126-f4aa920b7326 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 200 len: 1406 microversion: 2.54 time: 0.169034 Oct 04 18:24:01.457715 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2889/5888] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 04 18:24:01.520700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.533639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e769e256-7c15-4495-838c-b90d6111f094 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1672 microversion: 2.1 time: 0.360697 Oct 04 18:24:01.548644 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3000/5889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1672 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.555767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:01.557167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.567740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.568979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.569952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.571089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.571808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.572535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.843961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:01.851863 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-239e5f44-b6c2-497c-9985-ecd577c5fab6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1501 microversion: 2.1 time: 0.301011 Oct 04 18:24:01.852444 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2890/5890] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:01 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1501 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:01.881352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f710070d-eb55-406c-baea-99a9f92850e4"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:01.883826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.890742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.891252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.891681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.892382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.892844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.893274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.926102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Cannot 'attach_volume' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state rescued Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/os-volume_attachments HTTP/1.1 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 74 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: {"volumeAttachment": {"volumeId": "f710070d-eb55-406c-baea-99a9f92850e4"}} Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'attach_volume' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state rescued Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': 'c53909e8-a644-4ce3-8164-d59baf978557', 'body': {'volumeAttachment': {'volumeId': 'f710070d-eb55-406c-baea-99a9f92850e4'}}} Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c53909e8-a644-4ce3-8164-d59baf978557 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 04 18:24:01.927864 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state rescued Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state rescued Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 409 to user: Cannot 'attach_volume' instance c53909e8-a644-4ce3-8164-d59baf978557 while it is in vm_state rescued {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a4392f9e-d5fc-47d6-9a06-a5f85a505904 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.052641 Oct 04 18:24:01.933338 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3001/5891] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:24:01 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:24:01.939828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:01.940090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:01.950961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.952575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.953045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:01.953789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:01.954292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:01.954912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.048355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2994b3ba-2e60-4bcb-a7af-4f339acc5856 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action" status: 202 len: 0 microversion: 2.1 time: 0.112037 Oct 04 18:24:02.054152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2891/5892] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:24:01 2022] POST /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:02.060029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.060722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.067403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.067840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.068522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.069255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.069788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.070260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.462217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52b417a2-ec16-492d-994c-eadb96bb831f", "name": "network-vif-deleted", "tag": "0cbe3de5-e8e2-4b30-87aa-16cae8fda639"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:02.476803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.477530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.478995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.497298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] Creating event network-vif-deleted:0cbe3de5-e8e2-4b30-87aa-16cae8fda639 for instance 52b417a2-ec16-492d-994c-eadb96bb831f on n-h2-831194-21 Oct 04 18:24:02.503099 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-209955e7-c8c0-47f9-a992-8d26644d4ae3 req-15533147-270f-4e69-a7e1-fc32bf1b04a8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048021 Oct 04 18:24:02.505742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2892/5893] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:02.513151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.514440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] [instance: d2092010-3e90-42bb-9730-e9b9d0721e68] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.523685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.524694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.526529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.528268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.529367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.530196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.543392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.559121 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6dd5e105-bc5e-4263-ada1-9e30155c37c0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1509 microversion: 2.1 time: 0.503437 Oct 04 18:24:02.562304 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3002/5894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:02.571832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:02.574139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:02.575912 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] HTTP exception thrown: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Request method failure captured: Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 HTTP/1.1 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHoUQFeR4lS6G5X2sncDRla4h9aam259uKCG8hlbug9d5gUugSE-QiXkj7DnteNaGzWb2Z8bcFTp2LZbSsEbwvr3z8UvsVWUu3slPdAQRNMFtKD8FHVMUxWOvbiQEOw6FkkipT3tW6ffw3IEgcEMvVcCBGzXk1tfgPYdtt6KQqaSdjQ Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Openstack-Nova-Api-Version: 2.54 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2a557f92dec44c25b85a0823437e522d Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerShowV254Test-89067398 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2a557f92dec44c25b85a0823437e522d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a557f92dec44c25b85a0823437e522d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2a557f92dec44c25b85a0823437e522d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2a557f92dec44c25b85a0823437e522d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerShowV254Test-89067398 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2a557f92dec44c25b85a0823437e522d Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerShowV254Test-89067398 Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerShowV254Test-89067398-project Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 5ef1d51aa44640e6b4a56d8c2d9fb8ed Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerShowV254Test-89067398-project Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'd2092010-3e90-42bb-9730-e9b9d0721e68'} Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:02.580022 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:24:02.584360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] Returning 404 to user: Instance d2092010-3e90-42bb-9730-e9b9d0721e68 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:02.587807 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67fe6ae3-3cf6-406e-968e-8c9d09739384 tempest-ServerShowV254Test-89067398 tempest-ServerShowV254Test-89067398-project] 10.222.0.42 "GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68" status: 404 len: 111 microversion: 2.54 time: 0.079707 Oct 04 18:24:02.600323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2893/5895] 10.222.0.42 () {60 vars in 1277 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/d2092010-3e90-42bb-9730-e9b9d0721e68 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:24:02.601703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.604850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.607407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.608799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.609210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.609662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.675640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:02.676133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:02.676864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:02.677519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lazy-loading 'fault' on Instance uuid 52b417a2-ec16-492d-994c-eadb96bb831f {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:24:02.769718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:02.790683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec77445f-72f4-4cde-9a68-f57aba469109 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 200 len: 1328 microversion: 2.1 time: 0.226820 Oct 04 18:24:02.791433 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3003/5896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:02 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 1328 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.593354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.595055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.607471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.608696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.610039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.611844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.612552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.613294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.816639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.817263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:03.844409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.845057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.845362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.846114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:03.846575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:03.847005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:03.898948 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f HTTP/1.1 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '52b417a2-ec16-492d-994c-eadb96bb831f'} Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:24:03.901136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:24:03.906407 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88d951c1-df69-4200-a8c6-5b229acfcde6 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 404 len: 111 microversion: 2.1 time: 0.090214 Oct 04 18:24:03.916561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:03.918237 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3004/5897] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:24:03.923348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3fc225b-e707-44b2-a5db-feb2b1abc42c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '.version_select at 0x7fbdc1d42c10>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:03.937014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f017f1d-8882-44b6-b5be-b79c5d8f5417 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1509 microversion: 2.1 time: 0.349720 Oct 04 18:24:03.938212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2894/5898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:03 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1509 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:03.971272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3fc225b-e707-44b2-a5db-feb2b1abc42c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176826323" status: 202 len: 0 microversion: 2.1 time: 0.051805 Oct 04 18:24:03.972125 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3005/5899] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:24:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1176826323 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:24:04.967843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:04.970847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:04.991961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.007298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.008319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.016347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:05.018836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:05.019621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:05.530677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:05.538854 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-043d56e4-7400-432f-82b2-474e66a164ab tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1509 microversion: 2.1 time: 0.576707 Oct 04 18:24:05.539444 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2895/5900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:04 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1509 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:05.779974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75c8b912-8d28-4391-bd74-7dcf6d2ce112 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: .version_select at 0x7fbdbc5528b0>, body: {"keypair": {"name": "tempest-keypair-726402679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAt32X31piheqGcuUCHavI2z/QqZVHaA2TNs+epUpbII3CSxl5M9uSmt+F754okB9RaB5J102Hr9Qm8H72XCnb4rnwSnB7Ca/C3NEarGVXxPThLE9jyrlhDuLT9Xx8mGQ=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:05.832818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-75c8b912-8d28-4391-bd74-7dcf6d2ce112 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for project 65290c2428b14d898e10a90d66918ca0. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:05.840491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-75c8b912-8d28-4391-bd74-7dcf6d2ce112 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for user 7481f17bf5b142aaadc3e41dfbc68f9c and project 65290c2428b14d898e10a90d66918ca0. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:05.894978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75c8b912-8d28-4391-bd74-7dcf6d2ce112 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120982 Oct 04 18:24:05.896316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3006/5901] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:24:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:06.567301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:06.568005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:06.598943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.599566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.600660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.602634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:06.605145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:06.605916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:06.994791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:07.010439 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03c07684-1c10-4117-bc65-4494d309c197 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1515 microversion: 2.1 time: 0.446244 Oct 04 18:24:07.017098 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2896/5902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:06 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1515 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:10.045882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb807219-7aa2-42a5-8654-85f38553f1e8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: .version_select at 0x7fbdc1d429d0>, body: {"keypair": {"name": "tempest-keypair-1612141590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbjnn5ECxZSl/K1wYoCniYtt4K85b9/oyIc29RRZFuqvK+C0k7kkQE9RYYEIJ5KT95NKK6/zG6t14LXpq/hRvbURElqjYpYa2wl07VZBDcHCiaacha0nqIk2qFTw4dvLA=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:10.054980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:10.067360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cb807219-7aa2-42a5-8654-85f38553f1e8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:10.075227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cb807219-7aa2-42a5-8654-85f38553f1e8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for user 40182dcde092424f8a56c3effd3b40e2 and project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:10.151044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb807219-7aa2-42a5-8654-85f38553f1e8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108682 Oct 04 18:24:10.152062 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3007/5903] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:24:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:10.564480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2024514141", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b2144fd7-90fb-44c4-9f83-e87b9ee8cf4d"}], "security_groups": [{"name": "tempest-securitygroup--24010848"}], "key_name": "tempest-keypair-726402679", "user_data": "}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:10.856337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] validate_networks() for [('b2144fd7-90fb-44c4-9f83-e87b9ee8cf4d', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:12.029238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:12.031286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:12.032767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:12.033379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:12.034101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:12.058508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.059542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.060335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.062921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:12.064220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:12.065609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:12.106917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for project 65290c2428b14d898e10a90d66918ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:12.124847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Getting quotas for user 7481f17bf5b142aaadc3e41dfbc68f9c and project 65290c2428b14d898e10a90d66918ca0. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:12.151904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:12.154740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:12.256095 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e4acc335-f84f-492d-b179-d463957b52e9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.696329 Oct 04 18:24:12.257271 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2897/5904] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:10 2022] POST /compute/v2.1/servers => generated 400 bytes in 1698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:12.269915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d5939e59-78eb-4905-ad43-6229ba13e9cc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:12.271572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d5939e59-78eb-4905-ad43-6229ba13e9cc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:12.441585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d5939e59-78eb-4905-ad43-6229ba13e9cc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:12.463988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d5939e59-78eb-4905-ad43-6229ba13e9cc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1237 microversion: 2.1 time: 0.198556 Oct 04 18:24:12.464792 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3008/5905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:12 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1237 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.491504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:13.491986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:13.505657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.506422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.506917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.520500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:13.521126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:13.521595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:13.684429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:13.693280 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b56de0c7-2e2d-4382-8959-1968cf9328af tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1289 microversion: 2.1 time: 0.207857 Oct 04 18:24:13.693884 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2898/5906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:13 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1289 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:13.974803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-399984152", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26add75d-657d-4fe4-b138-af37bd1ebf20"}], "security_groups": [{"name": "tempest-securitygroup--929424816"}], "key_name": "tempest-keypair-1612141590", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:13.987320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=39 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:14.198307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] validate_networks() for [('26add75d-657d-4fe4-b138-af37bd1ebf20', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:14.724273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:14.724722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:14.737574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.738138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.738586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.746962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.747869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.748706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.937321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:14.938308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:14.939181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:14.939752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:14.941113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:14.990283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:14.993339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:14.996319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:14.999841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:15.002835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:15.008018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:15.081171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:15.097763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Getting quotas for user 40182dcde092424f8a56c3effd3b40e2 and project eb1f0ce17eb242b2ae35e1c0a10dbc7d. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:15.131986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:15.141634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:15.158946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.169149 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7857961f-ada4-4fdd-8a7b-5980fd6e2cd9 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1295 microversion: 2.1 time: 0.455263 Oct 04 18:24:15.174281 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2899/5907] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:14 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1295 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:15.295684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75f28fd3-b90a-4566-8409-63b0e7963ac1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.325283 Oct 04 18:24:15.299014 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3009/5908] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:13 2022] POST /compute/v2.1/servers => generated 408 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:15.308373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae612ada-f1b8-4690-8dac-9c6f3f5efb49 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:15.309924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae612ada-f1b8-4690-8dac-9c6f3f5efb49 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:15.537368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae612ada-f1b8-4690-8dac-9c6f3f5efb49 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:15.579594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae612ada-f1b8-4690-8dac-9c6f3f5efb49 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1245 microversion: 2.1 time: 0.271225 Oct 04 18:24:15.581029 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2900/5909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:15 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1245 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:16.203293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.203830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.213690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.214496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.215125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.216261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.218144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.218930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.330164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.342025 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d0299a5-240a-444c-bab0-e6a3914c3fde tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1295 microversion: 2.1 time: 0.143961 Oct 04 18:24:16.343434 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3010/5910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1295 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:16.623691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:16.631066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:16.664028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.664661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.665485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.667934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:16.678254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:16.678844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:16.817538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:16.827594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b18f86f-f8ac-45c5-a971-1472aaa32bac tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1297 microversion: 2.1 time: 0.220719 Oct 04 18:24:16.828475 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2901/5911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:16 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1297 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:17.381392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.385040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.403574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.404125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.411560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.412559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.413059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.413520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.861225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:17.862737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:17.885483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.889216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.892087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:17.893076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:17.893558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:17.895980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.050444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.079637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-feb70b5b-e02c-400a-99ca-c02beed7f5aa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1303 microversion: 2.1 time: 0.225014 Oct 04 18:24:18.081244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2902/5912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:18.126749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:18.139107 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b83d8e97-4380-4571-8f7c-2059b5360c21 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.776616 Oct 04 18:24:18.171432 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3011/5913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:17 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:18.394754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25b115e-53d3-4646-86ec-3b6cc9c1abff", "tag": "57057bab-7cd5-4da5-bd23-8a2418b5ce74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:18.440932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:18.443980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:18.445867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:18.479028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:18.495211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] Creating event network-changed:57057bab-7cd5-4da5-bd23-8a2418b5ce74 for instance a25b115e-53d3-4646-86ec-3b6cc9c1abff on n-h1-831194-21 Oct 04 18:24:18.509329 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1a9ebc6e-c33a-486c-a3dd-df24245ca225 req-1d09de4b-f4cb-4877-817e-03310289e376 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126040 Oct 04 18:24:18.510616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2903/5914] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:19.113728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.114444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.128537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.132295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.133707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.138750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.139466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.139900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.173543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:19.174280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:19.203930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.204436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.204889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.205644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:19.206106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:19.206551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:19.346725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.355428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-012a6008-280d-4940-9af3-034a3afdfcc2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1303 microversion: 2.1 time: 0.247437 Oct 04 18:24:19.373673 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3012/5915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:19.475564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:19.486439 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7655270d-db17-4eed-af20-e9a892d83d90 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.318217 Oct 04 18:24:19.491030 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2904/5916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:19 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:20.385393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.388147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.402749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.403592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.406195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.408571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.409591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.411180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.514717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:20.515354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:20.533630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.534281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.534836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.535853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:20.536427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:20.536971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:20.787846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:20.801799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3527edd7-0d2e-4633-abe5-be4ca918d907 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.422601 Oct 04 18:24:20.802816 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3013/5917] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:21.191192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:21.212279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.213942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.214947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.236908 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] Creating event network-changed:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:24:21.243386 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-66bd9a04-6051-46f6-9a6c-5270e07cbc78 req-7bb91a57-6462-4b28-96d0-18b881f05423 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055373 Oct 04 18:24:21.248831 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3014/5918] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:21.250722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:21.263212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8fbfde2d-3068-441a-9a8c-1787068eec9c tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.754703 Oct 04 18:24:21.264696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2905/5919] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:20 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:21.826926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:21.828558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:21.842761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.844761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.846553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:21.851925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:21.853095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:21.854754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.139311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.154497 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acadc87f-276c-4a8f-94cf-c88c120ea2e1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.328856 Oct 04 18:24:22.158297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3015/5920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:21 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:22.293679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:22.296367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:22.303477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:22.321708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.322758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.323466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.324837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:22.327402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:22.329027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:22.760489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:22.774685 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e303f7a0-0bb5-4166-a369-4096cbaad5b1 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.490486 Oct 04 18:24:22.777220 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2906/5921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:22 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:23.188683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.189564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.200527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.205318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.207146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.214441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.217747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.218346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.572504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:23.593774 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70049229-c8a6-452f-a956-c627f9bd4013 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.409395 Oct 04 18:24:23.612951 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3016/5922] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:23.802783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:23.804075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:23.830746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.833009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.835178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:23.840207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:23.841128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:23.847311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.215556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:24.231903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d96c6add-a23a-45a0-b2f8-eddcd8aedcee tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.434429 Oct 04 18:24:24.246948 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2907/5923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:23 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:24.622375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:24.623657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:24.632893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.634643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.635339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.636419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.637544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.638304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.779605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25b115e-53d3-4646-86ec-3b6cc9c1abff", "name": "network-vif-plugged", "status": "completed", "tag": "57057bab-7cd5-4da5-bd23-8a2418b5ce74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:24.827413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:24.828020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:24.828457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:24.856415 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] Creating event network-vif-plugged:57057bab-7cd5-4da5-bd23-8a2418b5ce74 for instance a25b115e-53d3-4646-86ec-3b6cc9c1abff on n-h1-831194-21 Oct 04 18:24:24.864163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-77addeee-afd6-4860-99ca-bdb83b551751 req-261dc382-b337-42e7-be0e-5dcb60efb47a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092141 Oct 04 18:24:24.865405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2908/5924] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:25.041367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:25.121168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:25.187670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.205897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6bb69fc-bdab-4573-a033-dbe4f1a285a0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.589438 Oct 04 18:24:25.207213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3017/5925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:24 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:25.280358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:25.281987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:25.292101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.292917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.293656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.295345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:25.297184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:25.298864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:25.575056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:25.650904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:25.665811 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce2c225f-b464-45bf-9c4f-531bea0453e5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1361 microversion: 2.1 time: 0.397614 Oct 04 18:24:25.668691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2909/5926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:25 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:26.252900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.255810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.283306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.284277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.285732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.310120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.310639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.311103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.692323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:26.692936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:26.708281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.708992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.709589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.710497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.711111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.711879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.779492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:26.795311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2eec893c-41d7-471b-b857-2e98adc1aeaa tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.562737 Oct 04 18:24:26.811383 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3018/5927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:26.956400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "name": "network-vif-plugged", "status": "completed", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:26.969670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:26.970382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:26.971120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:26.986144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] Creating event network-vif-plugged:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:24:26.994728 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4cf458c7-17ca-44f8-863a-df0c622b23f5 req-3b1d9aca-b2fa-4a10-aca8-fc925e89f0b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043652 Oct 04 18:24:26.996703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3019/5928] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:24:27.136216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:27.162446 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8be10ee9-5056-4f44-9395-2f368bad5378 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1546 microversion: 2.1 time: 0.473855 Oct 04 18:24:27.163795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2910/5929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:26 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1546 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:27.192219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.193377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.221287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.222139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.222855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.223756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.224387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.225302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.358192 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96e165c3-bb5c-455e-a076-2fe2ea74fcc3 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.170125 Oct 04 18:24:27.359790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3020/5930] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:27.826198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:27.827845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:27.848155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.850171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.851115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:27.852499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:27.853619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:27.854760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:28.522854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:28.554891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8cf7ba45-3c8e-4601-92a6-5a5ce0b1eba6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1370 microversion: 2.1 time: 0.733817 Oct 04 18:24:28.557076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2911/5931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:27 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1370 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:29.590454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:29.591095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:29.603987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.605670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.606159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:29.609139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:29.609859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:29.610575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.062074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a25b115e-53d3-4646-86ec-3b6cc9c1abff", "tag": "57057bab-7cd5-4da5-bd23-8a2418b5ce74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:30.079352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.087937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.088610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.119721 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] Creating event network-changed:57057bab-7cd5-4da5-bd23-8a2418b5ce74 for instance a25b115e-53d3-4646-86ec-3b6cc9c1abff on n-h1-831194-21 Oct 04 18:24:30.150044 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4281f6f7-28e4-4418-bec8-36b993d138bf req-55d8ae2e-155e-4633-a3be-e2ab79efb645 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084017 Oct 04 18:24:30.152915 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2912/5932] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:30.174183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:30.189451 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07ea52c9-dded-43a2-8635-8acfd2c8669d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1564 microversion: 2.1 time: 0.612309 Oct 04 18:24:30.197938 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3021/5933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:29 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1564 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:30.222026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:30.222710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:30.241500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.245525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.248318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.254268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:30.255116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:30.256848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:30.538444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44004114-473a-4d43-ae95-cbf8c533ba94 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.322514 Oct 04 18:24:30.539274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2913/5934] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:24:30 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-interface => generated 285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:34.087568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:34.124444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:34.128466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:34.130097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:34.168794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] Creating event network-changed:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:24:34.175438 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-138fdf53-7d70-477b-82e1-56a689b42b52 req-3ee9cc05-bd63-41d3-9bc4-2faeb23ee540 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093063 Oct 04 18:24:34.176616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3022/5935] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:45.910195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:45.911093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=51 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:45.919705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-65232204", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4f422b99-1651-4e0f-ad7c-08d983cd9638", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:46.493881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:24:47.904956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:24:47.906554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:24:47.907241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:24:47.907679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:24:47.908362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:24:47.931626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.937635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.938885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.940247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:47.941049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:47.941786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:47.976045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:24:47.986371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:24:48.076358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:24:48.080175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f422b99-1651-4e0f-ad7c-08d983cd9638',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:24:48.316702 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a0fc1e6-dfad-4872-a180-6f80116170f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.409917 Oct 04 18:24:48.328446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:48.329992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=66 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:48.334825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82ca0c9e-8c25-4c57-9a68-1496dc6cad4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:48.336454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82ca0c9e-8c25-4c57-9a68-1496dc6cad4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:48.337139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2914/5936] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:24:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:24:49.508509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-82ca0c9e-8c25-4c57-9a68-1496dc6cad4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:49.528871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82ca0c9e-8c25-4c57-9a68-1496dc6cad4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1055 microversion: 2.1 time: 1.202013 Oct 04 18:24:49.545925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3023/5937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:48 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1055 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:50.566943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:50.571871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:50.598367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.599559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.602912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.604364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:50.605794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:50.611970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:50.856501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:50.890492 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-43768cb4-bf71-4ec2-8b6e-9c34127a37bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1171 microversion: 2.1 time: 0.332646 Oct 04 18:24:50.911096 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2915/5938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:50 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1171 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:51.936576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:51.937893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:51.949633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.956337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.957184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:51.963247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:51.964175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:51.964661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:52.140827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:52.154111 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-031d5a6b-37d4-400b-809f-7c6c08df38a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1171 microversion: 2.1 time: 0.221642 Oct 04 18:24:52.158627 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3024/5939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:51 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1171 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:53.187284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:53.188117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:53.196502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.197008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.197458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:53.198448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:53.198666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:53.199105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:54.031424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:54.046915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-edbe90c0-aa85-46c3-8834-8f21b19b1696 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1213 microversion: 2.1 time: 0.863277 Oct 04 18:24:54.048840 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2916/5940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:53 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1213 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:24:55.074271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:55.075031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:55.128067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.128950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.129725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.131030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.131790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.144228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.780917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c7207f5-0bbd-4164-9dea-86e7432447f6", "tag": "75302239-3b8b-488b-b498-1813c9f144a4"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:24:55.812643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:55.814095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:55.814095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:55.834981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] Creating event network-changed:75302239-3b8b-488b-b498-1813c9f144a4 for instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 on n-h1-831194-21 Oct 04 18:24:55.848609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:55.863276 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fd607c66-96a8-4659-8469-5b7ba7aa4b0a req-26743f17-1470-4999-84ea-2d40e540a5a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086038 Oct 04 18:24:55.866269 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2917/5941] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:24:55.870158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-214dac71-9015-49e8-bc9a-bba05e4967a4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1213 microversion: 2.1 time: 0.800141 Oct 04 18:24:55.872291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3025/5942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:55 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1213 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:56.904642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:56.907411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:56.919203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.920745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.921583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:56.923298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:56.924015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:56.924973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:57.343405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:57.353822 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5e744fb-d653-437a-9811-07b63ed39d17 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1213 microversion: 2.1 time: 0.460108 Oct 04 18:24:57.370270 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2918/5943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:56 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1213 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:58.386398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:58.393630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:58.422511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.424704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.425377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.426425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:58.428312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:58.429585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:58.811716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:24:58.829745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e109f80e-7e3c-49ba-9c72-f48ac70a3c2d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1213 microversion: 2.1 time: 0.450768 Oct 04 18:24:58.831683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3026/5944] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:58 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1213 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:24:59.879268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:24:59.881482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:24:59.892680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:59.895383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:24:59.912292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.913564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.914901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:24:59.916695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:24:59.917799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:24:59.918854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:00.326434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:00.341697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a616b45f-6518-4671-83b5-6faaba658e8b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.475491 Oct 04 18:25:00.342711 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2919/5945] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:24:59 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:01.374378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:01.375208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:01.388312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:01.391329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.391881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.392827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.394115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:01.395483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:01.398530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:01.870434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:01.886090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-39d689cf-d96e-4864-b9e2-44f77751e101 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.522337 Oct 04 18:25:01.887334 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3027/5946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:01 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:02.921100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:02.921750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:02.937030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.938675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.940363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:02.942218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:02.942711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:02.943336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:03.271253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:03.291798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0301d0cd-e5a5-4c31-8986-fb1b117d7ea5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.374251 Oct 04 18:25:03.293114 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2920/5947] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:02 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:04.324129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:04.324866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:04.343098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.344305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.345441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.349133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:04.349633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:04.350136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:04.749071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:04.758917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2778e63-db9b-4eb8-8aa0-c958e8a3836d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.442499 Oct 04 18:25:04.774491 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3028/5948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:04 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:05.247360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:05.248468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:05.260114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.260988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.261798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.262767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.264036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.264833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.308558 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0be4db63-fa6a-4bf2-9b0d-eb96ca16c53f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/ips" status: 200 len: 143 microversion: 2.1 time: 0.065083 Oct 04 18:25:05.310394 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2921/5949] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:25:05 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/ips => generated 143 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:05.787784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:05.790052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:05.838911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.839948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.840871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:05.845810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:05.847018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:05.848089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.258583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:06.266904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:06.300847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.302300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.303963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.305575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:06.306705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:06.307697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:06.387542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:06.405170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9acf03f-797f-4e68-a81c-ee7015304572 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.624497 Oct 04 18:25:06.419036 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3029/5950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:05 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:07.156248 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-678b139b-e8af-49b3-a8b7-9a5d11a20b79 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904265 Oct 04 18:25:07.163357 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2922/5951] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:25:06 2022] POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 194 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:07.449581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:07.460473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:07.496434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.496955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.497739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.498912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:07.499631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:07.511261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:07.977516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:07.989016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e6f8038-eceb-4f91-95cd-cea9bae9729a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.562867 Oct 04 18:25:07.993693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3030/5952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:07 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:08.346003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f57db0d5-9ea8-4d06-82dc-70f419088827"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:08.371146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:08.422921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.429663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.430952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:08.434207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:08.437346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:08.440026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.024503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:09.025652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:09.052265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.052783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.053237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.055005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:09.062420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:09.064368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:09.536593 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3c9447f-0d6c-4676-a295-c9a68c9b6158 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.213956 Oct 04 18:25:09.547587 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2923/5953] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:25:08 2022] POST /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 194 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:09.574779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:09.593813 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-810d6912-fa1a-456c-8152-d34670cd46ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.583350 Oct 04 18:25:09.597189 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3031/5954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:09 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:10.660473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:10.661725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:10.685433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.687729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.689150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:10.690976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:10.692196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:10.693574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.165402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7207f5-0bbd-4164-9dea-86e7432447f6", "name": "network-vif-plugged", "status": "completed", "tag": "75302239-3b8b-488b-b498-1813c9f144a4"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:11.186155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:11.186644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:11.187065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:11.217967 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] Creating event network-vif-plugged:75302239-3b8b-488b-b498-1813c9f144a4 for instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 on n-h1-831194-21 Oct 04 18:25:11.237423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-d5563f52-be29-482c-a41c-95e2d8b73de7 req-c9e84226-9e85-4ab8-a2dc-c3161dcc0d79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075304 Oct 04 18:25:11.242004 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3032/5955] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:11.675128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:11.717705 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-750cfb0b-dc00-4639-afc6-321a12046b2a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 1.071353 Oct 04 18:25:11.720963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2924/5956] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:10 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:12.750877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:12.752092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:12.770352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.771592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.772495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:12.774192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:12.775400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:12.776879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:13.151461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:13.167826 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a39cb6e-d06e-4860-b7ec-2a8152eab33b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1201 microversion: 2.1 time: 0.424859 Oct 04 18:25:13.188530 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3033/5957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:12 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1201 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:14.198378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:14.200726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:14.216470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.218700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.220309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.222021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.223201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.225426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.503653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:14.530196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0bba56e-1551-4f10-847d-724c8b235729 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1387 microversion: 2.1 time: 0.337783 Oct 04 18:25:14.542784 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2925/5958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:14 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1387 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:14.571363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:14.572480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:14.585465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.585966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.587506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:14.588910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:14.589969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:14.590875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.302101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.320843 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56207149-b87d-4fed-8ed7-50db6cd84d37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1387 microversion: 2.1 time: 0.756722 Oct 04 18:25:15.323028 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3034/5959] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:14 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1387 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:15.349676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.351097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.370019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.372053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.373194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.375108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.377409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.378822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.721463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:15.733016 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-141b7f3e-b6a0-40df-8359-3e448f390e12 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1387 microversion: 2.1 time: 0.388050 Oct 04 18:25:15.733931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2926/5960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:15 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1387 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:15.761348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.762999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:15.770548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.771454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.772577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.773875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:15.774625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:15.775292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:15.812045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:25:15.948562 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6786323f-5b7b-460b-8768-c88b81cc3b62 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 204 len: 0 microversion: 2.1 time: 0.189271 Oct 04 18:25:15.953800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3035/5961] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:25:15 2022] DELETE /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:25:15.970371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:15.974142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:16.002381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:16.006876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.014045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.015765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.020262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:16.024603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:16.025896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:16.034785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:16.443264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:16.461856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-761eb6f3-f2f7-41fd-8bc6-3929568e9aa7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1393 microversion: 2.1 time: 0.500467 Oct 04 18:25:16.479174 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2927/5962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:15 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1393 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:17.497543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:17.499942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:17.513777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.515177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.516317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.518076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:17.519269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:17.520441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:17.957589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:17.979851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4801fd9-a4ef-4861-b32b-0856a3ceaa00 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1393 microversion: 2.1 time: 0.492161 Oct 04 18:25:17.987219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3036/5963] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:17 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1393 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:19.008021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c7207f5-0bbd-4164-9dea-86e7432447f6", "name": "network-vif-deleted", "tag": "75302239-3b8b-488b-b498-1813c9f144a4"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:19.017778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:19.019162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:19.046953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:19.051001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.054731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.057798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.061313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.062243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:19.065539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.066809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:19.067658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.070835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:19.091653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:19.122912 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] Creating event network-vif-deleted:75302239-3b8b-488b-b498-1813c9f144a4 for instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 on n-h1-831194-21 Oct 04 18:25:19.136839 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-57d0c574-5e4c-4448-864f-968f75262763 req-54909087-9c5c-44e7-a3c0-92b59712362f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.477168 Oct 04 18:25:19.137964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2928/5964] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:19.329719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:19.342669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4dd48113-d516-4d58-a886-e535f1a46842 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.329290 Oct 04 18:25:19.344000 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3037/5965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:19 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:20.389496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:20.401277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:20.426698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.428025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.429081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.430735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:20.431861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:20.432902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:20.660113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:20.712884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e41a1d56-cb01-413e-a2ea-d23d4378022b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.332444 Oct 04 18:25:20.714657 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2929/5966] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:20 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:21.755097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:21.760280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:21.787751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.794770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.808677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.810815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:21.820222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:21.825672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:21.975758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:21.998173 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8f868d4-d58f-448d-acd7-21ae00361b65 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.249662 Oct 04 18:25:22.000327 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3038/5967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:21 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:23.042026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:23.043349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:23.098834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.105063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.108753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.113446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:23.115617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:23.121178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:23.336552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:23.353580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac5eee0a-717d-4d22-9ec8-269a87095d1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.330798 Oct 04 18:25:23.354978 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2930/5968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:23 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:24.415713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:24.417034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:24.426096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.427027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.427805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.429219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:24.429948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:24.430569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:24.572716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:24.595802 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cd5fb44a-34d5-446f-ba4d-8118f403b2c2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.184335 Oct 04 18:25:24.605002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3039/5969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:24 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:25.624208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:25.625110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:25.647101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.648214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.658665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.659758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:25.661584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:25.662618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:25.826616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:25.839748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a925ade-7319-4108-8ddf-e109d231143e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.219734 Oct 04 18:25:25.840886 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2931/5970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:25 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:26.868886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:26.872940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.896616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:26.897694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:26.898896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.899936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.901019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.902075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.902670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.903226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.919191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.919855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.926884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.938071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:26.938071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:26.938071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:26.951789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'flavor' on Instance uuid c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:27.269560 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-639ec32a-f7d3-4b64-96ff-d1437823036d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/action" status: 200 len: 32 microversion: 2.1 time: 0.403705 Oct 04 18:25:27.271751 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3040/5971] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:25:26 2022] POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/action => generated 32 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:25:27.298617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:27.300317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:27.312284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.313080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.313969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:27.315119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:27.315793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:27.316748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:27.320874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.357102 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-05c64379-8005-4e70-bf12-ac2f7b7e1786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.465747 Oct 04 18:25:27.388138 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2932/5972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:26 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:27.859722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:27.870261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-152b7545-951f-43c2-89ae-4f11a800cbdf tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.582038 Oct 04 18:25:27.870261 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3041/5973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:27 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:28.426350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.428122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.444538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.446307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.448003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.449597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.450999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.452070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.869417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:28.896998 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f96e32b-9a68-48ea-9584-3c7e75c20667 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.494485 Oct 04 18:25:28.898683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2933/5974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:28.919552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:28.923357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:28.952029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.954457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.965663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:28.967129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:28.968630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:28.969790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.056968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.063181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.093150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.109731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.111382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.116661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.118523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.120190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.215700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-604e654b-7638-480c-b2aa-4e95311a02f5 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.170165 Oct 04 18:25:29.226939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2934/5975] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 197 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:29.259467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.260374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.270922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.272311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.273065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.274330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.275153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.276328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.323318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:29.345101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c788259d-598d-47ea-b699-b721e7d0034a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.433596 Oct 04 18:25:29.346109 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3042/5976] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:28 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:29.350696 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa03ecb5-5e01-49cc-9429-56316e52cf3d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827" status: 200 len: 194 microversion: 2.1 time: 0.112841 Oct 04 18:25:29.352017 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2935/5977] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827 => generated 194 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:29.953058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:29.953928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:29.983601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.985997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.987833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:29.994931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:29.995649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:29.996247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.139115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:30.164575 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e9a869a-898f-4529-8f2c-be7857d21024 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.211610 Oct 04 18:25:30.167181 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3043/5978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:29 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:30.390667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:30.392713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:30.408120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.410080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.411383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:30.415657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:30.416563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:30.418280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.064973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.121688 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76d5b46c-88eb-4974-9f85-c13117cfbc55 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.739223 Oct 04 18:25:31.124425 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2936/5979] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:30 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:31.219767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:31.221953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:31.231961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.233377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.234461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.242838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:31.245311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:31.246450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:31.371619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:31.393163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f427b42-6836-4e46-92cc-a7de588d905e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 200 len: 1186 microversion: 2.1 time: 0.181773 Oct 04 18:25:31.403254 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3044/5980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:31 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 1186 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:32.179729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.182340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.216077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.218525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.219885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.222255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.224525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.230936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.384287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d339406f-b6c4-452d-9412-7f2e5055a7ad"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:32.389364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.403269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.404485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.405410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.406891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.407958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.408927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.711968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:32.736369 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3fae6dbf-6223-4464-84e7-7ba0190b6ac2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.570159 Oct 04 18:25:32.737736 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2937/5981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:32.749238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:32.750805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 4c7207f5-0bbd-4164-9dea-86e7432447f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:32.768987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.769814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.770740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.773223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:32.775217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:32.776052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:32.801621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 HTTP/1.1 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4c7207f5-0bbd-4164-9dea-86e7432447f6'} Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:25:32.816308 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance 4c7207f5-0bbd-4164-9dea-86e7432447f6 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7fea4c0-663a-47f9-b8b7-b6699e44818f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6" status: 404 len: 111 microversion: 2.1 time: 0.085207 Oct 04 18:25:32.830353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2938/5982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:32 2022] GET /compute/v2.1/servers/4c7207f5-0bbd-4164-9dea-86e7432447f6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:25:32.960630 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ff90f31-8692-4ca7-8810-94aadd51732d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "POST /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581604 Oct 04 18:25:32.962826 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3045/5983] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:25:32 2022] POST /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:25:33.772732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:33.773792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:33.797659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.806826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.807697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:33.808952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:33.809767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:33.810579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:34.291585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:34.304003 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30f7e932-6111-4f5b-b0f3-f9c8cb05d61b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.538864 Oct 04 18:25:34.318230 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2939/5984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:33 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:35.370746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:35.376711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:35.393732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.395414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.397454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:35.399404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:35.400479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:35.401446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:36.084924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:36.112159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a4e78fc7-cd85-418b-b5a8-9bc545640fd2 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.756173 Oct 04 18:25:36.117813 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3046/5985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:35 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:37.144155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:37.145133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:37.158144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.158627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.165044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.165815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:37.166511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:37.167121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:37.842931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:37.865571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50039391-aa3e-4fd1-95e0-e61232c4feec tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.714857 Oct 04 18:25:37.867107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2940/5986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:37 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:38.900856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:38.902637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:38.917736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.928180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.929096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:38.930770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:38.931726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:38.932418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:39.818108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:39.832624 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d52629f-113f-4133-9703-4b7a970e932e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.937916 Oct 04 18:25:39.836754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3047/5987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:38 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:40.883291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:40.884464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:40.912517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.922102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.922597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:40.923413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:40.923850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:40.924292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:41.666580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:41.676477 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d4d206b0-c9d3-4e89-be6d-7abc172685be tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.805234 Oct 04 18:25:41.681010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2941/5988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:40 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:42.719471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:42.721600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:42.750017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:42.754601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:42.756087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:42.764928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:42.766191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:42.767267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:43.263723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1462666351", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "80c79263-2689-4547-8737-5a8512af355f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:43.269002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:43.298795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68ed508e-21f6-4e55-9a17-801d53031406 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.585997 Oct 04 18:25:43.299782 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3048/5989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:42 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:43.393033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:25:44.215615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:25:44.216371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:25:44.216889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:25:44.217575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:25:44.218207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:25:44.235401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.236921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.237373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.238217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.238693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.239734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.262397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:25:44.269375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:25:44.331341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.338481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.361013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:25:44.361708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='80c79263-2689-4547-8737-5a8512af355f',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:25:44.382287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.383703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.384205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.384977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:44.392178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:44.392714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:44.588576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b6fa79b-d973-4f88-ae90-1b75745fd955 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327141 Oct 04 18:25:44.605423 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2942/5990] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:25:44.622251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4b7a154e-3479-404e-b1d4-589f3b9c7c9c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:44.625092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4b7a154e-3479-404e-b1d4-589f3b9c7c9c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:44.750287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4b7a154e-3479-404e-b1d4-589f3b9c7c9c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:44.763518 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4b7a154e-3479-404e-b1d4-589f3b9c7c9c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1057 microversion: 2.1 time: 0.151564 Oct 04 18:25:44.780273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2943/5991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1057 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:44.837921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:44.851860 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ee09863-741d-418e-85fd-c68fe2db9e1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.529348 Oct 04 18:25:44.869982 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3049/5992] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:44 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:45.791464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:45.792180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:45.802423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.803766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.804443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.805470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.806290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.806972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.882406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:45.883495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:45.896098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.896680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.897357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.898430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:45.898905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:45.899337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:45.916300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:45.967960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:45.982284 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-278a3c72-3a5b-4823-90c8-608e271988e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1155 microversion: 2.1 time: 0.196654 Oct 04 18:25:45.984222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2944/5993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:45 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1155 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:46.164056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:46.190715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5ea5907-3f53-4e5a-a881-748bf4242d7a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.302263 Oct 04 18:25:46.191689 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3050/5994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:45 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:47.028784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:47.034855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:47.046734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:47.050661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.052425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.053157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.054368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.055123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.055792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.110334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=90 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:47.227686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:47.228939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:47.239782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.240774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.241668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.242648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:47.243392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:47.244293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:47.262099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:47.277990 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-807637b0-6ba7-4915-bf9d-ae8aa5e4550b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1173 microversion: 2.1 time: 0.255361 Oct 04 18:25:47.304808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2945/5995] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:47 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1173 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:47.571794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:47.605090 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea292195-1196-4bf7-9c63-2f8bb2c01c1e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.382885 Oct 04 18:25:47.606223 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3051/5996] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:47 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:48.324360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:48.325553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:48.354150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.358971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.361026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.364834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.365665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.366918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.662952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:48.675783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:48.707284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.708665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.730941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.733178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:48.734461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:48.736898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:48.885700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:48.925712 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b9a8140-07e3-4db2-82c1-fb45c698dcd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.610512 Oct 04 18:25:48.927139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2946/5997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:48 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:49.292936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:49.317374 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5df6d062-d46c-4d5a-9727-5c1992e849c7 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.680967 Oct 04 18:25:49.321260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3052/5998] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:48 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:49.967502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:49.968970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:49.993440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.994227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.995002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:49.995921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:49.996803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:49.997354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.348218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.349822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.361232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=32 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:50.370914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.371738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.372376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.373313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.381151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.382489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.830500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:50.845251 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7a342a9-9ada-4868-9d96-54fc7d03aa5e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.882204 Oct 04 18:25:50.850244 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2947/5999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:49 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:50.865181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:50.869766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:50.887874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.891253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.902664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:50.904036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:50.904712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:50.906320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.043206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9549ac5e-91dd-46fd-8162-6190ade0630f tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.191300 Oct 04 18:25:51.043957 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2948/6000] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:51.077014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:51.108547 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-789d69e7-9508-43eb-bfc0-81d35d11c24e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.766027 Oct 04 18:25:51.110761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3053/6001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:50 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:51.218067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.219545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.248286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.248886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.249376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.250186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.250813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.251385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.303523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5708720-14b7-4f81-b032-48e82a4f826d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827" status: 200 len: 194 microversion: 2.1 time: 0.105421 Oct 04 18:25:51.305133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2949/6002] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827 => generated 194 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:51.318369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.319661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.327313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.328387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.329647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.331052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.332158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.333038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.464477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lazy-loading 'services' on Instance uuid a25b115e-53d3-4646-86ec-3b6cc9c1abff {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:25:51.613348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58c90e5b-3d58-435c-90ff-7e4dbaa4ae07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827" status: 202 len: 0 microversion: 2.1 time: 0.300671 Oct 04 18:25:51.615157 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3054/6003] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:25:51 2022] DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/f57db0d5-9ea8-4d06-82dc-70f419088827 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:25:51.874817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:51.881519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:51.904369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.905661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.906726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:51.908580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:51.910296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:51.912718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.168105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:52.173688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:52.204243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.206139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.207335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.209672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.212053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.219213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.772733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:52.788344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:52.830832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4acc49d2-cffb-4ad4-8f6f-fd85c35a06f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.964159 Oct 04 18:25:52.838131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ff4f8e1-3bd6-4d0a-8313-0250e7c534b6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.699134 Oct 04 18:25:52.863587 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3055/6004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:52 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.869637 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2950/6005] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:51 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:52.889233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3800e20d-48e7-42ac-8f0b-329fb724fa74", "tag": "b5a99569-3ebc-431e-84ac-8145fe798253"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:25:52.911332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:52.916006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:52.920137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:52.972400 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] Creating event network-changed:b5a99569-3ebc-431e-84ac-8145fe798253 for instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 on n-h1-831194-21 Oct 04 18:25:52.992757 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c266e197-0481-44d4-b01a-a743ef9277c2 req-86061644-4420-49dc-9cfb-d928789199ac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126747 Oct 04 18:25:52.993704 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3056/6006] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:25:53.888434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.889350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.893251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:53.901196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:53.907259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.907922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.908386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.909130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.909606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.910101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.914268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.915779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.920066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:53.921188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:53.922613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:53.923305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:54.228586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.250355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:54.258238 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9154f9f-1754-4776-9e45-fc3cc084138d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.375992 Oct 04 18:25:54.281127 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3057/6007] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:53 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:25:54.664051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:54.679842 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4ef7784-6bb4-4188-b83c-2f5c23ab569b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.807836 Oct 04 18:25:54.680848 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2951/6008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:53 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:55.306858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.312311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.323914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.324714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.325336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.326403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.327091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.327753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.709393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:55.710207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:55.715937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:25:55.724886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.737547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.738231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.739222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:55.739841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:55.740585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:55.788552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:55.842500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5990791c-8ba9-49a5-b879-80fc6b75ac45 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1735 microversion: 2.1 time: 0.548574 Oct 04 18:25:55.843579 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3058/6009] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1735 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:56.163770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:56.201070 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7f342ab5-44e3-4c57-a88d-a7307377075d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.495718 Oct 04 18:25:56.202863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2952/6010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:55 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:56.904405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:56.930120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:56.951498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.952732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.960003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:56.965652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:56.969376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:56.977711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.229437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.230385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.251202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.252097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.253070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.255025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.255878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.256472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.319696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:57.343596 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a68fcf70-c4a9-42bb-ae22-2b4483b899fc tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1715 microversion: 2.1 time: 0.470988 Oct 04 18:25:57.344566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3059/6011] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:56 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1715 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:57.603577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:57.603577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:57.634694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.637529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.638463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.641925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:57.647988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:57.651191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:57.672098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:57.687748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b078db4f-e9b5-429f-80f0-6155c5abb1b3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.461118 Oct 04 18:25:57.701482 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2953/6012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:57 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:25:58.718898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:25:58.720643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:25:58.732990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.734719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.735828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:58.736922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:25:58.737574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:25:58.738301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:25:59.001776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:25:59.013189 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37bb33ab-26a1-4034-8534-4bd7e6dde98a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.299040 Oct 04 18:25:59.031373 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2954/6013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:25:58 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:00.040743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:00.041932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:00.066919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.072836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.073517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.074991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.078605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.083689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.467525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:00.503326 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-502b459f-76a2-4b20-91e3-2cd3b26fd55d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.465730 Oct 04 18:26:00.518602 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2955/6014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:00 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:00.530117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:00.530948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:00.548151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.548654 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Cannot 'detach_volume' instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 while it is in vm_state rescued Oct 04 18:26:00.549447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.550244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.553585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.554336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.555060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments/9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8 HTTP/1.1 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'detach_volume' instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 while it is in vm_state rescued Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': 'c1b28ca7-0ab8-4c59-ace4-8f5dde25a084', 'id': '9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8'} Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 while it is in vm_state rescued Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:00.557051 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 while it is in vm_state rescued Oct 04 18:26:00.564566 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:00.572357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 409 to user: Cannot 'detach_volume' instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 while it is in vm_state rescued {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:00.574255 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0bdbd47c-c610-4cb0-9817-37d86edcce4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments/9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8" status: 409 len: 152 microversion: 2.1 time: 2.975893 Oct 04 18:26:00.606450 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3060/6015] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:25:57 2022] DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments/9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8 => generated 152 bytes in 3009 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:26:00.625700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4cb046ff-d34f-478d-a49b-732d8312f43d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/d339406f-b6c4-452d-9412-7f2e5055a7ad" status: 200 len: 194 microversion: 2.1 time: 0.104287 Oct 04 18:26:00.627739 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2956/6016] 10.222.0.42 () {58 vars in 1413 bytes} [Tue Oct 4 18:26:00 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/d339406f-b6c4-452d-9412-7f2e5055a7ad => generated 194 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:00.630094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:00.634994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:00.640361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:00.641159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:00.653967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.655300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.656788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.659616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.663139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.663782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.666168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.671584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.672749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.675045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.676789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.679076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.851469 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4eb9f3c5-ba04-4e6a-bea0-40eaa378609a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/action" status: 202 len: 0 microversion: 2.1 time: 0.242391 Oct 04 18:26:00.856526 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3061/6017] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:00 2022] POST /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:00.867582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:00.868835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:00.877623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.878645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.880104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.881703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:00.882541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:00.883401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:00.993060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lazy-loading 'services' on Instance uuid a25b115e-53d3-4646-86ec-3b6cc9c1abff {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:01.120299 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b33c4f3-a670-41ec-9512-3d84d6c9ec51 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/d339406f-b6c4-452d-9412-7f2e5055a7ad" status: 202 len: 0 microversion: 2.1 time: 0.484605 Oct 04 18:26:01.125710 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2957/6018] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:26:00 2022] DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments/d339406f-b6c4-452d-9412-7f2e5055a7ad => generated 0 bytes in 491 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:01.468031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:01.490319 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fcd8ec46-04ac-49fb-ba66-31fa4eb1010c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1723 microversion: 2.1 time: 0.631976 Oct 04 18:26:01.491252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3062/6019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:00 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1723 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:01.532724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:01.533489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:01.543079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.543898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.544518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.550092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:01.551196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:01.551927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:01.886603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:01.905209 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1d6890a-6021-4b8e-8c24-510aff288eb7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.378093 Oct 04 18:26:01.908818 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2958/6020] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:01 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:02.522065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:02.523197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:02.558869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:02.559770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:02.560536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:02.561785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:02.562642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:02.563402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:02.969010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:02.970323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:02.997527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:02.998489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:02.999188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:03.000645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:03.001699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:03.002424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:03.496791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:03.528971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6bdd27c-39d1-4637-b25c-9e7c3e5bcf5b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 0.570777 Oct 04 18:26:03.533131 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2959/6021] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:02 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:04.516474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:04.539932 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb4ebee2-c79a-4fa8-9a65-ce3deebf2c56 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1723 microversion: 2.1 time: 2.023977 Oct 04 18:26:04.544211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3063/6022] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:02 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1723 bytes in 2029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:04.562310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:04.563100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:04.594474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.600067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.601485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:04.606996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:04.608402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:04.611190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.582315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:05.584067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:05.601600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.602589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.603269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.605046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:05.605764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:05.606720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:05.773574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:05.806045 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-85322239-89e6-498d-b562-b6e808a832a6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1215 microversion: 2.1 time: 1.244058 Oct 04 18:26:05.806958 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2960/6023] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:04 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1215 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:06.035821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:06.046909 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7d2952b6-1e44-4cde-8e75-b7c172003e4e tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1729 microversion: 2.1 time: 0.469772 Oct 04 18:26:06.061876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3064/6024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:05 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1729 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:06.096752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:06.097587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:06.129883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.130404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.130856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.131678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.132142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.132573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.140656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:06.353748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-227778cf-aad2-4b9a-a5de-cd41614a3e12 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.267130 Oct 04 18:26:06.355652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2961/6025] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:26:06 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-interface => generated 285 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:06.833974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:06.836477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:06.860075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.861052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.862668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:06.864837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:06.865498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:06.866460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:07.259875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:07.277261 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f512e12a-045b-4270-911c-dd6abcfbce0b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.450069 Oct 04 18:26:07.278576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3065/6026] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:06 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:08.314899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:08.315844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:08.355602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.356436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.357080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:08.358022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:08.358663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:08.359274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.254268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:09.255824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:09.266459 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f32de3b6-1f9d-4ee8-968e-c4f68533784f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.959182 Oct 04 18:26:09.285768 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2962/6027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:08 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:09.301225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:09.301878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:09.302334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:09.322759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:09.362686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] Creating event network-changed:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:26:09.376571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8b9a9310-5a55-4ba6-8513-182ee113165c req-82661f7f-6406-4ce1-a079-0d46666cb9cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128948 Oct 04 18:26:09.382396 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3066/6028] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:10.295570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:10.296206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:10.312618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.313139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.313599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.324863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:10.325577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:10.326270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:10.994125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:11.011959 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9505597f-e5d6-4d9a-923c-e84df75f2365 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.720488 Oct 04 18:26:11.013002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2963/6029] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:10 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:11.427905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:11.469650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:11.471050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:11.474091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:11.492100 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] Creating event network-changed:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:26:11.498443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0dd9521c-de2e-4b77-8d21-96ac2981c6d1 req-766038e5-51f7-465f-bb96-6482f417dd6d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083922 Oct 04 18:26:11.499691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3067/6030] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:12.053006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.063732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.085204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.088743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.091618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.092640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.093448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.094403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.600939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:12.617334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52266b42-bff4-4169-838c-9c816e0d3745 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.571619 Oct 04 18:26:12.618914 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2964/6031] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:12 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:12.682335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.686688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.698328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.698977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.699569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.702056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.702795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.703395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.765782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1432b0f-1b6b-4669-81ee-5135f031c6dc tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092975 Oct 04 18:26:12.766823 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3068/6032] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:12 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:26:12.966611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:12.970390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:12.980818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.981338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.981896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:12.982749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:12.983346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:12.983858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.032946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33e457d6-072e-49fa-b226-df9cd0f9049b tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075309 Oct 04 18:26:13.035192 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2965/6033] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:12 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:26:13.153912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:13.154736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.162491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.163288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.163970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.164973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.165476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.165976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.196027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:13.339662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-703fd9ef-5c41-4319-9904-e16cd7cdbc25 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 204 len: 0 microversion: 2.1 time: 0.190181 Oct 04 18:26:13.346487 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3069/6034] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:13 2022] DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:26:13.355479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:13.357523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.387776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.388409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.389002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.389869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.390483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.391137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.657717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.674742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c6f999f-5433-49b1-a079-b5427f7bb980 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1669 microversion: 2.1 time: 0.326171 Oct 04 18:26:13.676187 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2966/6035] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:13 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1669 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:13.693086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:13.694613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:13.702621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.703577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.704299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.705336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:13.706125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:13.707333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:13.976154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:13.994858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48835632-3261-4081-bae7-a55232ac183e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.323047 Oct 04 18:26:13.996057 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3070/6036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:13 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:14.705184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:14.706529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:14.720369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.721499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.724062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.726543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:14.727994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:14.728906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:14.955808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:14.965444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f34378c-c699-419a-84a5-e8233b23971d tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1669 microversion: 2.1 time: 0.268843 Oct 04 18:26:14.966223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2967/6037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:14 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1669 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:15.029063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:15.031063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:15.034952 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:26:15.038672 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:26:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 (ip 10.222.0.42) !!! Oct 04 18:26:15.057625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.058605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.059357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.061356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.062070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.062699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.571828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3800e20d-48e7-42ac-8f0b-329fb724fa74", "name": "network-vif-plugged", "status": "completed", "tag": "b5a99569-3ebc-431e-84ac-8145fe798253"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:15.578686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:15.591408 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-edea178e-3d2d-4edc-863a-db7cd1409550 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 0.569011 Oct 04 18:26:15.593902 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3071/6038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:15 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:15.613225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:15.614796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:15.615476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:15.637530 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] Creating event network-vif-plugged:b5a99569-3ebc-431e-84ac-8145fe798253 for instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 on n-h1-831194-21 Oct 04 18:26:15.647719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-cb38d3e7-bbcd-44d5-a724-fd36130adc4f req-1842580c-c301-42a1-8669-d486a5cb2806 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191239 Oct 04 18:26:15.649110 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2968/6039] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:16.001332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:16.002246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:16.016363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.017404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.021273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.022323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.023039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.023648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.638268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:16.641899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:16.662972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.663549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.664010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.664895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:16.665191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:16.665631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:16.842896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:16.865336 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9d1fb15-cd4b-4044-bd50-6cde74120978 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1669 microversion: 2.1 time: 0.869864 Oct 04 18:26:16.867666 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3072/6040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:15 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1669 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:17.824783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:17.861843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5faf024-a66d-4bdb-b660-bcfda319f6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1203 microversion: 2.1 time: 1.236121 Oct 04 18:26:17.863622 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2969/6041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:16 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1203 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:17.900578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:17.900578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:17.910302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.910647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.917976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:17.919100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:17.919741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:17.920350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.058670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7481f17bf5b142aaadc3e41dfbc68f9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65290c2428b14d898e10a90d66918ca0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:18.086534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a25b115e-53d3-4646-86ec-3b6cc9c1abff", "name": "network-vif-deleted", "tag": "57057bab-7cd5-4da5-bd23-8a2418b5ce74"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:18.105186 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6001ce0e-b616-4fe1-ad45-0a631d7a4eb8 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 200 len: 1603 microversion: 2.1 time: 0.208434 Oct 04 18:26:18.141546 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3073/6042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:17 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 1603 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:26:18.141754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=50 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:18.146718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.147212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.147795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.226143 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] Creating event network-vif-deleted:57057bab-7cd5-4da5-bd23-8a2418b5ce74 for instance a25b115e-53d3-4646-86ec-3b6cc9c1abff on n-h1-831194-21 Oct 04 18:26:18.249539 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d0c133fb-eb3c-4d23-8b94-a377e32ac12c req-1c48bb8c-41c4-45dc-bb58-6625be84b523 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175354 Oct 04 18:26:18.255435 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2970/6043] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:18.889334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:18.889997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:18.900790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.901365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.902220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:18.902580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:18.903050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:18.904365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.192659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.193380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.213580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.218691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.219573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.220094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.220400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.220813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.271921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff HTTP/1.1 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a25b115e-53d3-4646-86ec-3b6cc9c1abff'} Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:19.276874 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:19.286750 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:19.290950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:19.290950 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-31ab8299-ebd5-42ea-93ff-bd31660b4264 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 404 len: 111 microversion: 2.1 time: 0.102576 Oct 04 18:26:19.292081 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2971/6044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:26:19.312277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-62769367-9354-4a1b-80ff-4dfb72bccc07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '.version_select at 0x7fbdbc90f670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.323705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.352327 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-710ea5c4-2770-4423-ba7f-2686be210d8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1389 microversion: 2.1 time: 0.466558 Oct 04 18:26:19.355043 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3074/6045] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:18 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1389 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:19.369154 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-62769367-9354-4a1b-80ff-4dfb72bccc07 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-726402679" status: 202 len: 0 microversion: 2.1 time: 0.070855 Oct 04 18:26:19.369910 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2972/6046] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 18:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-726402679 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:26:19.386827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.389513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.428080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.428727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.429206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.430062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.430566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.431103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.903269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:19.928406 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7cb19101-7ae1-4b68-a479-495ddd353f74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1389 microversion: 2.1 time: 0.550913 Oct 04 18:26:19.929820 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3075/6047] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1389 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:19.970204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:19.972937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:19.981474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.982316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.982958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:19.984022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:19.984816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:19.985427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.347434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:20.368081 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-932892d5-4129-405f-abc1-ed4c0cc5a111 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1389 microversion: 2.1 time: 0.401781 Oct 04 18:26:20.369054 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2973/6048] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:19 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1389 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:20.395890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:20.397675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:20.399713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:20.406665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.407704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.408662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.410408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.412010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.412463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.456286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:20.591191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e74acc20-3302-41a2-94ad-9bc96dee3eb0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 204 len: 0 microversion: 2.1 time: 0.200304 Oct 04 18:26:20.592190 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3076/6049] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:20 2022] DELETE /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:26:20.605373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:20.606970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:20.622258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.623807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.624792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:20.625812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:20.626658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:20.639464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:21.080482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:21.090417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f11bac5f-0a77-4631-92f4-c797e1803045 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1395 microversion: 2.1 time: 0.490302 Oct 04 18:26:21.094812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2974/6050] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:20 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1395 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:22.131672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:22.134247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:22.161642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.162592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.164568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.166484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:22.170611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:22.179418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:22.389421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:22.404028 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7e384526-ee3e-4d4f-b242-7b6447ab929d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1395 microversion: 2.1 time: 0.284515 Oct 04 18:26:22.416025 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3077/6051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:22 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1395 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:23.223651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3800e20d-48e7-42ac-8f0b-329fb724fa74", "name": "network-vif-deleted", "tag": "b5a99569-3ebc-431e-84ac-8145fe798253"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:23.256418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.256914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.257361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.287597 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] Creating event network-vif-deleted:b5a99569-3ebc-431e-84ac-8145fe798253 for instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 on n-h1-831194-21 Oct 04 18:26:23.296801 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f88967ef-5ad2-4ff6-a58d-79b9aecf3fa6 req-d4da62a1-a3cc-40e7-80a1-0c907ee1e25f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086568 Oct 04 18:26:23.298478 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2975/6052] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:23.448187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:23.450669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:23.476340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.478014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.479101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.484390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:23.487559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:23.488766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:23.716087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:23.729796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cff40dab-d52b-4cc2-aa7d-cb4cc0c4a4a3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.290329 Oct 04 18:26:23.733003 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3078/6053] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:23 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:24.777868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:24.778714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:24.794713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.795667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.798148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.800884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:24.802880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:24.809181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:24.992182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:25.010961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7a7c939-863a-4af9-9271-142091707514 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.239858 Oct 04 18:26:25.012300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2976/6054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:24 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:26.060959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:26.061439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:26.076700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.080464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.082490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.084292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:26.086687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:26.087159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:26.282237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:26.296534 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-561d23a5-3150-456b-a4cb-e9d6c5e69874 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.245248 Oct 04 18:26:26.297483 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3079/6055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:26 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:27.328935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:27.330349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:27.342918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.349877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.350674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.351687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:27.352344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:27.352976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:27.442652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:27.454019 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c17f0cf-29c0-4beb-9527-0af385552e4d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.130291 Oct 04 18:26:27.455291 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2977/6056] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:27 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:28.484110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:28.486282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:28.503352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.503877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.504358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.505181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:28.505711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:28.506185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:28.611373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:28.628905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:28.632944 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0aab047-2bed-4f01-85cc-c161670f9172 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.155526 Oct 04 18:26:28.634012 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3080/6057] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:28 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:29.661649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:29.662575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:29.683037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.686700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.688384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.695385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:29.700902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:29.701693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:29.899118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:29.909895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-601b2eaa-7aaf-43b1-9eca-4ff8900b7724 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.255659 Oct 04 18:26:29.926722 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2978/6058] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:29 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:30.936322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:30.937194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:30.964891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.968470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.969371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:30.971399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:30.973662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:30.975442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:31.151823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:31.166677 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e334f2c2-41f3-4e78-a77e-7cf9f657a5bc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 200 len: 1188 microversion: 2.1 time: 0.235572 Oct 04 18:26:31.169661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3081/6059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:30 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 1188 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:32.192531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:32.193222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 3800e20d-48e7-42ac-8f0b-329fb724fa74] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:32.203687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.204255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.204719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.212157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:32.214050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:32.214867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:32.262273 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 HTTP/1.1 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3800e20d-48e7-42ac-8f0b-329fb724fa74'} Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:32.266882 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance 3800e20d-48e7-42ac-8f0b-329fb724fa74 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:32.273972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6c924426-b6b9-46fa-863c-ef38774071fa tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74" status: 404 len: 111 microversion: 2.1 time: 0.081137 Oct 04 18:26:32.276443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2979/6060] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:32 2022] GET /compute/v2.1/servers/3800e20d-48e7-42ac-8f0b-329fb724fa74 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:34.511644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:34.515866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:34.575162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.583151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.585052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.587975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:34.590200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:34.590935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:34.994940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'services' on Instance uuid c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:35.261878 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64c363c6-9d47-4bea-b3f4-337bf51ac036 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments/9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8" status: 202 len: 0 microversion: 2.1 time: 0.762956 Oct 04 18:26:35.270228 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3082/6061] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:26:34 2022] DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments/9b14b59d-4d4c-47e9-a33f-808ba8aaf2c8 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:26:35.273584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:35.278058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:35.319920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.320955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.321597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.328749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:35.329522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:35.330750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:35.410723 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc4d26b5-25c8-4beb-8ae4-c470a54d28b3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142963 Oct 04 18:26:35.414749 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2980/6062] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:35 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:36.161327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.162342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.200150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.206973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.212511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.213398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.221391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.222386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.288605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff HTTP/1.1 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a25b115e-53d3-4646-86ec-3b6cc9c1abff'} Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:36.291061 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:36.297309 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19b96106-3de5-4850-8ccf-3aaa26b586c7 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 404 len: 111 microversion: 2.1 time: 0.140098 Oct 04 18:26:36.302802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.303582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: a25b115e-53d3-4646-86ec-3b6cc9c1abff] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.326324 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3083/6063] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:36 2022] DELETE /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:36.329472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.330413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.331096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.332202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.334712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.337682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.400964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=92 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:36.403798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff HTTP/1.1 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a25b115e-53d3-4646-86ec-3b6cc9c1abff'} Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:36.414113 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:36.427159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance a25b115e-53d3-4646-86ec-3b6cc9c1abff could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:36.429261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:36.429261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:36.433893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b088081-c841-44d5-bd65-fbe8a4b4f0ef tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff" status: 404 len: 111 microversion: 2.1 time: 0.117095 Oct 04 18:26:36.441860 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2981/6064] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/a25b115e-53d3-4646-86ec-3b6cc9c1abff => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:26:36.451059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.451565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.452010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.452730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:36.453189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:36.453617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:36.596911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-473f2787-d3b9-445e-88a0-cf97a4c3f7b9 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.175636 Oct 04 18:26:36.597684 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3084/6065] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:36 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:26:37.612519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:37.625745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:37.650527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.651425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.660696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.666437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:37.668097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:37.669398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:37.785856 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e70786e4-ac82-487d-9f1d-0c16e52b275b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179412 Oct 04 18:26:37.795152 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2982/6066] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:37 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:38.803691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:38.806996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:38.822042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.834165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.837653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.838886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:38.841948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:38.843620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:38.947779 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e56153ef-a2c5-4746-af5e-2f7ee04259d1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142617 Oct 04 18:26:38.951325 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3085/6067] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:38 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:39.964780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:39.975159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:40.016502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.019909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.020657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.022857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:40.027411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:40.028094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:40.153401 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-95efa744-a482-45c8-80ef-464e9a445414 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193011 Oct 04 18:26:40.154560 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2983/6068] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:39 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:41.170739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:41.174755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:41.187174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.190073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.195421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.196486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:41.198592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:41.199701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:41.279700 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bdb20fa5-6c45-41c0-91ff-c88510deb16c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111729 Oct 04 18:26:41.289113 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3086/6069] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:41 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:42.296310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:42.302254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:42.327332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.330509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.334566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.335815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:42.336534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:42.337230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:42.432479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5090d305-d779-482c-afdb-92ef7fc72bb3 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.141970 Oct 04 18:26:42.433861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2984/6070] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:42 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:43.450049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:43.453381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:43.495318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.496157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.497994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.504244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:43.508609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:43.514045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:43.664987 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2bc1e45c-dd5c-4eff-b463-ee1117772177 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214686 Oct 04 18:26:43.675829 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3087/6071] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:43 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:44.691407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:44.694763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:44.713339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.713889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.714342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.715276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:44.715747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:44.716301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:44.879207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-29ac6607-3c4e-4846-b21b-81928e88fb57 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191778 Oct 04 18:26:44.882354 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2985/6072] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:44 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:45.897475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:45.905256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:45.954830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.955727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.956557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:45.963530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:45.964418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:45.965222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:46.129037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be12ee8a-2361-4b0c-834b-10687a3c8443 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240793 Oct 04 18:26:46.141075 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3088/6073] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:45 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:47.148786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.151590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.176627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.190234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.190704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.191469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.191945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.192389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.264684 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-244f52b9-8cff-4561-aeab-37f569074db0 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.120543 Oct 04 18:26:47.265548 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2986/6074] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:26:47.422986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:47.426987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.445460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.446259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.446948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.447882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.448574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.449469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.512024 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Cannot 'reboot' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action HTTP/1.1 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 28 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: {"reboot": {"type": "HARD"}} Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: exception: Cannot 'reboot' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2a796768-00c2-4396-afb5-3c5d861fe579', 'body': {'reboot': {'type': 'HARD'}}} Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:26:47.515108 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.518641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.521626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 409 to user: Cannot 'reboot' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:47.522844 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4c4e5a65-14cf-4dae-9c53-ee13b274ee5a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action" status: 409 len: 145 microversion: 2.1 time: 0.106956 Oct 04 18:26:47.528742 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3089/6075] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:47 2022] POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action => generated 145 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:26:47.534929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:47.538370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.550513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.551238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.552391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.554278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.554752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.555230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.611760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Cannot 'rebuild' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action HTTP/1.1 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 65 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: exception: Cannot 'rebuild' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2a796768-00c2-4396-afb5-3c5d861fe579', 'body': {'rebuild': {'imageRef': 'e1023401-e1c5-4082-870f-0d68a62149b1'}}} Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:26:47.618611 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 409 to user: Cannot 'rebuild' instance 2a796768-00c2-4396-afb5-3c5d861fe579 while it is in vm_state rescued {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13b9d544-9645-4343-af30-32e75df055a8 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action" status: 409 len: 146 microversion: 2.1 time: 0.091194 Oct 04 18:26:47.622457 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2987/6076] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:26:47 2022] POST /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579/action => generated 146 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 04 18:26:47.632440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.633106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.640884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.641549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.642242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.643245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.643838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.644392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.677719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:26:47.835272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1060bb23-f1e5-442c-8ce1-bcd7456b56ce tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 204 len: 0 microversion: 2.1 time: 0.205621 Oct 04 18:26:47.848096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:47.849125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:47.853167 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3090/6077] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:47 2022] DELETE /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:26:47.862395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.865629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.866574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:47.868483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:47.870148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:47.872573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:48.373013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:48.391329 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-886cc673-4a69-4110-b978-56a6587fe1c6 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1689 microversion: 2.1 time: 0.547687 Oct 04 18:26:48.396324 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2988/6078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:47 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1689 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:49.421279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:49.422584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:49.432510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.433238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.433873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.434770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:49.435389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:49.436231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:49.683100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:49.718588 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17abd670-e834-412e-be08-6b663378d49d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1689 microversion: 2.1 time: 0.301466 Oct 04 18:26:49.723806 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3091/6079] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:49 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1689 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:50.063599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.064618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.073392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:50.082443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.082984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.086184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.087590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.088116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.090097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.125641 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f HTTP/1.1 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '52b417a2-ec16-492d-994c-eadb96bb831f'} Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:50.129084 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.133355 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.135097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:50.136333 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-765a79a6-253a-49ae-9bba-966b45786265 tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 404 len: 111 microversion: 2.1 time: 0.077068 Oct 04 18:26:50.137563 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2989/6080] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:26:50 2022] DELETE /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:50.146728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.147362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] [instance: 52b417a2-ec16-492d-994c-eadb96bb831f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.160996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.161525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.162101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.162944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.163794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.164806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.194828 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] HTTP exception thrown: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Request method failure captured: Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f HTTP/1.1 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHlZoLsSlokR392UNBe-tsg07HzaNuJwLecIoIxt3mO6qN_2EcIa-Sp4YZDPuMpcuimmb51EIQYkqQneSbeBghgbayOLoIFzhP3rCB1hv4jj_r_EPXwdFMXOM8IEdbPbI9bOhTT-vMXuIke9nXdxS0ni1t9lxBiOujkxr1bAjMDbw48 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/65290c2428b14d898e10a90d66918ca0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_65290c2428b14d898e10a90d66918ca0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 65290c2428b14d898e10a90d66918ca0 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1006253578 Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7481f17bf5b142aaadc3e41dfbc68f9c Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeTestJSON-1006253578-project Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '52b417a2-ec16-492d-994c-eadb96bb831f'} Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:50.196820 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:26:50.200294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] Returning 404 to user: Instance 52b417a2-ec16-492d-994c-eadb96bb831f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:50.201012 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33437597-706e-4d08-a542-7feeaa7bc92a tempest-AttachVolumeTestJSON-1006253578 tempest-AttachVolumeTestJSON-1006253578-project] 10.222.0.42 "GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f" status: 404 len: 111 microversion: 2.1 time: 0.058980 Oct 04 18:26:50.201802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3092/6081] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/52b417a2-ec16-492d-994c-eadb96bb831f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:50.760938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:50.762071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:50.774046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.776850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.777493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:50.778843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:50.780868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:50.781522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:51.370148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:51.388766 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99d8ac44-db2a-4ebb-99e7-42bed4cc4c7d tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1689 microversion: 2.1 time: 0.629809 Oct 04 18:26:51.393570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2990/6082] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:50 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1689 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:52.416872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:52.417505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:52.423692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:26:52.452814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.454669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.456813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.460257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:52.460776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:52.461282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:52.586189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:52.597439 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-35296544-cb07-457e-a034-698e8e686f0f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1622 microversion: 2.1 time: 0.184633 Oct 04 18:26:52.599000 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3093/6083] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:52 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1622 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:53.048626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1b28ca7-0ab8-4c59-ace4-8f5dde25a084", "name": "network-vif-deleted", "tag": "443ff699-6a3a-4c64-ad88-697e932f8baf"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:26:53.059611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.060309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.060808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.074344 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] Creating event network-vif-deleted:443ff699-6a3a-4c64-ad88-697e932f8baf for instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 on n-h2-831194-21 Oct 04 18:26:53.091108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-afda1ec2-7284-44f9-9327-641f80b0a1c6 req-24e5ea30-af42-4ba0-ac9d-8556cae0a155 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.284864 Oct 04 18:26:53.091982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2991/6084] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:26:53.623372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:53.624210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:53.648035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.651444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.651940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.653943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.660080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.663819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.738654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:53.742890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:53.743359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:53.743835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'fault' on Instance uuid c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:26:53.823022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:26:53.834628 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b58bd3d2-7388-4765-8727-dafc4f5e3615 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 200 len: 1335 microversion: 2.1 time: 0.215437 Oct 04 18:26:53.838173 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3094/6085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:53 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:26:54.863072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.864361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c1b28ca7-0ab8-4c59-ace4-8f5dde25a084] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:26:54.885596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.887605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.890580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.892263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:26:54.893047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:26:54.895137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:26:54.930546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 HTTP/1.1 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c1b28ca7-0ab8-4c59-ace4-8f5dde25a084'} Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:54.932451 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. Oct 04 18:26:54.935972 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:26:54.939747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 404 to user: Instance c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:26:54.940843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67cda816-23db-49b1-a1ec-c414592c48a1 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084" status: 404 len: 111 microversion: 2.1 time: 0.083574 Oct 04 18:26:54.942683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2992/6086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:26:54 2022] GET /compute/v2.1/servers/c1b28ca7-0ab8-4c59-ace4-8f5dde25a084 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:26:54.952858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88e1a710-3fa5-4558-bd34-1db51b2b3344 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '.version_select at 0x7fbdc1d29790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:26:54.997091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88e1a710-3fa5-4558-bd34-1db51b2b3344 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612141590" status: 202 len: 0 microversion: 2.1 time: 0.049122 Oct 04 18:26:54.998360 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3095/6087] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:26:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612141590 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:27:07.940230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44171fa0-0d3a-4ece-b93a-81d338b66d46 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc8c1790>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:07.951523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:07.952716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=53 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:08.050401 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44171fa0-0d3a-4ece-b93a-81d338b66d46 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/34320f9f-3003-4ca6-a2bf-19b657a273a9" status: 200 len: 350 microversion: 2.1 time: 0.111824 Oct 04 18:27:08.059846 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2993/6088] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:27:07 2022] GET /compute/v2.1/os-volumes/34320f9f-3003-4ca6-a2bf-19b657a273a9 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:08.194408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.195589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.209380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:08.210458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:08.222932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.223626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.224394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.225316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.225981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.226608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.314512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:27:08.580742 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aeeb88e1-db1d-45b3-a543-c15ea8c5ab4b tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 204 len: 0 microversion: 2.1 time: 0.390518 Oct 04 18:27:08.581359 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3096/6089] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:08 2022] DELETE /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:08.594348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:08.595627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:08.618378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.618883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.619517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.620405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:08.621055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:08.621677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:08.957565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:08.972499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8202aa3c-4dd2-4041-b9a8-82c3c9168c48 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1507 microversion: 2.1 time: 0.386779 Oct 04 18:27:08.985868 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2994/6090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:08 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1507 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:10.004428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.008633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:10.016665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.017172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.017664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.018429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:10.019131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:10.019725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:10.278576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:10.290551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-86c84178-4166-41f6-bb40-e3e0502de7cb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1507 microversion: 2.1 time: 0.293182 Oct 04 18:27:10.291152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3097/6091] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:09 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:10.837647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7027390-6ecf-45d7-8a7d-406dae7bd161 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc978700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:10.905432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7027390-6ecf-45d7-8a7d-406dae7bd161 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5bb991b9-9615-43d2-b44a-597e5d0dc2b9" status: 200 len: 351 microversion: 2.1 time: 0.071774 Oct 04 18:27:10.914890 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2995/6092] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:27:10 2022] GET /compute/v2.1/os-volumes/5bb991b9-9615-43d2-b44a-597e5d0dc2b9 => generated 351 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:11.325785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:11.327213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:11.350072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.350679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.352273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.381609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.382491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.383825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.465914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a796768-00c2-4396-afb5-3c5d861fe579", "name": "network-vif-deleted", "tag": "67b51619-ac1d-455f-a5ca-e27c877c07d1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:11.508945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:11.510961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:11.514152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:11.549498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:11.567031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] Creating event network-vif-deleted:67b51619-ac1d-455f-a5ca-e27c877c07d1 for instance 2a796768-00c2-4396-afb5-3c5d861fe579 on n-h1-831194-21 Oct 04 18:27:11.574526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b4aacc7b-18a2-4154-8f3e-f05f4aad98eb tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 200 len: 1465 microversion: 2.1 time: 0.252889 Oct 04 18:27:11.578913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3098/6093] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:11 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 1465 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:11.601914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fa2c2faa-a2fe-4c2f-a5b9-fad239771677 req-8b127090-19dc-42b6-94a6-37f640badbf9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146253 Oct 04 18:27:11.607184 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2996/6094] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:12.616991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.618333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: 2a796768-00c2-4396-afb5-3c5d861fe579] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.628895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.629986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.630586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.631448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.632067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.632641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.649540 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 HTTP/1.1 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '2a796768-00c2-4396-afb5-3c5d861fe579'} Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:12.653070 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. Oct 04 18:27:12.657643 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:12.659341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 404 to user: Instance 2a796768-00c2-4396-afb5-3c5d861fe579 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:12.660377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a518459f-3e19-469a-9292-993176175c6f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579" status: 404 len: 111 microversion: 2.1 time: 0.052922 Oct 04 18:27:12.666605 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3099/6095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/servers/2a796768-00c2-4396-afb5-3c5d861fe579 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:12.673941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.674836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.688690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.689574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.690085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.690999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.691626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.692280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.730434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:27:12.917292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6cc18f7-e114-4409-8e51-968c6dc9f070 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 204 len: 0 microversion: 2.1 time: 0.248712 Oct 04 18:27:12.927648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:12.928275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:12.929524 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2997/6096] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:27:12 2022] DELETE /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:27:12.944740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.945786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.947057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:12.949388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:12.951203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:12.957271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:13.205637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:13.216326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f93d492-1498-41fc-a113-fe46df0571e5 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.292957 Oct 04 18:27:13.226305 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3100/6097] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:12 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:13.713066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6894a23-e0a9-41e2-845c-b7710f86648c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdc1e61b80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:13.839890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6894a23-e0a9-41e2-845c-b7710f86648c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/5a533ace-6bcd-4db2-9d7c-9cabcb3b2a57" status: 200 len: 350 microversion: 2.1 time: 0.131158 Oct 04 18:27:13.844456 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2998/6098] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/os-volumes/5a533ace-6bcd-4db2-9d7c-9cabcb3b2a57 => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:13.866437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79679f9a-17aa-4808-84aa-c547f5ed8fc0 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdc1d2bb80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.020770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79679f9a-17aa-4808-84aa-c547f5ed8fc0 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.165131 Oct 04 18:27:14.034837 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3101/6099] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 18:27:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:14.043255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bdb091d-b8fb-43b1-b791-d4320d500d44 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc9e0c10>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.197623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bdb091d-b8fb-43b1-b791-d4320d500d44 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.158653 Oct 04 18:27:14.201920 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 2999/6100] 10.222.0.42 () {58 vars in 1149 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:14.215061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac36eeb0-e307-4595-8240-b4b133c6c26c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdc1ceb790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.244622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.245458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:14.253021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.253903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.254602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.255623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:14.256328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:14.257005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:14.351853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac36eeb0-e307-4595-8240-b4b133c6c26c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.141287 Oct 04 18:27:14.352551 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3102/6101] 10.222.0.42 () {58 vars in 1134 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:14.368422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-926705df-b90d-4c03-916f-7a5b01b353d3 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc513670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.468023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:14.478582 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f552c853-a18e-45fa-86c1-3284b1872c3f tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.239431 Oct 04 18:27:14.480010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3000/6102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:14.521587 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-926705df-b90d-4c03-916f-7a5b01b353d3 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.157328 Oct 04 18:27:14.522289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3103/6103] 10.222.0.42 () {58 vars in 1167 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:14.538700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c420e880-2cc2-4cf1-bf76-83e0af2968de tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc8685e0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.662173 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c420e880-2cc2-4cf1-bf76-83e0af2968de tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.127695 Oct 04 18:27:14.662755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3001/6104] 10.222.0.42 () {58 vars in 1170 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:14.676570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44c73561-ee14-4cc8-98a0-cab2c87e442c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdc1d2bd30>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.782347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44c73561-ee14-4cc8-98a0-cab2c87e442c tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.109201 Oct 04 18:27:14.783979 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3104/6105] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:14.800629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-71a96ff9-8d4c-484f-8f24-ae0c7ebaef95 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc84b040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:14.919533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-71a96ff9-8d4c-484f-8f24-ae0c7ebaef95 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.125281 Oct 04 18:27:14.920481 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3002/6106] 10.222.0.42 () {58 vars in 1188 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:14.937130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1392c34-03dc-4daa-8677-6fc2e63a8451 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] Calling method '.version_select at 0x7fbdbc71a8b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:15.097869 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1392c34-03dc-4daa-8677-6fc2e63a8451 tempest-VolumesTestJSON-1492382530 tempest-VolumesTestJSON-1492382530-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.164176 Oct 04 18:27:15.098656 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3105/6107] 10.222.0.42 () {58 vars in 1155 bytes} [Tue Oct 4 18:27:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:15.530828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:15.532936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:15.585495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.586451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.587758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:15.589299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:15.590385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:15.591906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:15.697748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1132244513", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "4609998d-ba13-4e02-9ec6-76c75bc3e132", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:15.945434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:15.957357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-95e748da-2fc4-4c8b-8772-344207760e78 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.452223 Oct 04 18:27:15.958580 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3003/6108] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:15 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:16.026351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:27:17.001644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.002297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:17.016795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.017566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.018402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.019684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.020426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.020876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.328150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:17.340211 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-06413396-b118-47b2-835f-146b4dabbc1a tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1521 microversion: 2.1 time: 0.345761 Oct 04 18:27:17.341532 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3004/6109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:16 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:17.538099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c53909e8-a644-4ce3-8164-d59baf978557", "name": "network-vif-deleted", "tag": "3705ded7-2e4c-46f1-a72e-935d0df2a1ae"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:17.563234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.563748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.564363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.600224 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] Creating event network-vif-deleted:3705ded7-2e4c-46f1-a72e-935d0df2a1ae for instance c53909e8-a644-4ce3-8164-d59baf978557 on n-h2-831194-21 Oct 04 18:27:17.606907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1c2f1334-7762-4668-aec7-3978f3ef3c11 req-9e290e64-7f49-4128-9784-3f165779b1b7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073664 Oct 04 18:27:17.607968 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3005/6110] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:27:17.629931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:27:17.631166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:27:17.631941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:27:17.632667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:27:17.633383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:27:17.656536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.666731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.667554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.668590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:17.670354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:17.671484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:17.741623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:27:17.760977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:27:17.797960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:27:17.799943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4609998d-ba13-4e02-9ec6-76c75bc3e132',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:27:17.936323 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-646d3d71-c3cb-4d85-a085-f785a44e63e2 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247534 Oct 04 18:27:17.938459 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3106/6111] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:27:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:27:17.955122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6c64110-1ef9-4d7a-843a-5eb134d45fab tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:17.955122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6c64110-1ef9-4d7a-843a-5eb134d45fab tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.091471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d6c64110-1ef9-4d7a-843a-5eb134d45fab tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.101967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6c64110-1ef9-4d7a-843a-5eb134d45fab tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1057 microversion: 2.1 time: 0.154884 Oct 04 18:27:18.104568 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3006/6112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:17 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1057 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:18.379682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:18.381011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:18.396218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.398150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.399225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.400726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.401771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.403028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.474082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:18.475883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:18.476618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:18.477280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lazy-loading 'fault' on Instance uuid c53909e8-a644-4ce3-8164-d59baf978557 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:27:18.575671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '40182dcde092424f8a56c3effd3b40e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb1f0ce17eb242b2ae35e1c0a10dbc7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:18.589436 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-caba4c76-992d-44ae-b92e-25c785326be4 tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 200 len: 1311 microversion: 2.1 time: 0.224149 Oct 04 18:27:18.593900 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3107/6113] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:18 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 1311 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:19.131180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.133004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:19.145762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.146705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.147433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.148544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.149276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.149942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.239538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:19.252473 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b82fb6a5-55dc-4c0b-b16d-c210b4a95487 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1061 microversion: 2.1 time: 0.126955 Oct 04 18:27:19.253966 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3007/6114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1061 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:19.628090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:19.636459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] [instance: c53909e8-a644-4ce3-8164-d59baf978557] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:19.654592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.655201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.658322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.659171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:19.659719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:19.660240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:19.679339 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] HTTP exception thrown: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Request method failure captured: Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 HTTP/1.1 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHnqzvRgStdM288DyivqT2HjFR6jDij4bsc4_8HrFdIz-CSP-LtJzauFXPI_IzOT9yA_ltNyK9pLExRingMh-cANB2mvq9p9ZL1WWNscLOgQeVGyxZJOpIrpBliefLkXCSWdwA-cgvbGM3DGjPZF5dLwFm9MRLE7DfTmISKltShTH2k Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eb1f0ce17eb242b2ae35e1c0a10dbc7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: eb1f0ce17eb242b2ae35e1c0a10dbc7d Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-167581160 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 40182dcde092424f8a56c3effd3b40e2 Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerRescueNegativeTestJSON-167581160-project Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c53909e8-a644-4ce3-8164-d59baf978557'} Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:19.681018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. Oct 04 18:27:19.684308 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:27:19.685763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] Returning 404 to user: Instance c53909e8-a644-4ce3-8164-d59baf978557 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:27:19.686806 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9bbb600c-79db-4132-8096-66df656a563c tempest-ServerRescueNegativeTestJSON-167581160 tempest-ServerRescueNegativeTestJSON-167581160-project] 10.222.0.42 "GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557" status: 404 len: 111 microversion: 2.1 time: 0.074409 Oct 04 18:27:19.699366 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3108/6115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:19 2022] GET /compute/v2.1/servers/c53909e8-a644-4ce3-8164-d59baf978557 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:27:20.286840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:20.287649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:20.311950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.313273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.313763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.314524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:20.314983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:20.315413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:20.525362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:20.541636 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9de79f6b-eb80-4e49-b7ab-a20619dac84d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1127 microversion: 2.1 time: 0.260477 Oct 04 18:27:20.553857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3008/6116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:20 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1127 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:21.572737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:21.574297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:21.589240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.589988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.592934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.594640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:21.598495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:21.599341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:21.753563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:21.770729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30c895c8-b10b-43a6-bec1-af63247125ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1127 microversion: 2.1 time: 0.202453 Oct 04 18:27:21.774507 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3109/6117] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:21 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1127 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:22.797147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:22.797809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:22.818704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.819920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.820674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:22.821555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:22.822194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:22.822800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:23.527884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:23.550250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56ddc12c-c4c3-4ec1-9290-e4afed0ceb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.754887 Oct 04 18:27:23.553890 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3009/6118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:22 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:24.577349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:24.579077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:24.598499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.599009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.599455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.600182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:24.600638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:24.601070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:24.989048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:24.998951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-510b4eec-870e-4160-807a-0bb05de4976e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.426611 Oct 04 18:27:25.000531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3110/6119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:24 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:26.027483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:26.028120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:26.044897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.050763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.052924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.055415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.058569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.059868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.151350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abc4cefd-336f-43b1-96d1-522469f6aa9d", "tag": "8230efa4-9edb-40c4-ad2e-6916fd7a6981"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:27:26.205232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:26.206315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:26.206901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:26.226438 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] Creating event network-changed:8230efa4-9edb-40c4-ad2e-6916fd7a6981 for instance abc4cefd-336f-43b1-96d1-522469f6aa9d on n-h1-831194-21 Oct 04 18:27:26.233224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-609bcd17-12de-4dea-a8f6-1ebc062da3ed req-60fb081b-ef68-4a91-beea-13223c827f2b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086568 Oct 04 18:27:26.234922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3111/6120] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:27:27.105974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:27.119052 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0790b893-41ac-425c-9c53-13063f14d481 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 1.096334 Oct 04 18:27:27.130671 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3010/6121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:26 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:28.166701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:28.167997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:28.200299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:28.214628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:28.231131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.232175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.238387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:28.248993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:28.255379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:28.258749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:29.088844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:29.113796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-22cbafdc-ed9b-4219-9fa2-b92f95e3393b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.959648 Oct 04 18:27:29.114489 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3112/6122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:28 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:30.147072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:30.148264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:30.152836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:30.168647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.169167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.169617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.171721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:30.171721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:30.176860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:30.486117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:30.510494 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-477f55d6-316f-4966-941b-b22d5e1966bb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.368253 Oct 04 18:27:30.528002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3011/6123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:30 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:31.550592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:31.552575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:31.568315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.569080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.569722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.570818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:31.575548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:31.576327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:31.915476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:31.926503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-810ae37f-b982-4eca-ab00-55bde4f0bb37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.380212 Oct 04 18:27:31.928385 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3113/6124] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:31 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:32.959919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:32.960553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:32.974523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.976139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.976878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:32.978589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:32.981153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:32.981903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:33.298480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:33.313904 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-87ebb073-51a9-44ab-9fc6-4dbd4a59c55f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.359965 Oct 04 18:27:33.342074 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3012/6125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:32 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:34.344481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:34.346109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:34.356811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.357606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.358408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.359423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:34.360180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:34.361643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:34.791050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:34.809326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9eabed3b-9b80-429d-960a-99e5d17e20cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.468966 Oct 04 18:27:34.824116 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3114/6126] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:34 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:35.857025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:35.857662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:35.917047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.926766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.928037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:35.928824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:35.929306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:35.929744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:36.475106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:36.495433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0b2c245-f05d-4ce6-aff1-66f0fdd6d8d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.654159 Oct 04 18:27:36.498452 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3013/6127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:35 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:37.540480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:37.559762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:37.578440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.580606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.581859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:37.583713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:37.586220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:37.587307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:38.200165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:38.213773 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8c06668-ea72-43ab-9175-b50971edd6b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.684230 Oct 04 18:27:38.231616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3115/6128] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:37 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:39.310845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:39.317151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:39.383912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:39.396236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.399237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.401158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.402637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:39.406994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:39.408026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:39.452740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:40.220075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:40.231434 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8d51f75-596e-42d0-a432-c74c9732c786 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.974672 Oct 04 18:27:40.232101 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3014/6129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:39 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:41.266470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:41.268001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:41.294007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:41.297085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.303764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.308867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.310062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:41.315606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:41.316310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:41.342998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:27:42.320614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:42.332194 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-faa5afce-e8e1-4ebb-bc23-8a57f38ce80d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 1.073184 Oct 04 18:27:42.334290 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3116/6130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:41 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:43.361398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:43.362692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:43.375516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.377415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.378387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.379813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:43.381476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:43.381949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:43.766758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:43.805312 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.448199 Oct 04 18:27:43.823101 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3015/6131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:43 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:44.860774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:44.861450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:44.870697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.871442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.872068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:44.873077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:44.874182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:44.875355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:45.355531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:45.364319 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b797eca0-c84f-4244-8e58-16ce98f58ce1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 0.508651 Oct 04 18:27:45.386302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3117/6132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:44 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:45.483546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:45.484539 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ceee8a56-90a5-4bdd-85a6-1ebff3a80259 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001639 Oct 04 18:27:45.496890 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3016/6133] 10.222.0.42 () {56 vars in 886 bytes} [Tue Oct 4 18:27:45 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:27:46.410448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:46.411230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:46.429534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.430316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.430911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:46.434941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:46.435597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:46.436989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:47.678426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:47.719252 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa7e14b9-3ede-48c1-a58a-6afe6430154a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1169 microversion: 2.1 time: 1.318360 Oct 04 18:27:47.720092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3118/6134] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:46 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1169 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:48.770561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:48.771337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:48.792759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.793677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.794460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:48.796222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:48.797048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:48.797796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:49.478250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:49.499292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82d781bc-2927-4cf1-ba4a-5c9fc1c1cf7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1215 microversion: 2.1 time: 0.734899 Oct 04 18:27:49.516206 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3017/6135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:48 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1215 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:27:50.535831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:50.536393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:50.552628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.557924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.563546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:50.568785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:50.569849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:50.584357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:51.003074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:51.034601 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a913ffce-2be6-445a-bdb7-87856f61ba0c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.504353 Oct 04 18:27:51.050927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3119/6136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:50 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:52.093013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:52.098198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:52.128979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.135093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.139688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.140757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:52.144478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:52.146661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:52.490207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:52.509498 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.420496 Oct 04 18:27:52.512643 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3018/6137] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:52 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:53.546404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:53.550716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:53.563439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.564631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.565266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.566539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:53.567206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:53.567826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:53.883169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:53.892760 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9dec0787-8363-46cd-bc15-ead8384d2fcf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.353305 Oct 04 18:27:53.896120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3120/6138] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:53 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:54.824607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.825634 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-245c71e4-3b43-413b-9b7a-d7bc65fcb4d5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001385 Oct 04 18:27:54.826216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3019/6139] 10.222.0.42 () {56 vars in 886 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 04 18:27:54.922699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:54.926709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:54.943996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.944932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.947275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:54.949251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:54.950351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:54.951773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:55.218870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:55.232552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6f0791f-b892-4a1b-8839-6712e0a62f7b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.317558 Oct 04 18:27:55.234246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3121/6140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:54 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:56.258004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:56.259181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:56.280318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.284964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.284964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.291204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:56.292042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:56.292503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:56.600212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:56.621959 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4de7144c-e0f2-4cd1-8467-59196c9a3a81 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.369105 Oct 04 18:27:56.623079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3020/6141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:56 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:57.650278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:57.651411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:57.688562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.689170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.689632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:57.690441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:57.692983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:57.693953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:58.147907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:27:58.158280 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6359851-389c-4d14-b2d6-2fe07d6bbb86 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.512678 Oct 04 18:27:58.159970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3122/6142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:57 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:27:59.186736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:27:59.187541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:27:59.202458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.206827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.207623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.209698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:27:59.218815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:27:59.219349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:27:59.970217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc4cefd-336f-43b1-96d1-522469f6aa9d", "name": "network-vif-plugged", "status": "completed", "tag": "8230efa4-9edb-40c4-ad2e-6916fd7a6981"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:00.001363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:00.002825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:00.005283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:00.029195 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] Creating event network-vif-plugged:8230efa4-9edb-40c4-ad2e-6916fd7a6981 for instance abc4cefd-336f-43b1-96d1-522469f6aa9d on n-h1-831194-21 Oct 04 18:28:00.038673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f3c522b5-7de6-4559-b8b2-d35abb4fc6bd req-715f32f2-a27f-451c-9ee2-2cf56193aca5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074250 Oct 04 18:28:00.040352 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3123/6143] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:00.196721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:00.212161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e9faf10-149d-4fe2-abfc-0f1efb4f7b52 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 1.030637 Oct 04 18:28:00.214601 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3021/6144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:27:59 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:01.241171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:01.242315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:01.262287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.262826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.263400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.264084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:01.270693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:01.272948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:01.637489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:01.672299 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4a37f701-c7ec-408c-8875-c469731e0a83 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1203 microversion: 2.1 time: 0.437440 Oct 04 18:28:01.681011 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3124/6145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:01 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1203 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:02.710939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:02.713074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:02.732978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.733848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.734474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:02.736475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:02.736956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:02.739809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.268837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.285815 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c556f83e-3511-4842-b87d-b5a77e1c3a9d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1389 microversion: 2.1 time: 0.582824 Oct 04 18:28:03.286612 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3022/6146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:02 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1389 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:03.319010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.319686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.343935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.344453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.344907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.345641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.346136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.346583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.627467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:03.643329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fc340721-7ec8-4fe7-8f79-8bd4342e2954 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1389 microversion: 2.1 time: 0.328963 Oct 04 18:28:03.644290 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3125/6147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1389 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:03.673780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:03.674651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:03.695528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.697037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.698794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:03.699774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:03.704712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:03.705425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.058175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:04.072645 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-82fcba23-b0e4-4018-a60a-9b12039e3ccb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1389 microversion: 2.1 time: 0.405009 Oct 04 18:28:04.073956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3023/6148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:03 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1389 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:04.303446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:04.304297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.320532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.327495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.330659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.342418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.347178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.348431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.524769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:28:04.831915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45df7c47-53c6-4240-94a6-31d331b1e1bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 204 len: 0 microversion: 2.1 time: 0.532563 Oct 04 18:28:04.833237 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3126/6149] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:04 2022] DELETE /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:28:04.843365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:04.844021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:04.865683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.866215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.866662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:04.867418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:04.867881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:04.883591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:05.214425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:05.245642 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56ce46cc-419b-481c-b3e1-5efa9733daa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1395 microversion: 2.1 time: 0.405941 Oct 04 18:28:05.253368 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3024/6150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:04 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1395 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:06.283877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:06.285048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:06.337986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.338738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.339463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.340641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:06.341438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:06.350449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:06.757850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:06.776794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91259892-f190-46bb-b141-80e459b43dc6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1395 microversion: 2.1 time: 0.499540 Oct 04 18:28:06.779675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3127/6151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:06 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1395 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:07.807137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:07.807933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:07.828311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.828797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.829252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:07.835274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:07.835771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:07.836383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.232709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0216b15a-27f8-4419-aaf8-cd299f432b64 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: .version_select at 0x7fbdbd33fe50>, body: {"keypair": {"name": "tempest-keypair-1721873067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3TuUqTEU9lf54lth9pB2pFCo3O56+H+ywx0XmqQ0dFBrRARKLwZzH4ES4OIVcfyat5cxL1vmD0lOg8MXDOqjzNW0zuknYNEHcz9jZpf0OeHxfjpdPwi00Jet1ddzMP7Q=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:08.272702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0216b15a-27f8-4419-aaf8-cd299f432b64 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:08.282106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0216b15a-27f8-4419-aaf8-cd299f432b64 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:08.320050 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0216b15a-27f8-4419-aaf8-cd299f432b64 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.502455 Oct 04 18:28:08.326405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3128/6152] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:28:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:08.436598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abc4cefd-336f-43b1-96d1-522469f6aa9d", "name": "network-vif-deleted", "tag": "8230efa4-9edb-40c4-ad2e-6916fd7a6981"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:08.450976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:08.464197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:08.464692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:08.465135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:08.472742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c06ba70-76b5-4a8b-af4e-34257edf9028 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1353 microversion: 2.1 time: 0.669640 Oct 04 18:28:08.474134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3025/6153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:07 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1353 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:08.503631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] Creating event network-vif-deleted:8230efa4-9edb-40c4-ad2e-6916fd7a6981 for instance abc4cefd-336f-43b1-96d1-522469f6aa9d on n-h1-831194-21 Oct 04 18:28:08.548223 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1a453c89-653d-4bb1-b59f-3ffb40ecbd71 req-4f7abab2-3231-45a4-97e4-8667e78a1ca5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115732 Oct 04 18:28:08.550074 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3129/6154] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:28:09.497662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:09.498460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:09.531926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=20 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:09.541300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.545387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.558089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.562314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:09.563021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:09.563660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:09.578456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=60 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:10.222769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:10.233533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a723b019-e7fa-4df4-adca-186bc43038b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.740145 Oct 04 18:28:10.246625 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3026/6155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:09 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:11.280934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:11.285587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:11.303291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.306441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.309076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.318725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:11.321098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:11.324125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:11.444842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:11.551078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:11.574317 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5e0f07b-e0f8-44db-a359-911a46752007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.300257 Oct 04 18:28:11.578324 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3130/6156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:11 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:12.600922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:12.602567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:12.637975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:12.640672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:12.641383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:12.644002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:12.646921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:12.647642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:13.033725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:13.049503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-73a82022-35c9-4b68-b607-7088c4e829c5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.451967 Oct 04 18:28:13.051792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3027/6157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:12 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:13.637029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1282624468", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e80190d-6f7c-4a36-acb4-292d1b415902"}], "security_groups": [{"name": "tempest-securitygroup--702632152"}], "key_name": "tempest-keypair-1721873067", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:13.697776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:13.963989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] validate_networks() for [('6e80190d-6f7c-4a36-acb4-292d1b415902', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:14.077075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:14.079249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:14.099917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.101514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.102765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.105363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:14.106621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:14.108499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:14.278685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:14.288740 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-02c1bfa8-afe6-46d9-b7f0-8021083505ac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.216384 Oct 04 18:28:14.290434 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3028/6158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:14 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:15.314218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:15.315530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:15.334193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.334959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.340190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.342249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.345479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.346858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.534088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:15.548832 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56aafb34-8f6f-4827-8047-8cd9319e4cd4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.238529 Oct 04 18:28:15.554346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3029/6159] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:15 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:15.716771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:15.716771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:15.717376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:15.717634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:15.718304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:15.750983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.751482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.751931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.757712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:15.758252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:15.758707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:15.834034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:15.853476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:15.895647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:15.899439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:16.017694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c918778e-4a09-4608-bfa3-97073aa48df6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.385643 Oct 04 18:28:16.019117 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3131/6160] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:16.032342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2821daf1-308f-4a16-969f-5edf5e69eb06 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.033229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2821daf1-308f-4a16-969f-5edf5e69eb06 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.223573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2821daf1-308f-4a16-969f-5edf5e69eb06 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.232990 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2821daf1-308f-4a16-969f-5edf5e69eb06 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1242 microversion: 2.1 time: 0.206353 Oct 04 18:28:16.241002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3030/6161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:16.580412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:16.581031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:16.594557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.595205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.595687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.596813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:16.597344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:16.597785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:16.782347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:16.803602 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8bd0dc34-ed82-44f1-bce6-adb85deaa06c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.228705 Oct 04 18:28:16.807733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3132/6162] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:16 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:17.266472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.267880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.287613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.288215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.288618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.292296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.292965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.295844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.517845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:17.536000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-728c7056-c312-4fbe-a7e2-26f0ba4dc920 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1246 microversion: 2.1 time: 0.271301 Oct 04 18:28:17.539412 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3031/6163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1246 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:17.836781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:17.837914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:17.860034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.864577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.865296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:17.868835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:17.869463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:17.871358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.074814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.093347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c39ebe69-c43f-4ed5-a113-ff45a175f7eb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 200 len: 1188 microversion: 2.1 time: 0.260310 Oct 04 18:28:18.096809 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3133/6164] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:17 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 1188 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:18.562380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:18.563031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:18.580316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.581167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.581400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.582270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:18.582791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:18.586774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:18.700737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:18.716009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d075d075-b2b0-4e55-a00c-d5fd92d7500a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1300 microversion: 2.1 time: 0.154824 Oct 04 18:28:18.720074 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3032/6165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:18 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:19.121032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.121729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.131185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.131926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.132776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.134495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.135494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.136629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.166188 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d HTTP/1.1 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'abc4cefd-336f-43b1-96d1-522469f6aa9d'} Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:19.173088 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:19.178188 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:19.178689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:19.184854 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-996a261d-0b38-4351-956d-ab384d0bd25d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 404 len: 111 microversion: 2.1 time: 0.062991 Oct 04 18:28:19.184854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3134/6166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:19.747384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:19.747981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:19.768676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.769435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.770096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.770826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:19.771450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:19.772077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:19.916502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:19.937509 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae069922-53a9-4367-b3ff-9503da156519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1300 microversion: 2.1 time: 0.192888 Oct 04 18:28:19.942621 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3033/6167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:19 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1300 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:20.969427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:20.970879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:20.987439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.988199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.988805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:20.990377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:20.993702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:20.994299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:21.640751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:21.656384 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-703d21d2-8ebc-4e75-b7ce-a37eed2dfb96 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 0.692873 Oct 04 18:28:21.657027 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3135/6168] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:20 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:22.510691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.511857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.519099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.519594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.520032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.520736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.521189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.521615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.536955 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d HTTP/1.1 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'abc4cefd-336f-43b1-96d1-522469f6aa9d'} Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:22.538872 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.542957 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.545205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:22.546261 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-50d17659-3d4b-49c2-bf42-8bc899b2e5a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 404 len: 111 microversion: 2.1 time: 0.039789 Oct 04 18:28:22.547635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3034/6169] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:28:22 2022] DELETE /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:28:22.555476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.556780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: abc4cefd-336f-43b1-96d1-522469f6aa9d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.564257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.564759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.565204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.566010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.566610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.567053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.581988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d HTTP/1.1 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'abc4cefd-336f-43b1-96d1-522469f6aa9d'} Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:28:22.583614 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance abc4cefd-336f-43b1-96d1-522469f6aa9d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9c3890a2-39d9-45fb-afc5-a1486b1b81ea tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d" status: 404 len: 111 microversion: 2.1 time: 0.033379 Oct 04 18:28:22.587709 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3136/6170] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:22 2022] GET /compute/v2.1/servers/abc4cefd-336f-43b1-96d1-522469f6aa9d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:28:22.681095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:22.681732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:22.689538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.690083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.697549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.699251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:22.705164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:22.710357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:22.898290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:22.915339 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2be6ace8-8e38-4513-9f33-df686ecec0ff tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 0.238127 Oct 04 18:28:22.916885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3035/6171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:22 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:23.098642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd44d48-a5ed-4ddf-ad5c-544549654be1", "tag": "f865cc9d-94bc-469f-8df1-d3bfc72ef134"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:23.128567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.129500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.129981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.163154 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] Creating event network-changed:f865cc9d-94bc-469f-8df1-d3bfc72ef134 for instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 on n-h2-831194-21 Oct 04 18:28:23.180415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1e5cd57b-ab34-445b-bbe5-f8f1eaf966a0 req-5afb89c0-c027-4736-89c1-3ed0fa82fd96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091126 Oct 04 18:28:23.185532 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3137/6172] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:23.941021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:23.941763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:23.964356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.966047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.966517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:23.971450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:23.972124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:23.972751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:24.263558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:24.273012 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27b03e1c-8c86-48f9-86f8-12a1633d474a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 0.335230 Oct 04 18:28:24.274149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3036/6173] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:23 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:25.298428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:25.299827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:25.314779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.315276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.316158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.318565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:25.320657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:25.321112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:25.787654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:25.875824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:26.013128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:26.039631 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b64355a8-24e3-41ca-a44a-bc7dc4b0bde2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 0.747250 Oct 04 18:28:26.042278 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3138/6174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:25 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:27.082388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:27.084087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:27.094576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:27.099947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.101434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.102592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.103850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.104566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.105218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.612184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd44d48-a5ed-4ddf-ad5c-544549654be1", "name": "network-vif-plugged", "status": "completed", "tag": "f865cc9d-94bc-469f-8df1-d3bfc72ef134"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:27.665279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:27.674466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:27.675200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:27.701294 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] Creating event network-vif-plugged:f865cc9d-94bc-469f-8df1-d3bfc72ef134 for instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 on n-h2-831194-21 Oct 04 18:28:27.719570 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-925ca5ff-6443-40db-b003-0b2267db0bea req-165598cd-3a6c-46a3-be33-ed8268971c1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114016 Oct 04 18:28:27.722973 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3139/6175] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:28.175167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:28.187366 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ab3dd9e-f32f-4faa-b309-3612c78d67b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 1.113010 Oct 04 18:28:28.188267 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3037/6176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:27 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:29.218718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:29.219687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:29.239880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.241045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.241708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.242900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:29.243592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:29.244186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:29.476472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:29.486645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00e06169-1022-4ea0-95bf-ff8390cf83d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1367 microversion: 2.1 time: 0.273326 Oct 04 18:28:29.503716 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3140/6177] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:29 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.516473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.517096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.534028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.534667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.536971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.539867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.540707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.544617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.812207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:30.843895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e42af650-b751-4112-946d-31f708680e8d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1556 microversion: 2.1 time: 0.334472 Oct 04 18:28:30.862581 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3038/6178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1556 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:30.878365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:30.879588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:30.890156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.890851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.891494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:30.892645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:30.893282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:30.893961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:31.122049 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23406b81-6fa7-44fe-bc72-712f86ccd078 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248481 Oct 04 18:28:31.122664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3141/6179] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:28:30 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:33.656191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd44d48-a5ed-4ddf-ad5c-544549654be1", "tag": "f865cc9d-94bc-469f-8df1-d3bfc72ef134"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:33.675568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:33.684250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:33.685254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:33.706802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] Creating event network-changed:f865cc9d-94bc-469f-8df1-d3bfc72ef134 for instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 on n-h2-831194-21 Oct 04 18:28:33.719221 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-26ef85f7-3f3c-46fe-b55b-83291df28298 req-7b2960d2-18f5-4ece-9f31-20f968f59a98 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066066 Oct 04 18:28:33.719996 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3039/6180] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:50.219985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:50.221460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=49 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:50.228317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-206011855", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:50.349516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:51.378582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:51.379673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:51.380341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:51.380903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:51.381466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:51.393469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.394310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.394916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.395800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:51.396504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:51.397083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:51.417544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Getting quotas for project 5bcad072dd19462295bde801edf0a9a1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:51.424004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Getting quotas for user add452fc0fc94c5da08bd34c54fc4272 and project 5bcad072dd19462295bde801edf0a9a1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:51.438658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:51.441237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:51.502363 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4fce3e64-72fc-40ef-868c-7e40107f8754 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.285098 Oct 04 18:28:51.502993 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3142/6181] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:51.519431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d70dc356-617a-4ee1-92df-14a4cba7091e tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:51.520154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d70dc356-617a-4ee1-92df-14a4cba7091e tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:51.532383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=29 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:51.534689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=69 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:28:51.645711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d70dc356-617a-4ee1-92df-14a4cba7091e tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:51.665403 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d70dc356-617a-4ee1-92df-14a4cba7091e tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1214 microversion: 2.1 time: 0.150383 Oct 04 18:28:51.670965 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3040/6182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:51 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1214 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:52.722926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:52.723550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:52.730569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.731063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.731504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.732277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:52.732739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:52.733518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:52.903415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:52.930234 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aaece0b4-3614-4e58-a36a-ad9a63d5333f tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1266 microversion: 2.1 time: 0.213132 Oct 04 18:28:52.931439 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3143/6183] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:52 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:53.955845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:53.956478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:53.967922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.968616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.968873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:53.974120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:53.974841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:53.975445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:54.127292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:54.136797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0351062e-a11d-4559-9939-52627148b1ad tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1272 microversion: 2.1 time: 0.184120 Oct 04 18:28:54.141431 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3041/6184] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:53 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:55.183337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:55.189661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:55.246464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.247774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.249137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.251053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.253135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.253850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:55.525038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:55.550651 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf45910c-ada4-4973-8abb-e55bcfb605ac tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.387336 Oct 04 18:28:55.552484 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3144/6185] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:55 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:55.954348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3d0de8c-0773-4e97-a9b0-3025acf1468d", "tag": "6aadd95c-5f46-42d2-9c38-73f304526dc2"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:55.971961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:55.972585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:55.972987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.019543 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] Creating event network-changed:6aadd95c-5f46-42d2-9c38-73f304526dc2 for instance c3d0de8c-0773-4e97-a9b0-3025acf1468d on n-h1-831194-21 Oct 04 18:28:56.031285 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-609152f6-998b-4e6e-b9cc-d1705b198dc5 req-f75bfb93-94fe-47a7-a1f6-aa1f85edda8a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083164 Oct 04 18:28:56.037004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3042/6186] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:28:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:28:56.580657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:56.581293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:56.590033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.619824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.622057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.625063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:56.626321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:56.629892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:56.968983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:56.978781 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d5e1c29-afa9-44e7-b336-8e49b27b3b51 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.402045 Oct 04 18:28:56.979830 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3145/6187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:56 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:57.203917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-163276660", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "ec7470a9-c3db-4aba-9840-9ddca6a132e0"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:57.263090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] validate_networks() for [('ec7470a9-c3db-4aba-9840-9ddca6a132e0', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:57.653231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-77085451", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "04038c40-1353-4d2b-b7cc-0abd83a542b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:28:57.728875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:28:57.862528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:57.863601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:57.864598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:57.865257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:57.865940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:57.886735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.887623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.888345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.890835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:57.891593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:57.893450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:57.919201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Getting quotas for project c154d99d89b248ca93c1ca46cc246f71. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:57.925292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Getting quotas for user f2d2fcd7653e4d16b87951426259f5ed and project c154d99d89b248ca93c1ca46cc246f71. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:57.940853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:57.943501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:57.995260 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8ff59ebb-99a7-4963-ba5f-6e62efb270e2 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966513 Oct 04 18:28:58.002755 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3043/6188] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:28:58.009296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.010939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:58.020672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.021528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.022224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.023299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.023867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.024526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.318974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.335753 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-745df868-ac85-403d-9ea8-ea7a2313c10a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.331370 Oct 04 18:28:58.337417 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3044/6189] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:58.350364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d79241c-85fb-46d9-8448-b2c714891a71 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:58.351112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d79241c-85fb-46d9-8448-b2c714891a71 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:58.457175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d79241c-85fb-46d9-8448-b2c714891a71 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:58.466533 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d79241c-85fb-46d9-8448-b2c714891a71 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1213 microversion: 2.1 time: 0.127120 Oct 04 18:28:58.483514 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3045/6190] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:58 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1213 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:58.613565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:28:58.614313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:28:58.615082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:28:58.615884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:28:58.616864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:28:58.633742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.634540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.635866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.636922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:58.637593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:58.638325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:58.659319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:28:58.669443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:28:58.787200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:28:58.789472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='04038c40-1353-4d2b-b7cc-0abd83a542b3',volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:28:59.012159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e23fdf60-6330-4d77-9837-4930940e22f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.363511 Oct 04 18:28:59.013981 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3146/6191] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:28:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:28:59.024087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6f186905-36a5-48db-8f1e-a43340d2eb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.024997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6f186905-36a5-48db-8f1e-a43340d2eb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.130435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6f186905-36a5-48db-8f1e-a43340d2eb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:59.139695 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6f186905-36a5-48db-8f1e-a43340d2eb5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1069 microversion: 2.1 time: 0.119425 Oct 04 18:28:59.145885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3046/6192] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1069 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:28:59.369298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.371026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.381813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.382397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.383026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.383889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.384217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.384655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.501324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:28:59.502243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:28:59.511662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.512392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.513003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.520204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:28:59.521512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:28:59.522090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:28:59.598639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:59.610289 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f749046c-6a02-41ea-bc26-ad03d8e2a77c tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1265 microversion: 2.1 time: 0.115862 Oct 04 18:28:59.611458 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3047/6193] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1265 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:28:59.804521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:28:59.821479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f5fa2204-c497-4231-835c-435f4c2125aa tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.456978 Oct 04 18:28:59.825356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3147/6194] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:28:59 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:00.164740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.165461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.174014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.174765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.175381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.176108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.176572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.177005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.252446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.262424 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e0a048f-db32-4a58-8893-98498d7a5bfd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1167 microversion: 2.1 time: 0.101540 Oct 04 18:29:00.263248 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3048/6195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:00 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1167 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:00.637426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.638378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.645522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.646651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.647278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.648171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.648833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.649515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.820556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:00.834147 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-38c5dfaa-320a-45df-ba79-b0b6bf96c031 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1271 microversion: 2.1 time: 0.202302 Oct 04 18:29:00.837152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3148/6196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:00 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1271 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:00.853316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:00.854951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:00.867938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.868691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.870693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:00.871816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:00.872518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:00.873219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.286833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.287691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:01.304990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.305500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.305977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.307494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.308113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.308700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.312392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:01.322281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8bd1eba2-60e9-4923-89e5-434a9e54f13a tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.474182 Oct 04 18:29:01.334378 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3049/6197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:00 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:01.497277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:01.529735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f97b8f7c-f2c4-4302-bf6d-7e1cb931af1c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1185 microversion: 2.1 time: 0.246214 Oct 04 18:29:01.548369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3149/6198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1185 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:01.866307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:01.866950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:01.897090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.897651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.898135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:01.900368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:01.900983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:01.902975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.030645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d0de8c-0773-4e97-a9b0-3025acf1468d", "name": "network-vif-plugged", "status": "completed", "tag": "6aadd95c-5f46-42d2-9c38-73f304526dc2"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:02.054075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.058819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.061090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.099619 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] Creating event network-vif-plugged:6aadd95c-5f46-42d2-9c38-73f304526dc2 for instance c3d0de8c-0773-4e97-a9b0-3025acf1468d on n-h1-831194-21 Oct 04 18:29:02.111890 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c8c14e44-984e-4414-bc9f-ccb728c7376e req-1fd576af-6892-4c17-95ef-1996e184d01d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085737 Oct 04 18:29:02.114270 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3150/6199] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:02.355047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:02.356395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:02.374779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.375526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.376307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.377257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.377977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.378647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.444683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.458277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a42519b0-0068-4910-a2ed-901237ba1695 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1313 microversion: 2.1 time: 0.601043 Oct 04 18:29:02.462232 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3050/6200] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:01 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1313 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:02.560101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:02.560977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:02.567434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.568157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.568742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.569614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:02.570254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:02.570844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:02.705203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.713073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0617b6c8-01df-4c5d-9d13-ea35b9908603 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1314 microversion: 2.1 time: 0.364197 Oct 04 18:29:02.714255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3151/6201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:02 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:02.924686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:02.936453 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a32bed20-0b5f-4a0d-a84e-fdc180d25af9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1227 microversion: 2.1 time: 0.380983 Oct 04 18:29:02.952276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3051/6202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:02 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1227 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:03.247244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b264e53-28b5-4c42-99da-5ee80e6ee0fc", "tag": "4ca2ee44-35de-409d-9d46-bbba77248753"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.270054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.270802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.271408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.283918 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] Creating event network-changed:4ca2ee44-35de-409d-9d46-bbba77248753 for instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc on n-h2-831194-21 Oct 04 18:29:03.290132 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-17ed1aba-a197-4ed9-9e55-01dbcc1c7fdb req-116fecd4-0a1d-4966-9421-f2c73175e78b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047312 Oct 04 18:29:03.292211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3152/6203] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:03.496663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.497684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.497803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1839c8d-ed82-434b-a1ca-2109c00502b8", "tag": "3bf5544a-81fd-4f18-98db-a56b5daec34a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:03.511539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.512499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.513152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.514092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.514959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.515644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.519671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.521537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.522458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.550551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] Creating event network-changed:3bf5544a-81fd-4f18-98db-a56b5daec34a for instance e1839c8d-ed82-434b-a1ca-2109c00502b8 on n-h1-831194-21 Oct 04 18:29:03.563791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3bc68c4a-27b3-4e6a-9d9b-b1cc95198b24 req-d336dd6d-21c2-4349-af9d-8ebc46404d12 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071723 Oct 04 18:29:03.564790 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3153/6204] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:03.737947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.739183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.755242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.756258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.756920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.758008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.758682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.759378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.881350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:03.899161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d60faf0-c463-495d-9835-f0eb2f03f1c8 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1313 microversion: 2.1 time: 0.417245 Oct 04 18:29:03.899795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3052/6205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:03.966044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:03.966766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:03.982061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.982593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.983061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:03.983924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:03.984564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:03.985168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.024080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.033002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d3eb7bbe-bd87-47eb-aaad-a9696f4ca7f0 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1464 microversion: 2.1 time: 0.300210 Oct 04 18:29:04.037350 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3154/6206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1464 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:04.100324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.101152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.112012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.112819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.113714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.114657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.115313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.116037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.146817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:04.246496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e47e8a56-014a-4026-b4e1-f57c1e8cf5b4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 204 len: 0 microversion: 2.1 time: 0.150375 Oct 04 18:29:04.248542 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3155/6207] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:04 2022] DELETE /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:29:04.258296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.259428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.268031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.268886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.269523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.270815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.271531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.272502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.449440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.462325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-584d7ee4-b9f8-4b79-8fc5-30942dde1bdd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1470 microversion: 2.1 time: 0.208758 Oct 04 18:29:04.479683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3156/6208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1470 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:04.684362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:04.695557 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e1f3265-00c0-45b0-b9dd-fb0f8e371019 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1227 microversion: 2.1 time: 0.734736 Oct 04 18:29:04.714268 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3053/6209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:03 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1227 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:04.929490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:04.931058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:04.947411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.947952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.948398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:04.949272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:04.949596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:04.958410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.276002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:05.285061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b4d5b61-d3db-4dfd-8089-9e903106d1b0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1313 microversion: 2.1 time: 0.363071 Oct 04 18:29:05.286061 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3157/6210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:04 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:05.490259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.491498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:05.500849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.504101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.506694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.507742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.508721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.509207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.722226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:05.722854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:05.730385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.731275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.731822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.732650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:05.733192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:05.733629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:05.891583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:05.903846 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff5552cb-1c26-4181-9f34-9375f00ff69a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1227 microversion: 2.1 time: 0.184609 Oct 04 18:29:05.904730 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3158/6211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1227 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:05.997874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.007420 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1b982283-c3f0-4266-ba59-c2fcaf27f23b tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1470 microversion: 2.1 time: 0.522376 Oct 04 18:29:06.022955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3054/6212] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:05 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1470 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:06.312736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.318002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.336871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.337568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.338526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.339852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.340442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.340977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.638821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:06.652274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1aa4f866-59f4-4a6b-a937-382d07c8419d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1313 microversion: 2.1 time: 0.341689 Oct 04 18:29:06.653763 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3159/6213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:06.808845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3d0de8c-0773-4e97-a9b0-3025acf1468d", "name": "network-vif-deleted", "tag": "6aadd95c-5f46-42d2-9c38-73f304526dc2"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:06.820106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.820612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.821210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.851104 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] Creating event network-vif-deleted:6aadd95c-5f46-42d2-9c38-73f304526dc2 for instance c3d0de8c-0773-4e97-a9b0-3025acf1468d on n-h1-831194-21 Oct 04 18:29:06.857162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-62241545-13d2-46b1-a638-98853534877a req-e720a9df-4589-4e03-94c9-e8fade5c770b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054071 Oct 04 18:29:06.858387 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3055/6214] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:06.928827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:06.929821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:06.943545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.944423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.945946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.949308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:06.950640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:06.951112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:06.958986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:07.036471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.037384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:07.050905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.051703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.052649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.057606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.058323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.058775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.136804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.137624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.138065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.138770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lazy-loading 'fault' on Instance uuid c3d0de8c-0773-4e97-a9b0-3025acf1468d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:07.192835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'add452fc0fc94c5da08bd34c54fc4272', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bcad072dd19462295bde801edf0a9a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.202896 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e97581e-4ae8-4714-870a-0380a0abb0bd tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 200 len: 1304 microversion: 2.1 time: 0.171440 Oct 04 18:29:07.203669 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3056/6215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 1304 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:07.262892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.270750 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5e36144-2a78-4f74-afae-c97a121a0007 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1227 microversion: 2.1 time: 0.347216 Oct 04 18:29:07.271328 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3160/6216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:06 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1227 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:07.505424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b264e53-28b5-4c42-99da-5ee80e6ee0fc", "name": "network-vif-plugged", "status": "completed", "tag": "4ca2ee44-35de-409d-9d46-bbba77248753"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:07.517269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.517761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.518398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.538207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] Creating event network-vif-plugged:4ca2ee44-35de-409d-9d46-bbba77248753 for instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc on n-h2-831194-21 Oct 04 18:29:07.547409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e272a448-2e6e-4c44-bfd2-cc64c0fe79d9 req-3f4cf139-8cdb-4471-8dda-04406b1bc127 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046221 Oct 04 18:29:07.548360 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3057/6217] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:07.640619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.641117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:07.648379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.649115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.649719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.650500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.650963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.651395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.675883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-131e56fe-da22-4c88-bda3-16519898d82a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/ips" status: 200 len: 148 microversion: 2.1 time: 0.039088 Oct 04 18:29:07.679815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:07.682541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:07.684300 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3161/6218] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:07.690761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.691256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.691883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.692646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:07.693266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:07.693698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:07.909426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:07.927003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:07.936910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76e11979-cb15-4f2f-8933-cdf3f4d761e0 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1313 microversion: 2.1 time: 0.263725 Oct 04 18:29:07.937728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3058/6219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:07 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:08.228253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.232626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] [instance: c3d0de8c-0773-4e97-a9b0-3025acf1468d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.241855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.242773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.243321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.244159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.244675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.245116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.261292 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] HTTP exception thrown: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Request method failure captured: Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d HTTP/1.1 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHtfVn003L-3MXVuCfK6QbWyCr4P0m4iWrca6LceItlBRge9VBWjTIBOhu5n86wW_v0IKvCPp0Ng0s_nbSrG9Gvy_z_3CiP7bpeL5wXuHxpoTc53tzIpQy9YPMRcXIuegyLpEyO3W1zgBoG_efVtxqMC1n877FTPF4svIuijMci4Alo Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5bcad072dd19462295bde801edf0a9a1 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesNegativeTest-1502034515 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5bcad072dd19462295bde801edf0a9a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bcad072dd19462295bde801edf0a9a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5bcad072dd19462295bde801edf0a9a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5bcad072dd19462295bde801edf0a9a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesNegativeTest-1502034515 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5bcad072dd19462295bde801edf0a9a1 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesNegativeTest-1502034515 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesNegativeTest-1502034515-project Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: add452fc0fc94c5da08bd34c54fc4272 Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesNegativeTest-1502034515-project Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c3d0de8c-0773-4e97-a9b0-3025acf1468d'} Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:08.263382 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. Oct 04 18:29:08.267885 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:08.269133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] Returning 404 to user: Instance c3d0de8c-0773-4e97-a9b0-3025acf1468d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:08.270432 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3fdc8e73-2f30-4129-9fde-556350a16fa4 tempest-VolumesNegativeTest-1502034515 tempest-VolumesNegativeTest-1502034515-project] 10.222.0.42 "GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d" status: 404 len: 111 microversion: 2.1 time: 0.046290 Oct 04 18:29:08.271502 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3162/6220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers/c3d0de8c-0773-4e97-a9b0-3025acf1468d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:08.295719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.296272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.302606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.303123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.303541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.304439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.305054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.305637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.485275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:08.502115 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f1b54b06-1e97-4fc1-9ca0-4901a0f75405 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.211290 Oct 04 18:29:08.503299 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3059/6221] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:08.966995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:08.967648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:08.977269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:08.978443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:08.989350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.990722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.991381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:08.996741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:08.997667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:08.998077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.277657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.287494 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3aff6a81-9969-47ad-adcd-4d2d57dca839 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1497 microversion: 2.1 time: 0.329861 Oct 04 18:29:09.299140 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3163/6222] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:08 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:09.524464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:09.531096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:09.531846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:09.548365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.549238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.549892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.550954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:09.551673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:09.552271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:09.815205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:09.829505 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d01e866-e64c-46c6-8b48-44a4cc7f3f14 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.306907 Oct 04 18:29:09.830186 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3060/6223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:09 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:10.235955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:10.240187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.248422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.249204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.249895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.250812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.251513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.252161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.684551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-82c07df7-4041-4a04-a9fb-bc792741888e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.452219 Oct 04 18:29:10.690805 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3164/6224] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:29:10 2022] POST /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:10.855907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:10.856802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:10.866073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.866747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.867205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:10.868123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:10.868596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:10.869944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:11.044025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:11.047507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:11.057385 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0396ea51-1b97-4619-a0d7-8a55da0bad74 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.206428 Oct 04 18:29:11.058262 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3061/6225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:10 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:12.090456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:12.091187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:12.115754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.116365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.117008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.118110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:12.118644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:12.121592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:12.311311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:12.338697 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-adef79be-ea6a-4051-b678-306a29f02cc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.256759 Oct 04 18:29:12.339534 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3165/6226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:12 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:13.279926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.281092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.290206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.291445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.292440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.293377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.294076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.294850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.331450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:29:13.365439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.366917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.381612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.382478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.383164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.384153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.385715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.386889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.593338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-215eb050-1469-4d86-8a5d-54e219e74f3d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 204 len: 0 microversion: 2.1 time: 0.319541 Oct 04 18:29:13.594106 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3062/6227] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:29:13 2022] DELETE /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:29:13.625546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:13.626394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:13.635292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.636098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.636759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.637668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:13.638357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:13.638982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:13.707796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:13.720996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-84b8e088-ec74-4878-8cd3-c89dfd4f01dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.361871 Oct 04 18:29:13.722281 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3166/6228] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:13.945181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:13.960074 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5452a305-b70e-4760-bf09-54254139e5c7 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1503 microversion: 2.1 time: 0.360167 Oct 04 18:29:13.980522 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3063/6229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:13 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:14.746022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:14.746957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:14.757074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.757571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.758053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:14.758770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:14.759796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:14.760348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:14.996350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:14.997458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:15.013626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.015205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.019410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.019651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:15.020206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:15.020688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:15.021129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:15.030714 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca5ba203-bfde-49fd-b013-245e2c504540 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.288633 Oct 04 18:29:15.033620 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3167/6230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:14 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:15.213366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:15.221746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-008f63bf-a97d-4840-a158-95ee98ef318d tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1503 microversion: 2.1 time: 0.235052 Oct 04 18:29:15.224194 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3064/6231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:14 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:16.056535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.057575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:16.074135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.076998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.078133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.083360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.084143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.084729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.249654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:16.251147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:16.259752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.261643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.262351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.263680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.264358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.265027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.388989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:16.399449 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b6df6f4-0b82-4e28-bd73-e6f0023d3104 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1461 microversion: 2.1 time: 0.154942 Oct 04 18:29:16.402004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3065/6232] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1461 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:16.413104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1839c8d-ed82-434b-a1ca-2109c00502b8", "name": "network-vif-plugged", "status": "completed", "tag": "3bf5544a-81fd-4f18-98db-a56b5daec34a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:16.451399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.451892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.452329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.477532 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] Creating event network-vif-plugged:3bf5544a-81fd-4f18-98db-a56b5daec34a for instance e1839c8d-ed82-434b-a1ca-2109c00502b8 on n-h1-831194-21 Oct 04 18:29:16.492250 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6112371f-2000-4526-934c-c5bca0b25718 req-7f5ce4d5-bc4e-4cae-85e3-3df9d38264d9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088800 Oct 04 18:29:16.501646 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3066/6233] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:16.851969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:16.878403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b264e53-28b5-4c42-99da-5ee80e6ee0fc", "name": "network-vif-deleted", "tag": "4ca2ee44-35de-409d-9d46-bbba77248753"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:16.886037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9875f776-0a97-476c-a8d7-a738ca49f178 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.833119 Oct 04 18:29:16.889453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:16.890127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:16.890697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:16.895493 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3168/6234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:16 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:16.906893 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] Creating event network-vif-deleted:4ca2ee44-35de-409d-9d46-bbba77248753 for instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc on n-h2-831194-21 Oct 04 18:29:16.913159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f0eff8bc-57c2-4891-b3c0-6c5160c82975 req-65a56a6e-cae4-4495-b485-fd25b905a98d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038822 Oct 04 18:29:16.918551 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3067/6235] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:17.434054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.437290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.483873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.492870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.493462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.496221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.496719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.497170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.578613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.583963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.583963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.586055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lazy-loading 'fault' on Instance uuid 9b264e53-28b5-4c42-99da-5ee80e6ee0fc {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:29:17.684108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2d2fcd7653e4d16b87951426259f5ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c154d99d89b248ca93c1ca46cc246f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:17.693081 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55b7ea58-de33-49cb-80b1-fbb8db2cefce tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 200 len: 1303 microversion: 2.1 time: 0.268419 Oct 04 18:29:17.696239 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3169/6236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 1303 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:17.929083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:17.930478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:17.945360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.947744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.948284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:17.949245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:17.949788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:17.950275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.130363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:18.140032 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-911f670e-2aa5-4a24-918c-2b567929eca6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1215 microversion: 2.1 time: 0.215584 Oct 04 18:29:18.140857 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3068/6237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:17 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1215 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:18.719974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:18.720941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] [instance: 9b264e53-28b5-4c42-99da-5ee80e6ee0fc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:18.729550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.730089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.730537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.731254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:18.731715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:18.732149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:18.746377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] HTTP exception thrown: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Request method failure captured: Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc HTTP/1.1 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHtmFTpvyvqkxV2IVgj6Ln3StzLcd1ILj73DAzRMUDsDcdvUt_SuySnPhVQqiemfO-B-IrFYiFq3zrXdeXuwO8lOgJ2155j5QWRn0-FaOlMemTI6x6DqaY5fMrctALLW4bIqHNAHwWjSAHXWbu-gUgWoUXkl7NS-Gd4YxxCe5Vawaxs Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c154d99d89b248ca93c1ca46cc246f71 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesActionsTest-1660373808 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c154d99d89b248ca93c1ca46cc246f71"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c154d99d89b248ca93c1ca46cc246f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c154d99d89b248ca93c1ca46cc246f71"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c154d99d89b248ca93c1ca46cc246f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesActionsTest-1660373808 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c154d99d89b248ca93c1ca46cc246f71 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesActionsTest-1660373808 Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesActionsTest-1660373808-project Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f2d2fcd7653e4d16b87951426259f5ed Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesActionsTest-1660373808-project Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9b264e53-28b5-4c42-99da-5ee80e6ee0fc'} Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:29:18.748200 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] Returning 404 to user: Instance 9b264e53-28b5-4c42-99da-5ee80e6ee0fc could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dac7f5df-0929-4925-8499-3b30dd46e532 tempest-VolumesActionsTest-1660373808 tempest-VolumesActionsTest-1660373808-project] 10.222.0.42 "GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc" status: 404 len: 111 microversion: 2.1 time: 0.033726 Oct 04 18:29:18.752745 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3170/6238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:18 2022] GET /compute/v2.1/servers/9b264e53-28b5-4c42-99da-5ee80e6ee0fc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:29:19.168312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.169288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.186789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.187218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.187672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.188404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.188875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.194122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.196039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: .version_select at 0x7fbdbd13d1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-799402778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+ZMmyF2aLfdLMHn7t62mjxJxByukmI8+3HpMCfmAnVilPdO++anRcXmaIAywUOx0V7xVLsrZCZH5hIffcP6w9MfF3UYimDc2CxEAExQ9SGu1ex4VtuC+pIk3PmpSgdZA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:19.239843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:19.262508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:19.280854 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [a800a107-11e8-488a-aff6-acd772d471c8] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:29:19.367853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.380594 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-983098b0-a759-42f5-b0e9-505c1f709081 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1402 microversion: 2.1 time: 0.219607 Oct 04 18:29:19.381331 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3171/6239] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1402 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:19.404505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:19.405358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.411377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.411914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.412365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.413161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.413626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.414244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.593799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:19.606956 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eb90985c-e517-48bf-9d2a-83dc6a0a4a1b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1402 microversion: 2.1 time: 0.206373 Oct 04 18:29:19.607977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3172/6240] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:19 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1402 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:19.633562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1391993161"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:19.637711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:19.643260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:19.644910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.645765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.646400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.647451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:19.648070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:19.649369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:19.781870 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Attempting to quiesce instance before volume snapshot. Oct 04 18:29:19.842275 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 04 18:29:19.956432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Creating snapshot from volume 04038c40-1353-4d2b-b7cc-0abd83a542b3. {{(pid=128849) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 04 18:29:20.288669 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [a800a107-11e8-488a-aff6-acd772d471c8] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 52160. Oct 04 18:29:20.308788 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-682466b1-d321-4cda-b728-9c31169ccdf7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.346570 Oct 04 18:29:20.310241 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3069/6241] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:29:18 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:21.587350 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b91afe94-b8c7-4794-887b-42fccb8c3b7c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8/action" status: 202 len: 0 microversion: 2.1 time: 1.957860 Oct 04 18:29:21.588264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3173/6242] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:29:19 2022] POST /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8/action => generated 0 bytes in 1960 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 18:29:23.009338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1796783646", "imageRef": "2e076d57-a713-4763-addd-32a3114c65b6", "flavorRef": "452", "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:23.055480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:23.129013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:24.191672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2977e8e-4915-4cfa-936b-d119ba234e6c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: .version_select at 0x7fbdbdc7cca0>, body: {"keypair": {"name": "tempest-keypair-1151118449", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPgrzYN8pwgVD3KRm4KPzcFCUwd52Tv0b2nglxBTc4d58d8y5AxSWkcnz2s2f5PmGUNqL1w7t5ix6ol7Zew9THWfFE05atxx7rUut3pQcUXJS/J3hrku4Y/LJM3NgPOW0A=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:24.216781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:24.217310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:24.217922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:24.218438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:24.219139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:24.249542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.250571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.251526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.253138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:24.256315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:24.262143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:24.269576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d2977e8e-4915-4cfa-936b-d119ba234e6c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:24.287401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d2977e8e-4915-4cfa-936b-d119ba234e6c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:24.335816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:24.356155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:24.389308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2977e8e-4915-4cfa-936b-d119ba234e6c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.203434 Oct 04 18:29:24.395753 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3174/6243] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:29:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:24.407105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:24.409874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='052d8f5b-3ff3-4be8-96b8-b9a5bf831ce0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:24.594659 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-708ebaa8-d7a6-40f3-a1bd-d8c850c73217 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.590358 Oct 04 18:29:24.598773 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3070/6244] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:24.636052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-07405b1d-22e5-434b-984d-0e138a886cf7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:24.638784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-07405b1d-22e5-434b-984d-0e138a886cf7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:24.936739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-07405b1d-22e5-434b-984d-0e138a886cf7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:24.983306 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-07405b1d-22e5-434b-984d-0e138a886cf7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1230 microversion: 2.1 time: 0.359876 Oct 04 18:29:25.000517 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3175/6245] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:24 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1230 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:26.014020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:26.015233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:26.030410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.038569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.039288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.040742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:26.043991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:26.044609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:26.240923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:26.250574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce1315d7-ab4e-4510-99cc-ac03be9d09bf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1282 microversion: 2.1 time: 0.242128 Oct 04 18:29:26.265746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3071/6246] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:26 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1282 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:27.276917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:27.278321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:27.287580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.288462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.289129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.290926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:27.293291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:27.294080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:27.442037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:27.447208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:27.482535 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4fff8c1-9e5f-4ab3-9b7e-7aac5a504c33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1300 microversion: 2.1 time: 0.209758 Oct 04 18:29:27.485133 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3176/6247] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:27 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1300 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:28.515984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:28.516662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:28.546443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.548599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.551750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:28.553096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:28.554287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:28.556705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:29.309993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:29.324224 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2e3c9d0-bae7-40d9-9f72-b2e365bbb151 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.815613 Oct 04 18:29:29.327280 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3072/6248] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:28 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:29.502652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-390697712", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e80190d-6f7c-4a36-acb4-292d1b415902"}], "security_groups": [{"name": "tempest-securitygroup--1332951714"}], "key_name": "tempest-keypair-1151118449", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:29.896374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] validate_networks() for [('6e80190d-6f7c-4a36-acb4-292d1b415902', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:30.353174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:30.354510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:30.364650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.371018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.376720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:30.378257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:30.379197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:30.380985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.205486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:31.215904 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cca44118-e04b-49eb-ae9d-a000d643fd48 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.867290 Oct 04 18:29:31.226139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3073/6249] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:30 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:31.247690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:31.248718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:31.249430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:31.250771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:31.254887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:31.284541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.289458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.298522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.301271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.303169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.304954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.420547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:31.468154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:31.563238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:31.583739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:31.633412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6", "tag": "ce0b8404-2832-4158-9723-262bb1dd9681"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:31.665959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:31.666375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:31.666838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:31.706442 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] Creating event network-changed:ce0b8404-2832-4158-9723-262bb1dd9681 for instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 on n-h2-831194-21 Oct 04 18:29:31.716764 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-16b4e791-dfa6-4b91-b006-0285c42a0f98 req-d053e24f-bee0-43bb-b781-072d81edd44f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087061 Oct 04 18:29:31.726226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3074/6250] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:31.764748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6b09f06-baf4-4cae-b842-3f298f858125 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.267735 Oct 04 18:29:31.778582 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3177/6251] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 2282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:31.782235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ca3b0439-5d88-4aec-b70e-635391eb9f38 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:31.782994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ca3b0439-5d88-4aec-b70e-635391eb9f38 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:31.995481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ca3b0439-5d88-4aec-b70e-635391eb9f38 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:32.017185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ca3b0439-5d88-4aec-b70e-635391eb9f38 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1241 microversion: 2.1 time: 0.239167 Oct 04 18:29:32.017870 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3075/6252] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:31 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1241 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:32.244861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:32.245932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:32.275654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.282065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.283210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.284372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:32.286433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:32.287177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:32.910329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:32.927650 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2defdec-79d8-46c5-b992-53b7848e0fde tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.690644 Oct 04 18:29:32.928981 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3178/6253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:32 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:33.048663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e5da2b4-c0aa-4859-91aa-93369339fbc9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.049398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e5da2b4-c0aa-4859-91aa-93369339fbc9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:33.323391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e5da2b4-c0aa-4859-91aa-93369339fbc9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:33.333525 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e5da2b4-c0aa-4859-91aa-93369339fbc9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1241 microversion: 2.1 time: 0.289172 Oct 04 18:29:33.335439 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3076/6254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1241 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:33.956763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:33.957403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:33.982111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:33.986443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:33.990081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.000623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.007691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.010268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.362496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:34.364324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:34.368414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:34.392970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.393471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.393952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:34.394676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:34.395134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:34.395579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:35.186497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:35.212308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1573f04a-6f73-41bc-86f8-4477bb710a5d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 1.258262 Oct 04 18:29:35.228393 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3179/6255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:33 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:35.416102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:35.424624 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c4a9cc5-ce85-4226-b482-8d689cb5d51e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1301 microversion: 2.1 time: 1.066223 Oct 04 18:29:35.442219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3077/6256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:34 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1301 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:36.249819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.253193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:36.264347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.266843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.268751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.270921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.273673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.280393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.457489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:36.458949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:36.482454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.488067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.499909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.500975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:36.512711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:36.513548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:36.895506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:36.919603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf191002-45d9-47c0-a866-e4ac05295811 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1299 microversion: 2.1 time: 0.465831 Oct 04 18:29:36.949996 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3078/6257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1299 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:36.974596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-842956092", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "134dbf03-b41f-415b-b10a-57fa97cf99cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-799402778", "security_groups": [{"name": "tempest-secgroup-smoke-1586525568"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:37.083105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:37.128079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a9dfafc-a187-4465-a4a6-248b0a13c679 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.885999 Oct 04 18:29:37.134111 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3180/6258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:36 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:37.960295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:37.961239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:37.988183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:37.991405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:37.995909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:37.997172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.000057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.006614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.171551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] validate_networks() for [('134dbf03-b41f-415b-b10a-57fa97cf99cf', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:29:38.550573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:38.575300 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9cd5d3b-1f79-4cd4-8c2d-fb5490c29259 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.622545 Oct 04 18:29:38.582276 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3181/6259] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:37 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:38.597512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:38.603580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:38.629503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.630525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.631289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:38.632296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:38.642663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:38.643617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.043482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:39.053217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92e5ae3d-c749-4aeb-a6b5-b9895c546e47 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.469353 Oct 04 18:29:39.071819 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3182/6260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:38 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:39.621926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:39.623017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:39.647219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.652919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.654226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:39.655966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:39.656665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:39.657351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.144258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.159751 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e715261-73f6-4975-baa7-b5a59f5e9fdd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.543008 Oct 04 18:29:40.160509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3183/6261] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:39 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.179641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.183292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.200302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.201025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.203149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.203149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.204046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.204577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.256190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:29:40.256727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:29:40.257494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:29:40.259456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:29:40.259456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:29:40.286983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=15 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:40.304769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.305845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.305845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.309769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:40.315007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:40.316915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:40.389147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:29:40.400973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:29:40.437308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:29:40.439719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:29:40.526701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a53202a-ee99-4615-a8b3-ceea76561b82 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.558762 Oct 04 18:29:40.527885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3079/6262] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:29:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 3561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:29:40.542022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d05930ef-84f4-4618-82cf-123893bf3f51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:40.547558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d05930ef-84f4-4618-82cf-123893bf3f51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:40.578461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.600683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0c75e2b9-b243-4d7c-9a1b-285c76d1b330 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.439167 Oct 04 18:29:40.601275 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3184/6263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:40.807990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d05930ef-84f4-4618-82cf-123893bf3f51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:40.826189 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d05930ef-84f4-4618-82cf-123893bf3f51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1265 microversion: 2.1 time: 0.290539 Oct 04 18:29:40.831684 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3080/6264] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:40 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:41.057972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedcbcff-2ee9-411d-a907-18a780ca6391", "tag": "21c9ce15-3434-4b70-9cc3-69445ee582cf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:41.089101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.089798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.090420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.130576 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] Creating event network-changed:21c9ce15-3434-4b70-9cc3-69445ee582cf for instance fedcbcff-2ee9-411d-a907-18a780ca6391 on n-h1-831194-21 Oct 04 18:29:41.139943 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-03d4e494-3248-471a-a7a2-a94cfee9a70e req-fb6c1c88-ce97-4fe1-b857-d8e15e024e4f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127162 Oct 04 18:29:41.143945 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3185/6265] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:41.192346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.193639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.208524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.210283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.214206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.216016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.219801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.220752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.236959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:41.640080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:41.652821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=12 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:41.659467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.666548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.693776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:41.701666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.704509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.708719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.710423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:41.718094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:41.719022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:41.722884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3aff1962-e481-443b-83db-a515be1c3fd6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.537433 Oct 04 18:29:41.745684 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3081/6266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:41.861477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:41.863923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:41.992055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.001023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.013005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.013811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.014374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.015066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.310421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:42.326142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6042687c-d116-4e30-a1e1-39355f0e533e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1269 microversion: 2.1 time: 0.471579 Oct 04 18:29:42.350011 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3082/6267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1269 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:42.777288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:42.778166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:42.809595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.810346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.811094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:42.813914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:42.814578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:42.816273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.218980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.236274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5e2e1e05-fedb-44fa-af12-199f61a0ed61 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.465935 Oct 04 18:29:43.237855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3083/6268] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:42 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.357568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:43.362924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:43.390392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.390901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.391864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.394501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:43.397925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:43.399247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:43.732249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.742828 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87477be9-78ae-43d1-87c8-f2fa63101320 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 2.117096 Oct 04 18:29:43.779569 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3186/6269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:41 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 2154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:43.802890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:43.827926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c626ede0-ac74-4255-84c1-e9033f74471c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1317 microversion: 2.1 time: 0.476234 Oct 04 18:29:43.847721 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3084/6270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:43 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1317 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:44.273035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.274841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.300255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.301421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.327260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.330147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.330932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.332791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.787666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:44.788298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:44.805468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.814625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.815242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.816025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:44.822791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:44.823400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:44.979086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:44.993459 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4533dba6-ea60-45a9-b969-dcc73928105c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.726328 Oct 04 18:29:45.000655 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3187/6271] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:45.006645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:45.010237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:45.046766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.047590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.048277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.056377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:45.057267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:45.058070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:45.348817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.368222 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec654393-0941-4592-98de-1916a0051f15 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1323 microversion: 2.1 time: 0.365263 Oct 04 18:29:45.379014 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3188/6272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:45 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1323 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:45.628700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:45.638499 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-199c7f24-66e2-4a79-aeb5-b03700d8d7cc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.854825 Oct 04 18:29:45.639315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3085/6273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:44 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:46.022254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.022910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.041803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.042409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.042880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.043649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.044136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.044589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.423334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.424056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.425184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.446927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.449209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.450513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.451902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.452587 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43a832b0-ab7f-4d3b-b492-1c8857a29b07 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.433901 Oct 04 18:29:46.453721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.454257 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3189/6274] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:46.454901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.667043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:46.668037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:46.674395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.683216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.683975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.687187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:46.687738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:46.688192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:46.987747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:46.999294 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-144c7eb9-4c49-40b7-afd5-de1fc4a87240 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.589176 Oct 04 18:29:47.001027 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3086/6275] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:47.185162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.195282 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da20b12b-0816-4f65-ad42-4034cdfdd811 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.535803 Oct 04 18:29:47.197179 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3190/6276] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:46 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:47.482822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:47.488782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:47.502296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.503666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.504925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.506684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:47.509468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:47.510491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:47.800586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:47.810614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6965b754-dfba-4cf6-83a1-a6e7cce1ec0d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.336688 Oct 04 18:29:47.811212 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3087/6277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:47 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.032862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.033964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.056958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.057854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.058550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.059409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.060716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.062378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.223965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.224781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.246186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.247097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.247793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.249015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.258284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.259242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.378261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:48.411628 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-111f3d31-b23c-49fd-9a26-a01af4626e59 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.385159 Oct 04 18:29:48.417956 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3191/6278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.582920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:48.596855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec4f9f69-5443-4b94-ae25-79d7e61954fd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.379648 Oct 04 18:29:48.597793 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3088/6279] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:48.742452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:48.761995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedcbcff-2ee9-411d-a907-18a780ca6391", "name": "network-vif-plugged", "status": "completed", "tag": "21c9ce15-3434-4b70-9cc3-69445ee582cf"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:48.785121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.787106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.788500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.790389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.794239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.795631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.816256 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] Creating event network-changed:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h2-831194-21 Oct 04 18:29:48.826843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] Creating event network-vif-plugged:21c9ce15-3434-4b70-9cc3-69445ee582cf for instance fedcbcff-2ee9-411d-a907-18a780ca6391 on n-h1-831194-21 Oct 04 18:29:48.829398 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7f996109-9498-4669-a390-c257edfa8f48 req-9cea4ece-bf5e-443a-97ff-f6c5d4ad998e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093717 Oct 04 18:29:48.830769 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3192/6280] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:48.839144 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e50d364d-f156-4f23-aa04-3442e9c73923 req-f47be8f7-1e97-4de5-97a7-7042386d1997 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088252 Oct 04 18:29:48.843856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:48.846206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:48.846548 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3089/6281] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:48.865207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.866608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.869192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:48.870342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:48.870998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:48.871627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.447154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.448269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:49.465687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.466402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.467018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.468051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.468663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.469243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.514880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.528211 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a46f900b-6cc7-4e8d-8bf1-f5be38eafea5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1367 microversion: 2.1 time: 0.694737 Oct 04 18:29:49.528798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3193/6282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:48 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1367 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:49.623251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:49.624250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:49.635546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.643230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.643987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.644964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:49.648888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:49.650572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:49.834596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:49.849152 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c16e0634-963e-4f09-ad45-f2aa65089cf3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.406426 Oct 04 18:29:49.855026 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3090/6283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:49 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.407050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:50.428290 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8dd172e-ae1f-4de5-a9be-71898285c73d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.808483 Oct 04 18:29:50.445815 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3194/6284] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:49 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:50.560527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.561445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.590356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:50.594443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.598732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.605180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.606419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.607499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.612157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.823726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=7 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:50.882930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:50.883598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:50.885768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:50.902331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.904550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.906395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.908692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:50.910712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:50.914749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:50.963903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:51.254408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:51.308006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bc8ca646-2256-41de-9ad4-44b45109371e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1556 microversion: 2.1 time: 0.745950 Oct 04 18:29:51.309373 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3091/6285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1556 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:51.360029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:51.365487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:51.403309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.405306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.407160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.412857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.417492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.422939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.524140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:51.540705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d073a3f-8a1a-4046-8556-842b0344af90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.661544 Oct 04 18:29:51.541648 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3195/6286] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:50 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:51.547525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:51.562767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:51.573518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.574076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.574543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.575297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:51.575783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:51.576212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:51.827958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-83628c6c-4386-4331-a3a4-d3fdef40d37d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.496938 Oct 04 18:29:51.828975 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3092/6287] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:29:51 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/os-interface => generated 284 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:52.127461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.140446 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7bb3a50c-57cb-4275-80e3-b877e428cf4c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.594461 Oct 04 18:29:52.141089 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3196/6288] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:51 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:52.582030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:52.582908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:52.610886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.611787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.612410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.613549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:52.614223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:52.614806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:52.973940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:52.992498 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-745e3faf-8c70-4958-980f-ea134415dba6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.424113 Oct 04 18:29:52.994215 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3093/6289] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:52 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:53.167471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:53.168764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:53.176563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.177337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.177970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.178966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:53.180345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:53.182462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:53.847493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:53.859883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-032c9c3f-fe01-4fa0-bc9d-715343d85695 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.698204 Oct 04 18:29:53.874215 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3197/6290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:53 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.018162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.019364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:54.024687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:54.041936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.042607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.043279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.044322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.044847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.045294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.348867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:54.361638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedcbcff-2ee9-411d-a907-18a780ca6391", "tag": "21c9ce15-3434-4b70-9cc3-69445ee582cf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:54.364196 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40d1753a-717c-45e3-953c-d752aa7d2c93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.351147 Oct 04 18:29:54.364803 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3094/6291] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:54.392736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.393757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.394462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.408098 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] Creating event network-changed:21c9ce15-3434-4b70-9cc3-69445ee582cf for instance fedcbcff-2ee9-411d-a907-18a780ca6391 on n-h1-831194-21 Oct 04 18:29:54.415719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-54172702-498a-41f2-a9cb-efa78839c015 req-d6e9c75e-f684-41fb-b9d6-e445c7161f04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057162 Oct 04 18:29:54.421289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3198/6292] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:29:54.893211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:54.893894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:54.917908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.918573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.919035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:54.919767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:54.920233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:54.920672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.395909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:55.397500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:55.427809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.435076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.438518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.440478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:55.441179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:55.445970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:55.483481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.500356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c06bb82e-38bf-4fd6-906b-62dc5e581447 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.617738 Oct 04 18:29:55.500973 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3095/6293] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:54 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:55.928503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:55.939102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b58362f5-b8fb-4c67-8473-2c3ae285c26b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.549387 Oct 04 18:29:55.946368 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3199/6294] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:55 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:29:56.537174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:56.537802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:56.555579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.556097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.556550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.557285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.557754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.569184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.590913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "name": "network-vif-plugged", "status": "completed", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:29:56.638646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:56.639342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:56.640012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:56.679405 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] Creating event network-vif-plugged:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h2-831194-21 Oct 04 18:29:56.696612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-9a33dc7b-a39a-4995-a0bf-4e40b6515542 req-035c445f-afe3-4e11-a31b-0aecfce14002 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109427 Oct 04 18:29:56.700711 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3200/6295] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:29:56.985689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:56.986475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:57.005108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.005641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.006137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.006906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:57.007573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:57.008070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:57.247902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:57.260219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb96fdd6-818c-4e59-90af-aec42abc4c0f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1342 microversion: 2.1 time: 0.723040 Oct 04 18:29:57.261185 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3096/6296] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:56 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1342 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:57.710979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:57.726277 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-048f0561-f233-4c7d-8c5f-d5b0f1e8f8a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.741725 Oct 04 18:29:57.737856 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3201/6297] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:56 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:58.284690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.286110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:58.294504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.295478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.296158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.297134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.297863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.298525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.544836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:58.555432 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0be84c3-76b2-41fe-90e8-e43289a402b7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1388 microversion: 2.1 time: 0.273460 Oct 04 18:29:58.556386 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3097/6298] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1388 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:58.764863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:58.765536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:58.794750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.795498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.797624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:58.798609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:58.799726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:58.801939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.139028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.149530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac4246db-aa14-4bb2-8051-df1d40b6f78d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1391 microversion: 2.1 time: 0.393345 Oct 04 18:29:59.150458 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3202/6299] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:58 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1391 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:29:59.586109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:29:59.586881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:29:59.601545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.603943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.603943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.604207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:29:59.605704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:29:59.605704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:29:59.917068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:29:59.925480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:29:59.929780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb7c8447-67b8-47a8-a5ff-49f665a39aa5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.350468 Oct 04 18:29:59.933867 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3098/6300] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:29:59 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.175611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.176768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.225586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.226194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.226915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.227441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.230548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.231338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.494395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:00.513984 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fafb16b-dd42-46ae-977a-fa5df5ad3454 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1562 microversion: 2.1 time: 0.338027 Oct 04 18:30:00.514946 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3203/6301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1562 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.543849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.544770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.558826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.563538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.563538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.564414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.565815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.568004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.834790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:00.852383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-999783e2-e847-4052-8334-17373edfcc04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1562 microversion: 2.1 time: 0.313899 Oct 04 18:30:00.853600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3099/6302] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1562 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:00.959349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:00.961245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:00.973136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.974097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.975031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:00.977142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:00.978301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:00.979774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:01.268234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:01.283718 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1cc75b0b-eda3-4ecb-9eed-eb0163e22346 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.332248 Oct 04 18:30:01.284320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3204/6303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:00 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:02.310798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:02.311507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:02.337588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.342475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.343135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.343974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:02.344511 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:02.345011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:02.677029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:02.707192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-323f8c18-94f3-4490-84ce-1244c6415270 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.401584 Oct 04 18:30:02.724652 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3100/6304] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:02 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:03.737128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:03.740638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:03.774458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.779860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.782544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:03.786617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:03.791053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:03.792258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.091775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:04.123010 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aad950b0-b6a3-41a6-ba1f-f22ede5bad5a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.390728 Oct 04 18:30:04.123650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3205/6305] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:03 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:04.212851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6", "name": "network-vif-plugged", "status": "completed", "tag": "ce0b8404-2832-4158-9723-262bb1dd9681"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:04.231332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.231825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.232267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.276418 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] Creating event network-vif-plugged:ce0b8404-2832-4158-9723-262bb1dd9681 for instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 on n-h2-831194-21 Oct 04 18:30:04.289802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4edba142-b2cb-46c3-9422-eb3e91f8d0eb req-1c5a35af-a577-4275-a677-06decb430971 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079412 Oct 04 18:30:04.291946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3101/6306] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:04.388525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:04.389615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:04.408503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.409955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.411516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.412642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.413232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:04.414611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.417321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.449849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:04.452075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:04.452547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:04.503822 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] Creating event network-changed:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h2-831194-21 Oct 04 18:30:04.526235 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-45cbd54d-d1ec-486f-bbac-6f87bbfbf88c req-80891ce1-8449-49be-bbc7-32924b4a9feb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114509 Oct 04 18:30:04.530282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3102/6307] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:05.074216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.109424 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d577a70c-366a-44dd-b1a4-db5762f4a255 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1562 microversion: 2.1 time: 0.728434 Oct 04 18:30:05.110455 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3206/6308] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:04 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1562 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:05.151021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:05.151692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:05.170659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.173537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.174219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.176361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:05.177635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:05.179743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:05.564834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:05.581125 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c9905770-effd-4824-838f-a63792b34b8d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.436704 Oct 04 18:30:05.584091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3103/6309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:05 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:06.615465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:06.616849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:06.639691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.640308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.640674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.641413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:06.641904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:06.642546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:06.999039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:07.010164 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b415b1f-9870-4bb1-8172-4bc0aa000ad9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1376 microversion: 2.1 time: 0.401392 Oct 04 18:30:07.011371 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3207/6310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:06 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1376 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.045163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.045963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.059566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.061239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.066474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.070539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.071285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.073014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.400785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.413921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58c05029-7b4c-4517-a01a-6c9a911e7e37 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1562 microversion: 2.1 time: 0.381203 Oct 04 18:30:08.415202 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3104/6311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1562 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.437161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.438473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.447340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.448052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.448730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.449629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.450348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.450940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.669619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:08.678897 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00d01c4b-5bd7-4d6f-8249-873cfed11b61 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1562 microversion: 2.1 time: 0.245486 Oct 04 18:30:08.679505 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3208/6312] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1562 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:08.780711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.781321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.789054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.789555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.790075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.790787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.791244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.791877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.823259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:08.922609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3d02b6a-cbef-4205-9254-90efea1ef248 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 204 len: 0 microversion: 2.1 time: 0.152575 Oct 04 18:30:08.924199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3105/6313] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:08 2022] DELETE /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:08.933515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:08.934181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:08.941252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.941958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.942572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:08.943455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:08.944656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:08.945516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:09.089129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:09.110064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5c38c4e9-62ce-4876-80fb-7acf8f0f54fb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1568 microversion: 2.1 time: 0.171265 Oct 04 18:30:09.118421 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3209/6314] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:08 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:10.136303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:10.137018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:10.149536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.150065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.150507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.151223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:10.151678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:10.152103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:10.703933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:10.715805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a74f215-4b06-4ab6-ae1b-3f0f91c4bccf tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1568 microversion: 2.1 time: 0.583441 Oct 04 18:30:10.716839 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3106/6315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:10 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1568 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:11.725912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6", "name": "network-vif-deleted", "tag": "ce0b8404-2832-4158-9723-262bb1dd9681"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:11.743278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:11.744723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:11.754035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.755732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.757045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.758477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.759159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.759904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:11.760520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:11.760794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.762205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:11.793990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] Creating event network-vif-deleted:ce0b8404-2832-4158-9723-262bb1dd9681 for instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 on n-h2-831194-21 Oct 04 18:30:11.805976 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e8afdbd5-9b34-44df-873c-a41a811c6759 req-c9705249-d8f9-48ab-8782-c8224aefc733 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084985 Oct 04 18:30:11.807134 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3210/6316] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:11.924087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:11.938609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd029140-53ef-477b-8f59-af66a32e18f1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1361 microversion: 2.1 time: 0.200512 Oct 04 18:30:11.948046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3107/6317] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:11 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:12.976547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:12.978162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:12.986792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.988016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.988675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:12.989893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:12.991612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:12.992485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:13.080689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:13.091867 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f051270-4595-4052-beaa-51a60be610ef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1361 microversion: 2.1 time: 0.122567 Oct 04 18:30:13.107788 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3211/6318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:12 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1361 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:14.119063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:14.119687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:14.133645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.134358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.135008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.135925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:14.136584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:14.137217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:14.240232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:14.254426 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec174638-f60b-4239-bd8f-21bc6c7acbac tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1361 microversion: 2.1 time: 0.140076 Oct 04 18:30:14.257891 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3108/6319] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:14 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1361 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:15.283885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:15.285211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:15.295923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.296679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.298443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.299464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:15.300179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:15.300842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:15.509536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:15.527566 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10914273-a7fd-4384-92cd-2a6a3c750304 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1361 microversion: 2.1 time: 0.247363 Oct 04 18:30:15.541935 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3212/6320] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:15 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:16.561581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:16.564755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:16.577783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.578520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.579164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.580231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:16.580853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:16.581472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:16.714603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:16.729678 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b685f6b-2bbc-4b30-8ae8-b3d3f4a068da tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 200 len: 1361 microversion: 2.1 time: 0.181312 Oct 04 18:30:16.731036 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3109/6321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:16 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:17.754369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:17.755168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:17.766617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.767937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.768559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.772631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:17.778282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:17.779740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:17.799851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 HTTP/1.1 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6'} Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:17.802950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:17.810641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16c86726-06be-467b-a964-e460d3d3532f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 404 len: 111 microversion: 2.1 time: 0.054405 Oct 04 18:30:17.817771 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3213/6322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:17 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:24.414084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.415420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.420684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:24.424642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.425573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.426293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.427223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.428110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.428836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.461813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:24.570220 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7267a616-cbde-479e-a1c9-fc2f75498c89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 204 len: 0 microversion: 2.1 time: 0.159246 Oct 04 18:30:24.570865 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3110/6323] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:24 2022] DELETE /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:24.579433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:24.579995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:24.583499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=38 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:24.593563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.595017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.595681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.596661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:24.597546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:24.599996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:24.620230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:24.844692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:24.854576 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-390825a2-bd7a-412c-80e2-3712c31444b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1408 microversion: 2.1 time: 0.279252 Oct 04 18:30:24.866015 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3214/6324] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:24 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:25.668190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:25.674763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.687387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.688731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.689411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.690688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.692619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.693541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.776160 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e85e427-8f57-4e7a-92ec-109d677c2b1b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action" status: 200 len: 24567 microversion: 2.1 time: 0.116183 Oct 04 18:30:25.782569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3111/6325] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:25 2022] POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action => generated 24567 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:30:25.879194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:25.881085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:25.889414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.890206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.890804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:25.891768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:25.892394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:25.892989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:26.098358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:26.111833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59b3521e-5c5a-4c24-b79a-f76c8131613a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1408 microversion: 2.1 time: 0.236760 Oct 04 18:30:26.112725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3215/6326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:25 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:27.141524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.142276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.155184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.155681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.156123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.156830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.157287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.158116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.610847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.614015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.627323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.628237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.629140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.630180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.631526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.632164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.671019 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac9f30cf-43b3-42ad-9560-2f2c8b0855e9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/ips" status: 200 len: 149 microversion: 2.1 time: 0.067415 Oct 04 18:30:27.672085 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3216/6327] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/ips => generated 149 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:27.675430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:27.707790 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ff69dd1-7777-45f2-8093-ce032e19583f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1408 microversion: 2.1 time: 0.568379 Oct 04 18:30:27.715104 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3112/6328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:27 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1408 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:27.728279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:27.733659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.745554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.746318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.747143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.748183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.748796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.749404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.912108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:27.919163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/os-volume_attachments HTTP/1.1 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 74 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: {"volumeAttachment": {"volumeId": "d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9"}} Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': 'fedcbcff-2ee9-411d-a907-18a780ca6391', 'body': {'volumeAttachment': {'volumeId': 'd040b317-e0ce-4f58-83e7-fe8e7a0cbfe9'}}} Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:27.920963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 400 to user: Invalid volume: volume d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 is already attached to instances: dcd44d48-a5ed-4ddf-ad5c-544549654be1 {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53e2c604-c2d4-416f-8738-60d4ac6ff7f0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.205879 Oct 04 18:30:27.929443 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3113/6329] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:30:27 2022] POST /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391/os-volume_attachments => generated 174 bytes in 207 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:30:27.949023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:27.949542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:27.974405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.974926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.975378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.976091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:27.977187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:27.977934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:27.979152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1839c8d-ed82-434b-a1ca-2109c00502b8", "name": "network-vif-deleted", "tag": "3bf5544a-81fd-4f18-98db-a56b5daec34a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:28.002645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.006872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.007544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.050616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:28.066496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] Creating event network-vif-deleted:3bf5544a-81fd-4f18-98db-a56b5daec34a for instance e1839c8d-ed82-434b-a1ca-2109c00502b8 on n-h1-831194-21 Oct 04 18:30:28.095457 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a0890f97-2d96-4e31-a978-23197f559539 req-216f1724-748f-46f8-945b-80c593327a64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.421770 Oct 04 18:30:28.099648 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3217/6330] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:28.274228 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0fe5a18c-a965-4023-b311-4a180fcbf41e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 204 len: 0 microversion: 2.1 time: 0.334394 Oct 04 18:30:28.275796 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3114/6331] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:27 2022] DELETE /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:28.292043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.293308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.311929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.336988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.337659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.338636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.339257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.340129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.599985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.614945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33de90f5-946f-4d78-8aed-9307203d6f32 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1681 microversion: 2.1 time: 0.331733 Oct 04 18:30:28.622639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3218/6332] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1681 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:28.742009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:28.742735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:28.753464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.754001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.766970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.768062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:28.768910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:28.769553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:28.903868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:28.916350 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef40b10d-9c37-481a-81b1-a964719e5394 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1200 microversion: 2.1 time: 0.177334 Oct 04 18:30:28.919528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3115/6333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:28 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1200 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.650754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.651631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.659695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.660578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.661113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.662119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.662767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.663285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.890200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:29.904026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36a66b8d-273e-4b9e-87a9-156882803fb2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1681 microversion: 2.1 time: 0.258835 Oct 04 18:30:29.904897 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3219/6334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:29.941963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:29.945362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:29.953574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.954323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.954920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:29.955787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:29.956667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:29.957248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.111498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:30.123498 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9fc2dcf3-a804-408d-9c5e-28c1f46afa88 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1200 microversion: 2.1 time: 0.185044 Oct 04 18:30:30.125383 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3116/6335] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:29 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1200 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:30.932574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:30.934570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:30.949613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.950278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.950836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:30.951776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:30.953339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:30.954554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.060639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.076196 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13550f57-8c94-435d-bab5-026cbd9a315f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1613 microversion: 2.1 time: 0.150112 Oct 04 18:30:31.079100 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3220/6336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:30 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1613 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:31.146975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:31.148293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:31.156140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.156923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.157630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.159199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.159908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.160563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.278549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:31.291638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-361c688d-48ec-4f17-a06c-49149c712664 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1200 microversion: 2.1 time: 0.148510 Oct 04 18:30:31.292671 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3117/6337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:31 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1200 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:31.728354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedcbcff-2ee9-411d-a907-18a780ca6391", "name": "network-vif-deleted", "tag": "21c9ce15-3434-4b70-9cc3-69445ee582cf"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:31.776023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:31.784309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:31.785490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:31.803056 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] Creating event network-vif-deleted:21c9ce15-3434-4b70-9cc3-69445ee582cf for instance fedcbcff-2ee9-411d-a907-18a780ca6391 on n-h1-831194-21 Oct 04 18:30:31.814619 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-35e35f81-2e7a-4617-98ca-7a9bc69ec055 req-fa393c30-3763-4e2d-8806-38042ea43a4a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095157 Oct 04 18:30:31.815844 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3221/6338] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:32.102179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.103060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.117282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.118073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.118955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.119944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.120742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.121501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.172732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.175509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.180658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.181569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'fault' on Instance uuid fedcbcff-2ee9-411d-a907-18a780ca6391 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:32.186450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.189786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.213694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.214538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.215248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.216232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.217037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.217707 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.265243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.277151 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b037b1a6-25da-4c4f-b6f3-4520a5389326 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 200 len: 1331 microversion: 2.1 time: 0.177955 Oct 04 18:30:32.278408 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3118/6339] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 1331 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:32.322619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.324210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.347168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.347704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.348157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.351108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.351612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.352061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.492199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:32.509029 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12d1adcc-cfe7-48b4-93f5-22114337d752 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1200 microversion: 2.1 time: 0.194333 Oct 04 18:30:32.510493 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3119/6340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1200 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:32.722904 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-58175226-2b8d-40c9-a3f0-a6ebc3a0aba0 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1833 microversion: 2.1 time: 0.548425 Oct 04 18:30:32.731166 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3222/6341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1833 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:32.754627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:32.755934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:32.762522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.763026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.763475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:32.764383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:32.765027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:32.765674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.151467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.166934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4d2ec657-d13a-4b01-9ca8-064e6b0e63bc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1680 microversion: 2.1 time: 0.416061 Oct 04 18:30:33.182550 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3120/6342] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:32 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1680 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:33.307334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:33.310797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:33.313126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.319519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.345778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.361568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.362755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.363434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.364362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.365692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.368674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.369433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.373516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.374131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.374969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.375785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.410103 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 HTTP/1.1 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'fedcbcff-2ee9-411d-a907-18a780ca6391'} Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:33.412352 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:33.416427 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e4fa17a-ed68-4cb8-9ae3-fcf40c6eefad tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 404 len: 111 microversion: 2.1 time: 0.110659 Oct 04 18:30:33.428656 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3121/6343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:33 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:33.437662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7046db83-bcc2-47aa-9d0c-9a692387ef59 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '.version_select at 0x7fbdc1d57ee0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:33.480567 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7046db83-bcc2-47aa-9d0c-9a692387ef59 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1151118449" status: 202 len: 0 microversion: 2.1 time: 0.052243 Oct 04 18:30:33.481167 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3122/6344] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1151118449 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:33.516293 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-95a09e05-a179-4d86-8e28-270d95a9f84e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action" status: 200 len: 32642 microversion: 2.1 time: 0.217171 Oct 04 18:30:33.524749 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3223/6345] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:33 2022] POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action => generated 32642 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:30:33.540297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:33.541490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.561648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.562193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.562638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.563364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.563823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.578020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.694677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.718813 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-954b03f7-3a98-4c8c-be0d-e2ac173187e5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1200 microversion: 2.1 time: 0.184180 Oct 04 18:30:33.726084 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3123/6346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:33 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1200 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:33.737505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:33.738372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:33.752798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.753318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.753779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.755308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:33.756522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:33.762118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:33.911169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5f44ed6c246a44499833bef79de6fcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aac0c951034c9992c994cfaa89d910', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:33.913161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] flavor_id is None. Assuming migration. {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:30:33.913641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:30:34.387466 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2aa9f8db-b89e-4207-8c47-103e8e4a76d8 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action" status: 202 len: 0 microversion: 2.1 time: 0.654015 Oct 04 18:30:34.392913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3224/6347] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:30:33 2022] POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action => generated 0 bytes in 661 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:34.400012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.400654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.423821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.427185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.427938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.428722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.429209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.429648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.700326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.702084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.711296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.712074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.712957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.714270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.715000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.715639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.869879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'services' on Instance uuid dcd44d48-a5ed-4ddf-ad5c-544549654be1 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:34.889642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:34.898559 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-909f6264-7c49-443b-a868-8c4b3daf988c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1689 microversion: 2.1 time: 0.504696 Oct 04 18:30:34.905634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3124/6348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1689 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:34.910608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:34.918309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:34.932233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.934283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.934745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.936326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:34.936807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:34.937249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:34.999224 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-31dc0407-6d8b-4b87-a44d-6c4e0bdb0518 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments/d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9" status: 202 len: 0 microversion: 2.1 time: 0.306293 Oct 04 18:30:35.000581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3225/6349] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:30:34 2022] DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments/d040b317-e0ce-4f58-83e7-fe8e7a0cbfe9 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:35.010340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.012790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.026584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.027395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.028065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.030376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lazy-loading 'fault' on Instance uuid e1839c8d-ed82-434b-a1ca-2109c00502b8 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:35.030949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.031462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.032443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.033391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.035221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.037653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.127295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:35.139195 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-329a9596-fd43-4371-bce3-3f857e15688f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132782 Oct 04 18:30:35.140206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a50b540b-8806-4717-8a2d-3d1ab0132889 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 200 len: 1205 microversion: 2.1 time: 0.232431 Oct 04 18:30:35.141440 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3125/6350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:34 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 1205 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:35.160907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3226/6351] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:35.923318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:35.924083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:35.936981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.937490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.937964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:35.938686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:35.939144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:35.939576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.165555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:36.168851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:36.185515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.186170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.186733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.188488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.195462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.196293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.222767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 HTTP/1.1 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e1839c8d-ed82-434b-a1ca-2109c00502b8'} Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:36.224627 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:36.229575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:36.235431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:36.242865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-078b39ae-21d0-47fb-b520-fd84cef8b84f tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 404 len: 111 microversion: 2.1 time: 0.075379 Oct 04 18:30:36.245766 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3227/6352] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:36 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:36.269669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:36.276938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:36.288235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.296627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.302641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.305025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:36.305815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:36.306301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:36.354144 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-729aae3e-50b3-4f2e-9455-4aba57f4f2df tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.104950 Oct 04 18:30:36.356724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3228/6353] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:36 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:36.407708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:36.420981 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfa3cff0-30f8-45e8-bc45-55a9ccf82ab0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1689 microversion: 2.1 time: 0.501493 Oct 04 18:30:36.423629 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3126/6354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:35 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1689 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:37.372595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.376454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.394544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.396099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.396991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.398320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.399148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.399794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.460356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:37.461580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:37.475309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.475830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.476287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.499120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:37.504202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:37.505470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:37.521688 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-033f7f1f-c730-4ae2-b810-5d3736e6adf7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155073 Oct 04 18:30:37.542313 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3229/6355] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:37.851401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:37.860986 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-93a849b0-2a0b-4396-909d-084b45239005 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1689 microversion: 2.1 time: 0.405349 Oct 04 18:30:37.862044 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3127/6356] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:37 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1689 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:38.534088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.536378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.543931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.544724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.545340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.546444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.547080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.547683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.688846 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b32f091d-b40c-4589-8248-f31dd4e9284b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.158443 Oct 04 18:30:38.707275 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3230/6357] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:38.893045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:38.895098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:38.907255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.907986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.908603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:38.909580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:38.912628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:38.913902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.251541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:39.261443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-038b7984-2538-4c9e-a1a1-3dcdae8a571a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.373844 Oct 04 18:30:39.264336 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3128/6358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:38 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:39.720188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.723174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.742283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.742799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.743251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.743977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.744446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.744891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.759872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:39.811403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.812332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.822161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.822915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.823528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.824406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.825012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.825587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.841918 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-598f5465-13bc-4154-a6e2-505e5d8310a1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126820 Oct 04 18:30:39.842777 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3231/6359] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:39.852870 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 HTTP/1.1 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6'} Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:39.856058 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-031c59f7-8fa2-4f17-b1a5-453f569ffb75 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 404 len: 111 microversion: 2.1 time: 0.051957 Oct 04 18:30:39.864691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3129/6360] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:39 2022] DELETE /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:30:39.872123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:39.872950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:39.881789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.882520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.883331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.884244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:39.884888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:39.885521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:39.915662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 HTTP/1.1 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6'} Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:39.919485 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. Oct 04 18:30:39.923947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:39.925352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:39.926508 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc0d8533-0fb5-4838-a4df-14cf7a4d30b4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6" status: 404 len: 111 microversion: 2.1 time: 0.059203 Oct 04 18:30:39.928348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3232/6361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:39 2022] GET /compute/v2.1/servers/a5a76e3c-620e-4a27-b8e5-7b9b8709ccd6 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:40.301972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.306026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.326166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.327943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.329651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.330971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.332311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.333862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.375863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:40.791336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.792451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.804614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.805348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.806058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.806985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.807666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.808452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.834138 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 HTTP/1.1 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e1839c8d-ed82-434b-a1ca-2109c00502b8'} Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:40.836021 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.840248 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.841669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:40.842843 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70152463-64e1-4ea2-9144-d52e9e1c61a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 404 len: 111 microversion: 2.1 time: 0.057214 Oct 04 18:30:40.843922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3233/6362] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:40 2022] DELETE /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:40.857473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.858153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: e1839c8d-ed82-434b-a1ca-2109c00502b8] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.878027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.878444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.879096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.880049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.880747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.881377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.909273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 HTTP/1.1 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e1839c8d-ed82-434b-a1ca-2109c00502b8'} Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:40.911674 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. Oct 04 18:30:40.916685 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:40.918240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance e1839c8d-ed82-434b-a1ca-2109c00502b8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:40.919267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4bb7d27-faba-4eb0-b558-0c4bc0772c0e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8" status: 404 len: 111 microversion: 2.1 time: 0.071129 Oct 04 18:30:40.923498 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3234/6363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/e1839c8d-ed82-434b-a1ca-2109c00502b8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:40.930784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:40.933079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:40.939934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.940447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.940903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:40.941693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:40.942253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:40.943307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:41.012443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ba9ce029-d93c-4faf-8c29-d19c9be1a5e2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085700 Oct 04 18:30:41.015452 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3235/6364] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:41.089359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-087ae3c7-b558-47f5-8d7b-18a443e3553b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: .version_select at 0x7fbdbd3adc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-268794580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNP0clL/vQOJD5bSodoo9Ym1dEPpZGq8+Ic4NAYFjImPrpMsLQ3QDT6MPRWeCFLsW1YAnZX30bX37GOnTsrioMu/ybyBRPaYu5j+RdNVBCP/awEd525pDPIcr+EQpla7iw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:41.120465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-087ae3c7-b558-47f5-8d7b-18a443e3553b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:41.127542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-087ae3c7-b558-47f5-8d7b-18a443e3553b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:41.163061 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-087ae3c7-b558-47f5-8d7b-18a443e3553b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.087181 Oct 04 18:30:41.164413 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3236/6365] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:30:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:41.184980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:41.199265 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-41a30f0e-933c-45d7-8f85-188230ddc391 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.900901 Oct 04 18:30:41.200013 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3130/6366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:40 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:42.036981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.041294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.074858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.075469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.084899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.085801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.086582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.086770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.187611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1515d2a8-9c34-4b94-9c6f-ed8651b9dd8e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162093 Oct 04 18:30:42.188882 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3237/6367] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:42.229014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:42.229695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:42.245457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.249345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.249848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.250609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:42.256410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:42.256941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:42.583813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:42.595168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-edc0759c-212f-454e-a0c0-1ef0acdbb928 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.370484 Oct 04 18:30:42.596286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3131/6368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:42 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:43.204625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.211060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.229774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.231054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.231825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.233611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.234550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.235819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.279623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5eee2518-54c0-4e6d-8ba5-ee00d53c25a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082972 Oct 04 18:30:43.280647 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3238/6369] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:30:43.362431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.364686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.374019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.374991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.375499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.376473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.377463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.378163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.420024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:30:43.542663 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4381be28-cf86-46c7-9cf7-fb0fcee93575 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 204 len: 0 microversion: 2.1 time: 0.183189 Oct 04 18:30:43.544321 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3132/6370] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:30:43 2022] DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:30:43.552837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.553478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.559865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.560378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.560822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.561885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.562533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.563936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.630255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:43.633809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:43.642393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.642889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.643548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.646718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:43.647310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:43.647851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:43.876164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.905369 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc0f7860-a097-49fe-b8a9-7a40d3719666 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.282640 Oct 04 18:30:43.906247 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3133/6371] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:43.911020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:43.922543 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aff13277-727e-4b29-bd59-ea5444f3b18f tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1680 microversion: 2.1 time: 0.373977 Oct 04 18:30:43.938435 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3239/6372] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:43 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1680 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:44.933942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.934692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.949203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:44.949736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.949895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:44.953012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.953763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.954643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.955234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.956457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.963441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.966310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.967754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:44.971066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:44.974324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:44.974932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:45.316627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.333796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0966103c-dfe7-4de7-92c2-29721a5a60c9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1680 microversion: 2.1 time: 0.388983 Oct 04 18:30:45.348007 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3240/6373] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1680 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:45.560645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:45.573938 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e33db2e-dd8b-47c4-b35b-2cd42f91cc40 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.643136 Oct 04 18:30:45.574563 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3134/6374] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:44 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:46.361419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.362902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.388896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.389916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.390602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.392185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.392968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.393848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.594954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:46.600688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:46.601316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:46.607053 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9aad1eae-bf31-435b-b695-ea14005a3872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1613 microversion: 2.1 time: 0.250450 Oct 04 18:30:46.636853 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3241/6375] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1613 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:46.639155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.639656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.640133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.640866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.641322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.641749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.963618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd44d48-a5ed-4ddf-ad5c-544549654be1", "name": "network-vif-deleted", "tag": "f865cc9d-94bc-469f-8df1-d3bfc72ef134"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:46.977241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:46.977755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:46.978299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:46.991662 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] Creating event network-vif-deleted:f865cc9d-94bc-469f-8df1-d3bfc72ef134 for instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 on n-h2-831194-21 Oct 04 18:30:46.998041 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3394d3ca-6c76-4f87-add5-d5130977f489 req-c8c4c484-a0d4-4fbb-87d4-6a02c7216f4b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047709 Oct 04 18:30:47.003394 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3242/6376] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:30:47.119382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.137117 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14435d37-e641-4a21-8af5-ff56d22a7ff7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.536963 Oct 04 18:30:47.138404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3135/6377] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:46 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:30:47.652090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:47.654623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:47.684320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.685848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.687336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.703320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.706009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.709077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.835111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:47.842386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:47.842880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:47.843771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'fault' on Instance uuid dcd44d48-a5ed-4ddf-ad5c-544549654be1 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:30:47.968011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:47.980721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9235b17-5e12-4550-870e-f3546d00a13d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 200 len: 1332 microversion: 2.1 time: 0.342488 Oct 04 18:30:47.987072 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3243/6378] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:47 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 1332 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:48.168253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:48.169488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:48.186621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.187701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.188595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.189950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:48.190595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:48.191435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:48.681969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:48.690697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da9f9146-d9e6-4ae7-857f-db8508c11b5c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.529721 Oct 04 18:30:48.691217 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3136/6379] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:48 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:49.023616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.024367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.046089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.046633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.047454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.048379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.048870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.049326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.068656 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 HTTP/1.1 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'dcd44d48-a5ed-4ddf-ad5c-544549654be1'} Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:30:49.071074 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:30:49.075844 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:30:49.078222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:30:49.079711 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4bcdad55-d607-41e4-9050-b3b9a6acbda6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 404 len: 111 microversion: 2.1 time: 0.060556 Oct 04 18:30:49.094766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a755fe71-d240-4315-ba51-5d0bbfc0cd73 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '.version_select at 0x7fbdc1c649d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.101487 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3244/6380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:30:49.148805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a755fe71-d240-4315-ba51-5d0bbfc0cd73 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721873067" status: 202 len: 0 microversion: 2.1 time: 0.060394 Oct 04 18:30:49.153159 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3137/6381] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:30:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721873067 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:30:49.719775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:49.721266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:49.752740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.754065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.756436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:49.758122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:49.762221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:49.763308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:50.028817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:50.039595 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad66fe89-1d8b-4754-8aca-7f1597c79528 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.325318 Oct 04 18:30:50.051209 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3245/6382] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:49 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:50.420742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba2d8a94-2486-43ed-9100-105c50b373cc tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: .version_select at 0x7fbdc1d73550>, body: {"keypair": {"name": "tempest-keypair-126438501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJJLdEF1hzepaO7iZVOiaOBjqQLDn49d+ga14+TMtLqUVF3YNYQl9jKCT1rRkAhwom8RWQFrGhmjZk/bRX36moowDDGWFU6RHtwIJSQcOnCefezICgTTG2B2wzl2YKHXhQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:50.445222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ba2d8a94-2486-43ed-9100-105c50b373cc tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:50.452468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ba2d8a94-2486-43ed-9100-105c50b373cc tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:50.488159 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba2d8a94-2486-43ed-9100-105c50b373cc tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072366 Oct 04 18:30:50.494206 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3138/6383] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:30:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:51.087990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:51.090275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:51.110088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.110885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.111769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.115167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:51.116050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:51.116702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:51.154787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:51.350940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:51.364578 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-714350ac-be1a-4ecb-af77-1c3de8bd2752 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.290018 Oct 04 18:30:51.365447 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3246/6384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:51 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:52.392898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:52.393525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:52.404007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.407444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.409873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.411142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:52.411856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:52.412489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:52.708042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:52.743869 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-909de786-bb75-4ed8-971c-e93ae211a656 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.353425 Oct 04 18:30:52.745797 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3139/6385] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:52 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:53.020288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1290949397", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e80190d-6f7c-4a36-acb4-292d1b415902"}], "security_groups": [{"name": "tempest-securitygroup--1762029259"}], "key_name": "tempest-keypair-126438501", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:53.198446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] validate_networks() for [('6e80190d-6f7c-4a36-acb4-292d1b415902', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:30:53.768874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:53.769497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:53.793722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.794184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.794641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:53.795341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:53.795801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:53.796228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.064382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.109246 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e3ae1fd4-ded8-4411-b80b-cf9491fa6805 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.317233 Oct 04 18:30:54.110311 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3140/6386] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:53 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:54.332924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:30:54.333512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:30:54.334044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:30:54.334472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:30:54.335107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:30:54.348433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.348944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.349396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.355126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:54.356090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:54.356550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:54.385292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:30:54.391089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:30:54.407319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:30:54.410094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:30:54.469665 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc0c1a4c-4b65-45a6-8ba7-5b843094205d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.453593 Oct 04 18:30:54.470804 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3247/6387] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:30:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:30:54.482316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fb60c435-1405-449f-b4cd-4c6891010872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:54.483030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fb60c435-1405-449f-b4cd-4c6891010872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:54.501633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:54.618178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fb60c435-1405-449f-b4cd-4c6891010872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:54.631768 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fb60c435-1405-449f-b4cd-4c6891010872 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1241 microversion: 2.1 time: 0.151255 Oct 04 18:30:54.638661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3141/6388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:54 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1241 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.149528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.150552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.159264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:30:55.162441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.163253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.164262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.165361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.166584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.167473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.413117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.424479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c7c7060-2e3a-4c27-a0e2-eaa5df8018f7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1694 microversion: 2.1 time: 0.281029 Oct 04 18:30:55.430165 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3248/6389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1694 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:55.665036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:55.666198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:55.703125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.709205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.711842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.713008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:55.713683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:55.714339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:55.850709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:55.860784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b82ffdee-373c-4afa-b808-053ec9c54bac tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1293 microversion: 2.1 time: 0.204025 Oct 04 18:30:55.875065 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3142/6390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:55 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1293 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:56.454097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.455424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.473362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.475744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.476637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.480746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.481642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.482418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.892718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:56.899335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:56.932073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.933151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.933893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:56.934865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:56.935862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:56.936454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:57.110210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.122113 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-654f3a2c-661d-48c0-800a-7251f4088484 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1693 microversion: 2.1 time: 0.672737 Oct 04 18:30:57.124566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3249/6391] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1693 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:57.182966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:57.196718 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-69137daa-f321-4cb7-9aa5-0654b1e872d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1299 microversion: 2.1 time: 0.313105 Oct 04 18:30:57.197336 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3143/6392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:56 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1299 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:58.168737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.171644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.185877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.186706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.187347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.188557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.189271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.192100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.225663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:58.234049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:58.256485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.258575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.259653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.260441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.260912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.261602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.610583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:58.632278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7ed3a109-c242-4a59-8654-8fc356c321a6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1693 microversion: 2.1 time: 0.484118 Oct 04 18:30:58.636918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3250/6393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1693 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:30:58.649434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "name": "network-vif-unplugged", "status": "completed", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:30:58.690072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:58.690590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:58.691164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:58.706581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Creating event network-vif-unplugged:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h1-831194-21 Oct 04 18:30:58.715452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:30:58.731101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dc089543-8e43-410d-a75f-82de736bb0e1 req-2f63988d-2f84-45f2-997e-abacccffc786 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087240 Oct 04 18:30:58.732096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3251/6394] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:30:59.666978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:30:59.668605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:30:59.687630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.689695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.690379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.699532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:30:59.700340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:30:59.700984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:30:59.905570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:30:59.914699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-444656f9-2035-418d-a478-0742ad72abae tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 1.694999 Oct 04 18:30:59.915299 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3144/6395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:58 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:00.230475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:00.237248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:00.249550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e10a8127-b068-49b1-a4c7-8e816ef618e3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1693 microversion: 2.1 time: 0.589952 Oct 04 18:31:00.254175 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3252/6396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:30:59 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1693 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:00.852444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:00.888956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.889970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.890623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.908391 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Creating event network-changed:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h1-831194-21 Oct 04 18:31:00.918309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:31:00.933338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-4932b8ab-090d-4ded-96e5-1474f461f662 req-fe694d7f-be8e-4171-9992-a1c3eb2afa70 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086748 Oct 04 18:31:00.939150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3145/6397] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:00.942868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:00.944448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:00.959495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.960582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.962934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:00.964193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:00.965143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:00.965812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.277749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:01.279466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:01.302203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:01.677405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.694824 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5364cad1-8625-445f-82ab-1870df790d61 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1693 microversion: 2.1 time: 0.421222 Oct 04 18:31:01.704452 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3146/6398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:01 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1693 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:01.860183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:01.879741 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eaa21445-f6a3-4cfe-9d69-1275cf8ae678 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.943177 Oct 04 18:31:01.885260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3253/6399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:00 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:02.730464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.731672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.742546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.746825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.762909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.763705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.764246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.764624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.915227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:02.916611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:02.932624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.933452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.934200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:02.935175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:02.935984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:02.936678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.098377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:03.123839 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2134a557-1d98-494a-9d56-9af52570d125 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1691 microversion: 2.1 time: 0.397686 Oct 04 18:31:03.125130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3147/6400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1691 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:03.131373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83736f69-d32f-4398-acb4-801996fd9c46", "tag": "54520ac8-c452-40ce-a165-8ca46d052426"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:03.141697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:03.142527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:03.143195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:03.157131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] Creating event network-changed:54520ac8-c452-40ce-a165-8ca46d052426 for instance 83736f69-d32f-4398-acb4-801996fd9c46 on n-h1-831194-21 Oct 04 18:31:03.173236 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c205618c-6ed3-4348-a359-e509fb1d9063 req-68663d49-1e2d-41eb-a567-08246bb01b29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045869 Oct 04 18:31:03.175944 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3148/6401] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:03.240482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:03.261156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-610211bb-e84c-41a5-9c56-8c38598c5297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.349930 Oct 04 18:31:03.267451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3254/6402] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:02 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.155621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.156503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.170696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.176714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.178667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.180439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.181559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.184800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.232301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:04.292748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:04.301582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:04.329731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.333526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.334268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.337013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:04.337678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:04.338321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:04.385557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:04.404873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:04.476784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.489402 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3d015f05-010c-4165-8617-82e616831a04 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1691 microversion: 2.1 time: 0.338736 Oct 04 18:31:04.490773 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3149/6403] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1691 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:04.744886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:04.763967 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0028e0c-7bcf-4b85-b0f1-ed39f7e7ccee tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.476207 Oct 04 18:31:04.784450 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3255/6404] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:04 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:05.517951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.518576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.533023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:05.536393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.537214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.537890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.538790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.539404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.540008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.797354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:05.798746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:05.819198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.820175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.821459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:05.822561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:05.823520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:05.824184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.024204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.033606 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1294c964-33f8-434b-97c5-23c2ff780191 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.243826 Oct 04 18:31:06.061095 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3256/6405] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.533668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:06.549221 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99639c63-0b2a-4c5a-8a94-d849ef1fe701 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1688 microversion: 2.1 time: 1.035123 Oct 04 18:31:06.563804 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3150/6406] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:05 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1688 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:06.575690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:06.576567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.585199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.586085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.586782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.588442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.589138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.589796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.693616 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad96b7a2-14fc-4c25-bc87-9575cf5b1239 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action" status: 204 len: 0 microversion: 2.1 time: 0.121029 Oct 04 18:31:06.695002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3257/6407] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:06 2022] POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:06.722465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:06.729943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:06.767125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.770057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.770745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:06.772063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:06.772619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:06.774191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.087764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:07.093562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:07.115328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.116297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.118136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.120668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:07.134792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:07.136513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:07.160824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.169730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4180b6bc-94cc-4b78-8e4b-f5c55a064ae3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1688 microversion: 2.1 time: 0.470478 Oct 04 18:31:07.176751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3151/6408] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:06 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1688 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:07.510150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:07.533749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-687ae2e5-30c7-4f3c-a5e8-82af7a16c52d tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.453539 Oct 04 18:31:07.551088 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3258/6409] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:07 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.200161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.201399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.209097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.209595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.210058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.210969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.211593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.212020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.557304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:08.558617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:08.581021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.581942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.583375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.584292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.584925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.586138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.592862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.604980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b720dd7a-4e28-4d11-ac76-1fce60d7873f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1688 microversion: 2.1 time: 0.408569 Oct 04 18:31:08.610270 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3152/6410] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1688 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:08.676532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "name": "network-vif-plugged", "status": "completed", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:08.704231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:08.705033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:08.706262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:08.741752 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] Creating event network-vif-plugged:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h1-831194-21 Oct 04 18:31:08.754585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fd409cad-a69f-40fc-b7cb-0a773f4eba43 req-2bf48056-dfa5-4f0b-97b9-33871709a0c3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086464 Oct 04 18:31:08.771062 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3153/6411] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:08.843277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:08.855422 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6adc5ec3-8ffe-47d4-a4fb-4b42885da029 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.301958 Oct 04 18:31:08.872726 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3259/6412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:08 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:09.640783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.642199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.650162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.651188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.651579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.652144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.652761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.653086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.834124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:09.844123 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cce2b071-6780-4cc5-9f7b-8f6d1a819e9c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1680 microversion: 2.1 time: 0.208405 Oct 04 18:31:09.844993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3154/6413] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1680 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:09.885053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:09.885688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:09.904385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.905164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.905633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:09.906421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:09.906907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:09.907670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.432558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:10.443818 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8675caac-2b83-4a24-a47b-93f1c922af5b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.564187 Oct 04 18:31:10.445679 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3260/6414] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:09 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:10.812653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83736f69-d32f-4398-acb4-801996fd9c46", "name": "network-vif-plugged", "status": "completed", "tag": "54520ac8-c452-40ce-a165-8ca46d052426"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:10.823423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:10.823906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:10.824553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:10.837852 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] Creating event network-vif-plugged:54520ac8-c452-40ce-a165-8ca46d052426 for instance 83736f69-d32f-4398-acb4-801996fd9c46 on n-h1-831194-21 Oct 04 18:31:10.842958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a9b3fe64-f5f5-44d2-9151-061b20bb90e6 req-fb7cc005-4616-4166-9b69-48c4fb5b9a72 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033996 Oct 04 18:31:10.847736 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3155/6415] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:11.466526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:11.467654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:11.475680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.476304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.476837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.478007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:11.478631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:11.479176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:11.657608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:11.670270 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12ab9b04-f103-400f-9de8-10b45b07e39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1367 microversion: 2.1 time: 0.207455 Oct 04 18:31:11.686029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3261/6416] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:11 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:11.855591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-746840609", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-268794580", "security_groups": [{"name": "tempest-secgroup-smoke-1873706191"}], "block_device_mapping_v2": [{"uuid": "c6c43d83-e289-42f7-80b0-50d92bbb0ed7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:12.006447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:12.700023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.700665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.710316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.711007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.711684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.712751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.713691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.714338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.879549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:12.887951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e992a0ab-0337-45c4-92ec-784ba258af15 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1556 microversion: 2.1 time: 0.191863 Oct 04 18:31:12.888661 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3262/6417] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1556 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:12.914327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:12.914989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:12.921273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.921949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.922501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:12.923309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:12.923881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:12.924595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.023274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dfc657d3-b514-4fed-b7e2-f50a1fae7ae0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114908 Oct 04 18:31:13.024149 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3263/6418] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:31:12 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:13.206131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:13.208485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:13.209230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:13.210335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:13.211853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:13.235594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.238493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.239157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.239927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:13.240386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:13.244827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:13.288094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:13.301501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:13.405528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:13.408781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6c43d83-e289-42f7-80b0-50d92bbb0ed7',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:13.656648 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7c19960-f9dc-4916-a320-192e8a393895 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.806515 Oct 04 18:31:13.657571 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3156/6419] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:31:13.669074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d4d05eb-ae69-4e68-a86f-b19096fde6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:13.669715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d4d05eb-ae69-4e68-a86f-b19096fde6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:13.793786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d4d05eb-ae69-4e68-a86f-b19096fde6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:13.802572 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d4d05eb-ae69-4e68-a86f-b19096fde6d6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1093 microversion: 2.1 time: 0.137231 Oct 04 18:31:13.805445 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3264/6420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:13 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1093 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:14.797899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83736f69-d32f-4398-acb4-801996fd9c46", "tag": "54520ac8-c452-40ce-a165-8ca46d052426"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:14.822164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.822746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.823273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.836101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:14.838113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:14.848179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.849573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.850296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.851228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:14.852682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:14.853456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:14.860836 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] Creating event network-changed:54520ac8-c452-40ce-a165-8ca46d052426 for instance 83736f69-d32f-4398-acb4-801996fd9c46 on n-h1-831194-21 Oct 04 18:31:14.873581 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2bb3123b-8506-48e5-873c-78111b60119f req-446fd332-c70b-4154-9127-c8a4e0c7e525 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076830 Oct 04 18:31:14.878160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3157/6421] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:15.021636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:15.035556 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1e6273d-a50b-4475-9fa9-c40310790777 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1135 microversion: 2.1 time: 0.205789 Oct 04 18:31:15.036150 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3265/6422] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:14 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1135 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:16.064137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:16.064723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:16.087847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.088563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.090283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.091700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:16.092368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:16.092966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:16.381134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:16.389713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4479dde1-6a35-444e-a725-966c60cc5d02 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1209 microversion: 2.1 time: 0.330657 Oct 04 18:31:16.394692 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3158/6423] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:16 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1209 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:17.419311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:17.420523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:17.454264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.455269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.455944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.458205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:17.458906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:17.459559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:17.923297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:17.943500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e241ea6a-b08e-4cc5-b451-78105246c47e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1277 microversion: 2.1 time: 0.528284 Oct 04 18:31:17.944291 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3266/6424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:17 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1277 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:18.807205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d99db2f-707e-4592-b01c-95d7d92a4f4b", "tag": "d79c389d-9b55-4011-a367-7891dd6c8c54"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:18.828621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:18.829125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:18.829570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:18.854330 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] Creating event network-changed:d79c389d-9b55-4011-a367-7891dd6c8c54 for instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b on n-h2-831194-21 Oct 04 18:31:18.871795 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-51954f63-9893-43b7-8648-06f711d52f10 req-d98981be-1520-432e-bc20-bf66750295b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068324 Oct 04 18:31:18.872422 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3159/6425] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:18.979107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:18.979766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:19.010188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.010969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.011621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.012537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:19.013196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:19.013889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:19.293805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:19.309172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9b7a3fe-9c5e-466b-a1b9-3efc840c21b9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1277 microversion: 2.1 time: 0.338657 Oct 04 18:31:19.309800 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3267/6426] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:18 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1277 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:20.334452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:20.336202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:20.367827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.368750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.370504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.373109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:20.374929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:20.376875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:20.712482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:20.728532 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f656c6c4-923a-466e-809c-cd1ebe42677d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1277 microversion: 2.1 time: 0.399571 Oct 04 18:31:20.729407 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3160/6427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:20 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1277 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:21.756143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:21.757025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:21.770555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.773646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.775875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:21.778989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:21.781155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:21.782205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:22.167260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:22.180492 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b265018-f77d-4569-96ac-173c2d528238 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1277 microversion: 2.1 time: 0.429784 Oct 04 18:31:22.181264 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3268/6428] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:21 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1277 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:23.211482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:23.214515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:23.226180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.226849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.227623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.228679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:23.229277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:23.229818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:23.258461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:23.317064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:23.411476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:23.428531 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7e31462f-6bc8-41fa-9550-9191c3249be9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.226766 Oct 04 18:31:23.429728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3161/6429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:23 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:24.454099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:24.454786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:24.459062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:24.471766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.472315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.473167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.473975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:24.474581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:24.475599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:24.503490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:24.726308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:24.734269 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-57a21289-dce6-48b1-afba-4cadd9128458 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.285397 Oct 04 18:31:24.735119 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3269/6430] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:24 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:25.760302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:25.760951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:25.764003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:25.777930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.778375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.778823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:25.779590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:25.795343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:25.795852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:26.086160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:26.103920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d06d903a-fb20-47dc-b821-63153bdfa6ad tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.348110 Oct 04 18:31:26.114830 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3162/6431] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:25 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:27.139857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:27.141211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:27.144816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=46 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:27.155380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.161749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.162744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.163891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:27.164374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:27.164826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:27.449293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:27.460369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f92a9ec1-8259-4b11-a883-c44655e78ce7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.324306 Oct 04 18:31:27.475319 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3270/6432] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:27 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:28.489064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:28.490828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:28.502359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.503019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.503474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.504309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:28.504774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:28.505200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:28.844923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:28.862076 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e674372-db01-4e02-8724-ca415d818e33 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.377761 Oct 04 18:31:28.863838 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3163/6433] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:28 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:29.889938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:29.891122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:29.909571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.911228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.926227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:29.930095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:29.936946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:29.937464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:30.329404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:30.340519 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ced6e816-22d7-459c-9ce0-f6b98fee5767 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.455776 Oct 04 18:31:30.342672 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3271/6434] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:29 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:31.368146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:31.369858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:31.380306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.380968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.381474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.382302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:31.382812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:31.383402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:31.527916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:31.536453 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f4636a39-c802-4d61-b65a-bde6ec5f3f79 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.174868 Oct 04 18:31:31.537355 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3164/6435] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:31 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:32.563526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:32.564832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:32.577691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.579281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.579953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.580913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:32.581643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:32.584328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:32.795191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:32.808459 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b1d15c9-d138-4886-ba42-36ec19ef7446 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.250831 Oct 04 18:31:32.820659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3272/6436] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:32 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:33.835484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:33.836118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:33.845047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.845812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.846474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:33.847376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:33.848061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:33.848995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:34.185117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:34.193907 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ecdcb309-1ce3-4c69-80c4-1181500d94a8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.362736 Oct 04 18:31:34.194520 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3165/6437] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:33 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:35.220603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:35.223859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:35.234100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.234978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.235789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.237005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:35.237712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:35.239435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:35.709869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:35.721433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-efe1b65e-6046-4df6-87eb-94a17bcf631b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.504750 Oct 04 18:31:35.722729 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3273/6438] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:35 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:36.114493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d99db2f-707e-4592-b01c-95d7d92a4f4b", "name": "network-vif-plugged", "status": "completed", "tag": "d79c389d-9b55-4011-a367-7891dd6c8c54"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:36.127021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.127021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.127351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.133254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=80 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:36.145317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:36.148433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.167208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.167834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.169124 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] Creating event network-vif-plugged:d79c389d-9b55-4011-a367-7891dd6c8c54 for instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b on n-h2-831194-21 Oct 04 18:31:36.169819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.174049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.174793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.177877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.190546 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-986bbe13-d9b1-41b6-b53d-cc2698c8ed3e req-481a3ea7-38e0-4947-a361-86470cbb47cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.678771 Oct 04 18:31:36.192764 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3166/6439] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:36.262892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb2d042d-2a84-4f67-9571-55b7c0785a57 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action" status: 200 len: 24579 microversion: 2.1 time: 0.123969 Oct 04 18:31:36.264298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3274/6440] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:31:36 2022] POST /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5/action => generated 24579 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:31:36.750097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:36.750830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:36.768037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.768558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.769194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:36.770372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:36.771034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:36.771647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:37.138189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:37.148713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1bb5204-23b7-4244-8a82-00f1bc241891 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1265 microversion: 2.1 time: 0.403721 Oct 04 18:31:37.149347 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3167/6441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:36 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.181530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.187984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.203626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.204827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.205481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.207189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.208794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.209897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.498787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.509263 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f02d498f-b28f-42bd-bda7-205a6e0d0a42 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1451 microversion: 2.1 time: 0.340164 Oct 04 18:31:38.510641 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3275/6442] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1451 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:38.538847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:38.539567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:38.546954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.547536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.548275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.549109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:38.549628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:38.550170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:38.821773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:38.849753 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c0d6db0-05f2-4613-83b2-0d1af364d3e1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1451 microversion: 2.1 time: 0.316467 Oct 04 18:31:38.851199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3168/6443] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:38 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1451 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:40.680015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e2ef8e1-99a4-4c1f-84b6-fe74cfe906c9 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Action: 'create', calling method: .version_select at 0x7fbdbc71ab80>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1276788523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIP+cemYea7fuEruAL97MC1mo+V2Ujn/7xXGH73cLvbWVshJk/50EKFPh9fBiqi4faewibLnDOTaWTjWV1LpzmaoSfLMSNwtw/jCXinrw1CIuxaCL1/D1WAAj7kGu6EQAg=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:40.717204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-8e2ef8e1-99a4-4c1f-84b6-fe74cfe906c9 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:40.731563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-8e2ef8e1-99a4-4c1f-84b6-fe74cfe906c9 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for user 849445be07fc453fbb9706c1313b4535 and project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:40.801423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e2ef8e1-99a4-4c1f-84b6-fe74cfe906c9 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.460565 Oct 04 18:31:40.812747 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3276/6444] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:31:40 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:42.213589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d99db2f-707e-4592-b01c-95d7d92a4f4b", "tag": "d79c389d-9b55-4011-a367-7891dd6c8c54"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:42.230275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:42.231063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:42.231669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:42.244974 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] Creating event network-changed:d79c389d-9b55-4011-a367-7891dd6c8c54 for instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b on n-h2-831194-21 Oct 04 18:31:42.250939 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-13da19e7-e698-474d-a59c-48c15829afc1 req-914a2c25-01e5-4e1c-8781-9bdbfbf1660c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044795 Oct 04 18:31:42.252130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3169/6445] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:47.023192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:47.025002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:47.037230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.038378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.040892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.042685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:47.043931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:47.044605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:47.539635 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-acacb672-633a-4eb4-8eed-166759312cbe tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1833 microversion: 2.1 time: 0.521899 Oct 04 18:31:47.540802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3277/6446] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:47 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1833 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:50.317012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.318449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.343032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.344194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.346501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.346671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:50.347515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.348064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.349550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.368712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.369230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.369690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.431117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:31:50.432996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] Creating event network-changed:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h1-831194-21 Oct 04 18:31:50.453494 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8ff88f26-b6f6-42ff-a6bc-f6191f251190 req-bd297337-6fc2-407a-83d3-5243da1a75b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111519 Oct 04 18:31:50.457393 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3278/6447] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:31:50.699200 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e803c29c-33f9-47e4-87e1-264537001cb8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 204 len: 0 microversion: 2.1 time: 0.388430 Oct 04 18:31:50.705775 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3170/6448] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:31:50 2022] DELETE /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:31:50.718163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:50.720121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:50.741661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.742294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.742960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.744000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:50.744577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:50.745817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:50.831976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:50.862988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1113577359-access_point-384388080", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "479d9821-88c5-41df-9d62-7db7bd980bab"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1276788523", "security_groups": [{"name": "tempest-secgroup_access--755946591"}, {"name": "tempest-secgroup_general--1969540342"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:51.109163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:51.122845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75708b9c-7547-452f-a1c8-7040e3765788 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1686 microversion: 2.1 time: 0.416480 Oct 04 18:31:51.123466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3279/6449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:50 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1686 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:51.339697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] validate_networks() for [('479d9821-88c5-41df-9d62-7db7bd980bab', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:31:52.151667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.152495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.161258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.162167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.162818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.163105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:31:52.163708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:31:52.163854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.164214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.164668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:31:52.165055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.165190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:31:52.165508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:31:52.179250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.179802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.180354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.181516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:52.182037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:52.183046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:52.213323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:31:52.219910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for user 849445be07fc453fbb9706c1313b4535 and project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:31:52.238269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:31:52.242306 n-d-831194-21 devstack@n-api.service[128850]: WARNING nova.utils [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1113577359-access_point-384388080 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1113577359-ac Oct 04 18:31:52.244293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:31:52.336185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27b036e5-e41c-4aa0-bf49-825972126b5f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.476074 Oct 04 18:31:52.340130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3171/6450] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:31:50 2022] POST /compute/v2.1/servers => generated 457 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:31:52.353076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-186ab35a-71f1-4143-b63b-ab4c2f83aa87 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:52.354544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-186ab35a-71f1-4143-b63b-ab4c2f83aa87 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:52.391485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.401492 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a720bf83-ba6c-47d3-9ab9-7480611d3fa2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1686 microversion: 2.1 time: 0.256618 Oct 04 18:31:52.405079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3280/6451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1686 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:52.498863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-186ab35a-71f1-4143-b63b-ab4c2f83aa87 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:52.514873 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-186ab35a-71f1-4143-b63b-ab4c2f83aa87 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1294 microversion: 2.1 time: 0.169967 Oct 04 18:31:52.515475 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3172/6452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:52 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:53.430951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.431846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.451718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.452473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.453007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.454788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.454929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.455655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.537501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:53.538275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:53.548303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.549198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.549728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.550714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:53.551397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:53.552042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:53.657073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:53.668973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9963dc6c-e0e2-405e-8169-60fe75880ae9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1686 microversion: 2.1 time: 0.244198 Oct 04 18:31:53.669925 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3281/6453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1686 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:54.087289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.095364 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f327fa6-1e0d-4a7a-bd56-cb93984c5407 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1346 microversion: 2.1 time: 0.562422 Oct 04 18:31:54.096507 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3173/6454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:53 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1346 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:31:54.405036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b61889-46a4-46d9-97b0-eeae1402b0b5", "name": "network-vif-deleted", "tag": "8816d9d2-c218-46c1-9348-dc792ac8ff2f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:54.416047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.417170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.417790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.445390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] Creating event network-vif-deleted:8816d9d2-c218-46c1-9348-dc792ac8ff2f for instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 on n-h1-831194-21 Oct 04 18:31:54.455191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-31e1e15a-9982-47c1-b2e9-c184fec60b2b req-138a25b6-94cc-430d-aefc-412e90f9a51f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052632 Oct 04 18:31:54.456309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3282/6455] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:54.696188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:54.696836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:54.711665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.712182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.712635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.713385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.713820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.714277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.827726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:54.830007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:54.830649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:54.831381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lazy-loading 'fault' on Instance uuid 61b61889-46a4-46d9-97b0-eeae1402b0b5 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:31:54.903249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:54.913816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89029367-f8bd-4bcd-ae94-4aa2312f02f8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 200 len: 1355 microversion: 2.1 time: 0.222880 Oct 04 18:31:54.926406 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3174/6456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:54 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 1355 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.127846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.132167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.143968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.145323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.146558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.147718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.148477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.149354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.156100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=65 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:55.605237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:55.617597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27b9e0e3-eaf4-40fe-bc69-e18c1dd6b6d4 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.496473 Oct 04 18:31:55.618611 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3283/6457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:55.947707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:55.949842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 61b61889-46a4-46d9-97b0-eeae1402b0b5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:55.970217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:55.975733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.976440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.977083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:55.978463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:55.984008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:55.985720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.030059 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] HTTP exception thrown: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Request method failure captured: Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 HTTP/1.1 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHt-0BnwV2rFzV2hLLW2yaLqlHbGOJrThXPXVfij2tfnCzKqjxv7oMkGlVbQMqo1_1qeYIH56aDp3b2ijHpp5u35DmmSjyFglfemElCnGqSMxDe9pXwWx4lVvOek0GuKreknZH0OJ_pkDYjbqoIC-c0_Ug1emqp1Q567JpjK1DS5nDU Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dc578eb8835546d4a127279e3cd8a38b Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '61b61889-46a4-46d9-97b0-eeae1402b0b5'} Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:31:56.033739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. Oct 04 18:31:56.044536 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:31:56.047897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Returning 404 to user: Instance 61b61889-46a4-46d9-97b0-eeae1402b0b5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:31:56.049555 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2edb1216-a534-42af-93fe-3e3cc499a972 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5" status: 404 len: 111 microversion: 2.1 time: 0.112185 Oct 04 18:31:56.052220 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3175/6458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:55 2022] GET /compute/v2.1/servers/61b61889-46a4-46d9-97b0-eeae1402b0b5 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:31:56.647583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:56.648425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:56.656067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.656597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.657039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:56.657789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:56.658294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:56.658745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.341462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:57.350026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c59b29a-f91e-42d4-b9e2-590b897c2343 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.709309 Oct 04 18:31:57.350026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3284/6459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:56 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:57.961805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:57.963926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:57.968183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:31:57.973119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.974343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.974865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:57.975783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:57.976253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:57.976680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.009387 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f483c88b-0d1c-4274-be56-b7849157cbfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/ips" status: 200 len: 149 microversion: 2.1 time: 0.061497 Oct 04 18:31:58.010575 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3285/6460] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:31:57 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/ips => generated 149 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:58.056926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1416490-cb35-45d4-80ac-4a992d6dc4b6", "tag": "ca480ab7-8998-49b4-8152-f362247fb775"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:58.071020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.071803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.072402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.091763 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] Creating event network-changed:ca480ab7-8998-49b4-8152-f362247fb775 for instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 on n-h1-831194-21 Oct 04 18:31:58.096911 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ca17d24b-f0e0-4cf5-a111-451daa1d4848 req-6ccb7df7-fc1b-480e-932a-db96e65fbd49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147580 Oct 04 18:31:58.100646 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3176/6461] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:31:58.376887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:58.382647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:58.391460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.392258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.392702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.393440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:58.393948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:58.394987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:58.905244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:31:58.914538 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f26204da-312f-4b50-a288-694377f36044 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.545423 Oct 04 18:31:58.915466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3286/6462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:58 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:31:59.504247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5a619f9-cd0a-49bd-9122-8024c8b962d8"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:31:59.507628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.533621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.534629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.535093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.535854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.536931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.537375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.939391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:31:59.939940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:31:59.948166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.948677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.949136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:31:59.949926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:31:59.950401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:31:59.950850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:00.463646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:00.474118 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5014902f-ed88-429e-93c2-8c7de06b62b7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.538584 Oct 04 18:32:00.482695 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3287/6463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:31:59 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:00.752131 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f9b745df-3e8a-4f60-a9a4-329b64b5b6bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.253458 Oct 04 18:32:00.773887 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3177/6464] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:31:59 2022] POST /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 194 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:01.528429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:01.535064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:01.547555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.549454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.550518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:01.551803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:01.553382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:01.554671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:02.093523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:02.106995 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b18c6925-1c32-4143-bee0-e8bf9227597c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.602585 Oct 04 18:32:02.107899 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3288/6465] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:01 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:03.138624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:03.141170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:03.172966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:03.182480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:03.214893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.244646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.245521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:03.246491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:03.247084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:03.249759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:04.114867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:04.151686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fc69dd3b-5189-49f9-8151-d96f70efb4f1 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 1.021482 Oct 04 18:32:04.152769 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3178/6466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:03 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.196746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.197399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:05.216302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.216966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.217523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.218416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:05.219132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:05.219904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:05.514689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:05.529212 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1c18594-0523-45e7-8d62-f93d550668b5 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.349757 Oct 04 18:32:05.530085 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3289/6467] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:05 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:05.619383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ec2e681b-b098-47ab-adb0-19d69fab9bb3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '.version_select at 0x7fbdc1c5ab80>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:05.683206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ec2e681b-b098-47ab-adb0-19d69fab9bb3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-799402778" status: 202 len: 0 microversion: 2.1 time: 0.069230 Oct 04 18:32:05.683812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3179/6468] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 18:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-799402778 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:05.726759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-119c127b-b4f4-4301-b4ca-9afd5fc7ccbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: .version_select at 0x7fbdbd00c3a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-963653783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6m3jLio80WfAtsG38neiU7bT7bVwiktq0/2Sad/MffEuaE5P+cQrj65LDkL+GZAOAkfts+nFoZVC3LoEa3N9K4wbfY8tJzWULQ5MpxsXTfwKdkozar+BaOk4lnrZ6P+Q=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:05.756730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-119c127b-b4f4-4301-b4ca-9afd5fc7ccbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:05.765570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-119c127b-b4f4-4301-b4ca-9afd5fc7ccbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:05.813443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-119c127b-b4f4-4301-b4ca-9afd5fc7ccbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.091848 Oct 04 18:32:05.821424 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3290/6469] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:05 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:06.557513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:06.558476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:06.582125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.583015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.583977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.584796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:06.585223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:06.585660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:06.589041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:07.011331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1416490-cb35-45d4-80ac-4a992d6dc4b6", "name": "network-vif-plugged", "status": "completed", "tag": "ca480ab7-8998-49b4-8152-f362247fb775"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:07.035798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:07.036922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:07.037546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:07.081501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] Creating event network-vif-plugged:ca480ab7-8998-49b4-8152-f362247fb775 for instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 on n-h1-831194-21 Oct 04 18:32:07.096997 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-dae1a526-530b-46db-8216-8f59ba7322b0 req-b35ab0cf-bfbd-46e2-8818-ab2d8eaf9bb5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092733 Oct 04 18:32:07.098830 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3291/6470] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:07.294002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:07.316306 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-32edb654-acbc-4636-ad48-3f6dc347bd98 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.762456 Oct 04 18:32:07.335253 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3180/6471] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:06 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:08.345588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:08.346388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:08.362180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.366309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.367566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.372260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:08.373752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:08.375222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:08.811737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:08.829094 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c1d6ce1f-31e7-4803-8dc5-16da4f43450d tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1471 microversion: 2.1 time: 0.489371 Oct 04 18:32:08.830622 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3292/6472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:08 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1471 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:09.858869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:09.859714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:09.867121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.867921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.868527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:09.869919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:09.870542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:09.871641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.047220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.056025 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2756f6e0-a920-478e-86e0-73194795f312 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1643 microversion: 2.1 time: 0.200935 Oct 04 18:32:10.057046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3181/6473] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:09 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1643 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:10.080523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.081166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.089803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.090343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.090949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.091532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.092015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.092469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.377235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:10.391329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7721b2a9-c88d-4bd1-afde-c5d0253df378 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1643 microversion: 2.1 time: 0.314471 Oct 04 18:32:10.392345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3293/6474] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1643 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:10.417441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:10.418875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:10.425164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.425986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.426643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.427892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:10.428561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:10.429003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:10.876638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3ff3759-d662-495e-bff5-24309933e6b1 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1796 microversion: 2.1 time: 0.463888 Oct 04 18:32:10.879086 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3182/6475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:10 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1796 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:13.802239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1416490-cb35-45d4-80ac-4a992d6dc4b6", "tag": "ca480ab7-8998-49b4-8152-f362247fb775"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:13.813955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:13.814871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:13.815553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:13.829509 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] Creating event network-changed:ca480ab7-8998-49b4-8152-f362247fb775 for instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 on n-h1-831194-21 Oct 04 18:32:13.837695 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1b0486d1-de9e-4fa0-baf5-794d0ac68925 req-99282831-ebe1-47cf-9e5a-c7a357c95ab5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038236 Oct 04 18:32:13.838949 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3294/6476] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:15.965435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5a619f9-cd0a-49bd-9122-8024c8b962d8"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:15.971031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.002994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.003855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.005415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.009622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.010375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.011158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.214120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments HTTP/1.1 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 74 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: {"volumeAttachment": {"volumeId": "d5a619f9-cd0a-49bd-9122-8024c8b962d8"}} Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '83736f69-d32f-4398-acb4-801996fd9c46', 'body': {'volumeAttachment': {'volumeId': 'd5a619f9-cd0a-49bd-9122-8024c8b962d8'}}} Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:16.216314 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 Oct 04 18:32:16.221469 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:16.227036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 400 to user: Invalid volume: volume d5a619f9-cd0a-49bd-9122-8024c8b962d8 is already attached to instances: 83736f69-d32f-4398-acb4-801996fd9c46 {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:16.228444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-59f41898-3d8d-4a9a-9de6-b3148ddf84d7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.271058 Oct 04 18:32:16.229719 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3183/6477] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:32:15 2022] POST /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 174 bytes in 273 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:32:16.391515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.394180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.416494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:16.423775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.424407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.425087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.426277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.426979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.428378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.576006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'services' on Instance uuid 83736f69-d32f-4398-acb4-801996fd9c46 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:16.723767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f807fc8a-33b0-4c40-a004-c1f411c80e27 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments/d5a619f9-cd0a-49bd-9122-8024c8b962d8" status: 202 len: 0 microversion: 2.1 time: 0.339470 Oct 04 18:32:16.727132 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3295/6478] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:32:16 2022] DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments/d5a619f9-cd0a-49bd-9122-8024c8b962d8 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:16.737721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:16.743718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:16.759767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.760498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.761126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.762099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:16.763104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:16.763750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:16.838407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d6654dc-e7a6-4fea-abab-3711bdf8c438 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107207 Oct 04 18:32:16.844845 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3184/6479] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:16 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:17.323330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2079948855", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5088649d-c70a-49f6-8bdb-76736d83854e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-963653783", "security_groups": [{"name": "tempest-secgroup-smoke-797234692"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:17.604912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] validate_networks() for [('5088649d-c70a-49f6-8bdb-76736d83854e', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:17.856565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:17.860167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:17.883806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.886530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.887176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.888082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:17.891010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:17.893291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:17.997814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-252903c3-6429-4e38-91df-c23cc8d0b6d8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148474 Oct 04 18:32:17.999953 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3185/6480] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:17 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:19.012631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.015307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.028430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.029060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.029516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.030416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.031066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.031596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.118640 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6cd56d2f-9a86-4f6c-a784-73ae75148de6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105667 Oct 04 18:32:19.123001 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3186/6481] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:19.428956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:19.429886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:19.429886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:19.430277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:19.430900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:19.449457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.452974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.453677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.454825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:19.458531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:19.460083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:19.507102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:19.520138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:19.551698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:19.555331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:19.688248 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1532a7b7-6c10-4cd6-98f0-b636328093ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.369414 Oct 04 18:32:19.717326 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3296/6482] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 2399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:19.717543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01f4a642-789f-47ac-ab88-8bdfda73788c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:19.718620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-01f4a642-789f-47ac-ab88-8bdfda73788c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:19.895606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-01f4a642-789f-47ac-ab88-8bdfda73788c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:19.913005 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-01f4a642-789f-47ac-ab88-8bdfda73788c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1266 microversion: 2.1 time: 0.202156 Oct 04 18:32:19.914939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3187/6483] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:19 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:20.128610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.131400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:20.147947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.148542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.149153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.149963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:20.161481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:20.165119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:20.379123 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e507df1-6a10-4919-aedd-656c751298fb tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.255104 Oct 04 18:32:20.383034 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3297/6484] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:20.940386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5581fa97-8376-4df6-a457-57e3f89af55b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:20.941215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5581fa97-8376-4df6-a457-57e3f89af55b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.092570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5581fa97-8376-4df6-a457-57e3f89af55b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:21.105166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5581fa97-8376-4df6-a457-57e3f89af55b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1266 microversion: 2.1 time: 0.170970 Oct 04 18:32:21.118583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3188/6485] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:20 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:21.397069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:21.402056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:21.428089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.428923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.431701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.432708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:21.433364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:21.437203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:21.517228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3286e58a-3de8-4363-adf8-2d1f3f72a3a5 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124970 Oct 04 18:32:21.521609 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3298/6486] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:21 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:22.136037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.137188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.153149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.153706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.154182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.155142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.155628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.156154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.359346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:22.392220 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f345bf64-90f7-4d37-a7be-65187a21ce05 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1318 microversion: 2.1 time: 0.258978 Oct 04 18:32:22.393149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3189/6487] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1318 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:22.533035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:22.535307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:22.556376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.557002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.557449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.563193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:22.566745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:22.567476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:22.641756 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ffca8ad-72bc-4245-9e46-7336ac532ce0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112819 Oct 04 18:32:22.655207 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3299/6488] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:22 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:23.420247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.421039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.447751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.465659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.467425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.468551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.469215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.470011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.664433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:23.666825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:23.698682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.706716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.707482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.712843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:23.713615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:23.716942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:23.753615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:23.784201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bbc886c1-1e03-46a1-ab63-109dbf3540a8 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1324 microversion: 2.1 time: 0.365983 Oct 04 18:32:23.784877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3190/6489] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:23.826678 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e8ea480-8035-418b-8a77-67e15898041a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167439 Oct 04 18:32:23.827236 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3300/6490] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:23 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:24.815029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.815681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.830949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.836414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.839677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.840118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:24.842922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.843532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:24.843672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.851685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.857228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.862054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.863974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.868853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:24.869647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:24.870406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:24.960608 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-446d602b-5b9f-46cd-b924-07f8f87b95d1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124375 Oct 04 18:32:24.968141 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3301/6491] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.166253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:25.179457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b063b97c-6a03-4eff-85e7-7cd42c8de58b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.368754 Oct 04 18:32:25.195610 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3191/6492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:24 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:25.324719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:25.344119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.345020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:25.345697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:25.349322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:25.364695 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] Creating event network-changed:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:32:25.383351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-20d9b595-2827-4d2a-b8cd-fdae3d78505b req-fdb9879a-2ed5-47bb-be2f-17078c2fffe7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063129 Oct 04 18:32:25.384787 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3302/6493] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:25.980569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:25.985569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:25.998464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:25.999853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.001015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.002255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.002957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.003607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.042430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b919b337-6b50-4854-9f27-935de43f9b48 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066587 Oct 04 18:32:26.043650 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3192/6494] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:32:25 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:32:26.135262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.135909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.143639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.145042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.145737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.147938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.149169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.149794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.178572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:32:26.217092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.218027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.224588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.225160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.225604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.226576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.227042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.227472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.296934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-864003ca-38c5-44bf-a191-a6b8b22996bf tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 204 len: 0 microversion: 2.1 time: 0.166620 Oct 04 18:32:26.298347 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3303/6495] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:32:26 2022] DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:32:26.308681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:26.309875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:26.316566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.317074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.317978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.318925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:26.319464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:26.319859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:26.407509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.419523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b41cc372-7c50-4731-9740-c6589b3333f9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.216454 Oct 04 18:32:26.424205 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3193/6496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:26.613050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:26.622543 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d34c67b8-f771-4eb8-b4a2-c42b3f222edd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1681 microversion: 2.1 time: 0.318667 Oct 04 18:32:26.638074 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3304/6497] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:26 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1681 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.457943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.459425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.468060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.468763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.469373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.470629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.471253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.471961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.653531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:27.657808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:27.676560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.677539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.679690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.682143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:27.683631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:27.684596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:27.813112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.830720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0afb47e9-ce1f-4274-bd48-cafb63f516bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.384826 Oct 04 18:32:27.832629 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3194/6498] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:27.950469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:27.959476 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0efee0f-8076-4519-b98d-14b0a28b22b7 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1681 microversion: 2.1 time: 0.314486 Oct 04 18:32:27.960670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3305/6499] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:27 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:28.858271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.859798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.868035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:28.870964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.871855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.872641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.873706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:28.874605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:28.875284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:28.986630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:28.987121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:28.989773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:29.007631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.008916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.009383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.010205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:29.014717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:29.015741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:29.205069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.221377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-739c0f12-9d8a-4b0e-b3ca-53b7c4a45353 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1613 microversion: 2.1 time: 0.240345 Oct 04 18:32:29.223109 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3306/6500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1613 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:29.335668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:29.349051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebf62af0-69e8-4c64-9ccd-9c665a4b9916 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.495033 Oct 04 18:32:29.354414 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3195/6501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:28 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:30.081462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83736f69-d32f-4398-acb4-801996fd9c46", "name": "network-vif-deleted", "tag": "54520ac8-c452-40ce-a165-8ca46d052426"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:30.096131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:30.101076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:30.121035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.121619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.122107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.142103 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] Creating event network-vif-deleted:54520ac8-c452-40ce-a165-8ca46d052426 for instance 83736f69-d32f-4398-acb4-801996fd9c46 on n-h1-831194-21 Oct 04 18:32:30.157750 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-ecf0a67f-3242-4617-8230-c5e50e2fde02 req-3e1ad606-4ba6-4387-86f0-fd5946b6a2e8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080574 Oct 04 18:32:30.161309 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3307/6502] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:30.262476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.264310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.282325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.283541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.284512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.286147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.299225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.300430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.369653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.370464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.371144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.372053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'fault' on Instance uuid 83736f69-d32f-4398-acb4-801996fd9c46 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:32:30.399618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:30.401766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:30.413481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.414305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.415253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.416721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:30.417771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:30.418890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:30.462261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.471739 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00a4c183-f1c1-4b0a-b900-a4af6f56505e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 200 len: 1331 microversion: 2.1 time: 0.222316 Oct 04 18:32:30.485864 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3196/6503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:30.683519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:30.699044 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc0842e8-172f-406a-8aaf-45ec2bb2da97 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.312179 Oct 04 18:32:30.699639 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3308/6504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:30 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:31.506582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.508124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.511332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:31.520100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.520898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.521510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.522733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.523489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.524352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.544272 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 HTTP/1.1 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '83736f69-d32f-4398-acb4-801996fd9c46'} Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:32:31.545963 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:32:31.550788 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:32:31.552438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:32:31.554353 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b268e29b-71cc-4e27-8939-2a27879041a0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 404 len: 111 microversion: 2.1 time: 0.056377 Oct 04 18:32:31.555728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3197/6505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:32:31.570755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5aadde34-d1d9-46b9-913a-48e2434ab479 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '.version_select at 0x7fbdc1d791f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.600286 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5aadde34-d1d9-46b9-913a-48e2434ab479 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-126438501" status: 202 len: 0 microversion: 2.1 time: 0.037989 Oct 04 18:32:31.601454 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3309/6506] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 18:32:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-126438501 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:32:31.730092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:31.732652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:31.740077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.741600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.742572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.743427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:31.743906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:31.744541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:31.976448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:31.989875 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-181edfa9-5a6a-4841-a937-8efd1b8ddf2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.267499 Oct 04 18:32:31.991729 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3198/6507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:31 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:32.560377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae71f2f2-f74e-48c5-ac70-ff30f85fb925 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: .version_select at 0x7fbdc1d2b790>, body: {"keypair": {"name": "tempest-keypair-1784001903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5W1pG204zGvCnag+53v1k2V1gsz5AsH2/JsnkX65HgV5sqgWct0GWKxWZgpocz5eBlo57+bE3LEo00RPTotX8KReaqINVdBQTmINHBDcrU8PVzitG/BYNM8mdKphEKHg=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:32.590430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae71f2f2-f74e-48c5-ac70-ff30f85fb925 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:32.604639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae71f2f2-f74e-48c5-ac70-ff30f85fb925 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:32.649650 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae71f2f2-f74e-48c5-ac70-ff30f85fb925 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097064 Oct 04 18:32:32.651091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3310/6508] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:32:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:32.839524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-plugged", "status": "completed", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:32.850563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:32.851615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:32.852321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:32.857259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=100 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:32.869410 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] Creating event network-vif-plugged:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:32:32.879294 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-95491963-c9c3-4c7b-a1d6-d66a8cebf01c req-024adf03-2745-40c6-a3fe-1dce6e6269c0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040947 Oct 04 18:32:32.880237 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3199/6509] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:33.032293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:33.032949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:33.046227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.047959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.048640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.049735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:33.067366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:33.067994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:33.468611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:33.477928 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e378aa47-e610-4a82-8242-64e34d14f34c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1391 microversion: 2.1 time: 0.459213 Oct 04 18:32:33.479152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3311/6510] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:33 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1391 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.512323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.513050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.528186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.529090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.529634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.530535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.531289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.531952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.656444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-738862721", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6e80190d-6f7c-4a36-acb4-292d1b415902"}], "security_groups": [{"name": "tempest-securitygroup--1562280234"}], "key_name": "tempest-keypair-1784001903", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:34.790425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:34.805586 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4344b38f-4b26-4149-b165-44b83995ca9f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1563 microversion: 2.1 time: 0.300217 Oct 04 18:32:34.835761 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3200/6511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1563 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:34.840100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] validate_networks() for [('6e80190d-6f7c-4a36-acb4-292d1b415902', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:34.842719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:34.843449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:34.870761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.872617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.872617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:34.873216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:34.874040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:34.874756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.181134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.196463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5edc8a08-743d-4a8b-93a5-1b7223b3bc2e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1563 microversion: 2.1 time: 0.358222 Oct 04 18:32:35.214271 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3201/6512] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:34 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1563 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:35.476967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:35.477545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:35.478175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:35.478858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:35.479454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:35.493461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.494314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.495001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.496295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:35.497270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:35.497742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:35.525750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:35.532149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Getting quotas for user 72348d69cbd14e588c07dbb1f0651096 and project a0b16a926aec4eb8a11d43fede625277. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:35.578391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:35.582189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:35.648335 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-74b6f76e-2b61-4a0e-9c5a-a422c6ffebc1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.996320 Oct 04 18:32:35.657502 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3312/6513] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 18:32:35.663230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1f5b7e18-aacb-454c-af6d-537a6d1eddfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:35.664838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1f5b7e18-aacb-454c-af6d-537a6d1eddfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:35.762027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1f5b7e18-aacb-454c-af6d-537a6d1eddfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:35.779277 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1f5b7e18-aacb-454c-af6d-537a6d1eddfa tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1241 microversion: 2.1 time: 0.119265 Oct 04 18:32:35.785872 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3202/6514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:35 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:36.808156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:36.810102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:36.820934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.821457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.821967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.822712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:36.823189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:36.823673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:36.920275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:36.936297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-20f42280-3ceb-4a9f-8958-8d9bccbd8f9c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1293 microversion: 2.1 time: 0.134894 Oct 04 18:32:36.937584 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3313/6515] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:36 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:37.978681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:37.981951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:37.999431 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.001145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.002279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.003523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.004748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.008164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.119512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.137881 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49dc1f01-9888-4ffc-a444-8656181113ce tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1299 microversion: 2.1 time: 0.171798 Oct 04 18:32:38.139233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3203/6516] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:37 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:38.392721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:38.393486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:38.417139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.418316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.419113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.420434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.421221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.421915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.433063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:38.467649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:38.478131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:38.478786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:38.497043 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] Creating event network-changed:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:32:38.508023 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3b4f96a9-3e20-4a3b-a4b5-7e272ce8d947 req-78e1349b-53bf-4616-ac3f-bc3d2f2693c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077842 Oct 04 18:32:38.509512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3204/6517] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:38.863766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:38.884560 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bbd86a56-cae3-4798-9416-c39520a2e394 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1563 microversion: 2.1 time: 0.496533 Oct 04 18:32:38.886863 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3314/6518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:38 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1563 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:39.164729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:39.165461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:39.178011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.183977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.184648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.185543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:39.186080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:39.186544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:39.503342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:39.523178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1bb074a-6a6f-48f4-b019-01d11e66fa21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.362200 Oct 04 18:32:39.525749 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3205/6519] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:39 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:40.547227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc", "tag": "f08ab938-2c52-496a-8500-3feab6b6e413"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:40.549718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:40.551158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:40.559182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.559693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.560177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.560900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.561369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.561846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.564850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:40.565467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:40.566058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:40.582273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] Creating event network-changed:f08ab938-2c52-496a-8500-3feab6b6e413 for instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc on n-h1-831194-21 Oct 04 18:32:40.588635 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b5e55b36-2ef0-47ba-a02d-5dd666141aa3 req-e714dfb1-e6a7-4174-b0a4-577436321f2a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045726 Oct 04 18:32:40.589568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3315/6520] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:40.730322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:40.741625 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dae2ee85-7e52-461d-91b0-8c7e3aa1b9b8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.195984 Oct 04 18:32:40.743010 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3206/6521] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:40 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:41.768443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:41.769163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:41.778051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.778991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.779499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.780246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:41.781709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:41.781709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:41.946164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:41.957957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f0111ab4-bcdd-4f6f-8c56-fe7d2b21c3ab tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.194491 Oct 04 18:32:41.958557 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3316/6522] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:41 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:42.987379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:42.988010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:42.996446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.996954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.997398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:42.998139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:42.998601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:42.999029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:43.200220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:43.208831 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0d925ff-f620-44a8-ac52-a7a5e1241231 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.225209 Oct 04 18:32:43.221852 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3207/6523] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:42 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:44.237391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:44.238199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:44.246977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.247495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.247942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.248672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:44.249146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:44.249605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:44.417766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:44.426770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b7d5db2-0eab-4601-91f5-f19057724ee8 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.193625 Oct 04 18:32:44.427490 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3317/6524] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:44 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:45.453450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:45.454107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:45.462158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.462663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.463110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.463884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:45.464350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:45.464809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:45.633390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:45.642355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e3eec14-ec39-44bb-86a9-487de5741869 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.192582 Oct 04 18:32:45.642874 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3208/6525] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:45 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:46.666512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:46.667980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:46.670113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:46.670819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:46.683962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.684480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.684944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.686377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.687263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.688036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.883826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc", "name": "network-vif-plugged", "status": "completed", "tag": "f08ab938-2c52-496a-8500-3feab6b6e413"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:46.904535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:46.909080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:46.916917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6f6434d-00be-4b6c-a28c-7b7fd76afed9 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.254596 Oct 04 18:32:46.927310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:46.927558 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3318/6526] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:46 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:46.927663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:46.927663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:46.940468 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] Creating event network-vif-plugged:f08ab938-2c52-496a-8500-3feab6b6e413 for instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc on n-h1-831194-21 Oct 04 18:32:46.947363 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-19ffccba-b804-4fca-bf1e-9e479e7595cf req-5852d378-efcd-48f1-a552-c1b308726f7a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073002 Oct 04 18:32:46.958360 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3209/6527] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:32:47.944835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:47.945513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:47.953061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.953943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.954388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:47.955129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:47.955606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:47.956061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:48.263419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:48.272443 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8903e52d-7779-4112-95ff-d44deada6551 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1367 microversion: 2.1 time: 0.333134 Oct 04 18:32:48.273546 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3319/6528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:47 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.300467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.301218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.309277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.309818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.310290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.311022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.311484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.311920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.580696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:49.589689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b9563452-9afa-48c7-a50b-af58ea5df583 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1556 microversion: 2.1 time: 0.295268 Oct 04 18:32:49.590313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3210/6529] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1556 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:32:49.613232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:49.613845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:49.622190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.622190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.622734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.623507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:49.624061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:49.625254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:49.735388 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-432953cf-d014-44f4-8682-1007bc2581b6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126080 Oct 04 18:32:49.736531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3320/6530] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:32:49 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:51.136738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc", "tag": "f08ab938-2c52-496a-8500-3feab6b6e413"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:51.150060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:51.150791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:51.151376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:51.164221 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] Creating event network-changed:f08ab938-2c52-496a-8500-3feab6b6e413 for instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc on n-h1-831194-21 Oct 04 18:32:51.172242 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d44e1065-fad4-42e0-93a9-63dda0341c5a req-39a8af50-adae-45b7-b299-f9004ca77380 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039784 Oct 04 18:32:51.173431 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3211/6531] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:32:57.910053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-917854113", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "2e05563d-b5f3-4e27-8dc2-7c981962e5bd"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1276788523", "security_groups": []}, "os:scheduler_hints": {"different_host": ["d1416490-cb35-45d4-80ac-4a992d6dc4b6"]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:57.986858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] validate_networks() for [('2e05563d-b5f3-4e27-8dc2-7c981962e5bd', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:32:58.650869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:32:58.651346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:32:58.651817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:32:58.652472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:32:58.653097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:32:58.663480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.664320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.665928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.667201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:58.668363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:58.669153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:58.676081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:58.694819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:32:58.700940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Getting quotas for user 849445be07fc453fbb9706c1313b4535 and project 1cc4bb995e0b4843b3b41ae2e95efcb1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:32:58.715879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:32:58.718297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:32:58.772378 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-16860e59-645a-4457-9d2a-9e8ffb6cdc5c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.867909 Oct 04 18:32:58.774082 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3321/6532] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:32:57 2022] POST /compute/v2.1/servers => generated 361 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:32:58.790149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1fc7fbf7-1b6b-4088-8948-a8d704bdfc8c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:58.792089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1fc7fbf7-1b6b-4088-8948-a8d704bdfc8c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:58.902579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1fc7fbf7-1b6b-4088-8948-a8d704bdfc8c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:32:58.920195 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1fc7fbf7-1b6b-4088-8948-a8d704bdfc8c tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1241 microversion: 2.1 time: 0.138616 Oct 04 18:32:58.921138 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3212/6533] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:58 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1241 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:32:59.710925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:32:59.713713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.718791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:59.727018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.727893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.728589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.730049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.730723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.731375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.809668 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8cdf8392-6210-4c13-b9ca-38a9a30c4e42 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action" status: 200 len: 24564 microversion: 2.1 time: 0.110198 Oct 04 18:32:59.810957 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3322/6534] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:32:59 2022] POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action => generated 24564 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:32:59.950733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:32:59.952906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:32:59.955997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=42 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:32:59.962250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.962910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.963560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:32:59.964372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:32:59.965180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:32:59.965615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:00.042342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:00.050382 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4253130-ee35-469e-81c6-037f4048640a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1293 microversion: 2.1 time: 0.105752 Oct 04 18:33:00.064139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3213/6535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:32:59 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:01.076872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:01.077607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:01.095111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.095620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.096090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.102454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:01.103242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:01.104038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:01.246790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:01.256722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-22e9a824-4d50-4658-ae5d-3f51d85bebba tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.184807 Oct 04 18:33:01.258646 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3323/6536] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:01 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.289548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:02.290450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:02.300401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.301043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.301549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.302509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.303453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.304642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.400600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:02.408748 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5ae1076-9b8f-446e-a2b1-6e4960783137 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.126790 Oct 04 18:33:02.422334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3214/6537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:02 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:02.640454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010782f-304e-421f-a176-d220f2083efe", "tag": "72a8f02a-1a80-416f-a366-98bb689a04c3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:02.652288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:02.652820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:02.653266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:02.664041 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] Creating event network-changed:72a8f02a-1a80-416f-a366-98bb689a04c3 for instance 4010782f-304e-421f-a176-d220f2083efe on n-h2-831194-21 Oct 04 18:33:02.673743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f5ab0115-fc76-48ba-b108-39f62bb88650 req-62be3d9f-b2b1-4aeb-89c2-a10aa1602c2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033507 Oct 04 18:33:02.675670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3324/6538] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:03.434436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:03.435169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:03.442331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.442904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.443421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.444760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:03.445128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:03.445632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:03.448513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=68 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:03.535841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:03.544850 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6db18f7-d858-4ffd-b15c-6bc504696786 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.116157 Oct 04 18:33:03.549631 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3215/6539] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:03 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:04.578785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:04.579864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:04.589286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.602679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.603639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.604753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:04.605637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:04.606966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:04.754732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:04.763966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c3a35181-719a-4158-85c8-02c49ec75fb0 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.199271 Oct 04 18:33:04.764696 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3325/6540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:04 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:05.789230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:05.789784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:05.796962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.797765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.798308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.799014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:05.799550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:05.799991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:05.890595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:05.899252 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d7a0863b-4780-43b7-97af-6c450b90711e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.114643 Oct 04 18:33:05.900204 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3216/6541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:05 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:06.923127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:06.923889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:06.932352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.932901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.933482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:06.934298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:06.935108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:06.935664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:07.037085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:07.046268 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e9ea5da5-6786-4c83-912b-df8128d3887a tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.126932 Oct 04 18:33:07.046881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3326/6542] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:06 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.070691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:08.071259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:08.078677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.079209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.079654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.080552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.081157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.081887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.180575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:08.189189 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b3f723f-3e72-4ba2-afb0-54d2a8d549c3 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.123115 Oct 04 18:33:08.190291 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3217/6543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:08 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:08.792333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010782f-304e-421f-a176-d220f2083efe", "name": "network-vif-plugged", "status": "completed", "tag": "72a8f02a-1a80-416f-a366-98bb689a04c3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:08.799745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:08.800822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:08.810253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:08.810765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:08.811224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:08.824040 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] Creating event network-vif-plugged:72a8f02a-1a80-416f-a366-98bb689a04c3 for instance 4010782f-304e-421f-a176-d220f2083efe on n-h2-831194-21 Oct 04 18:33:08.830542 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-533f9ec7-3ca2-490b-863d-2594a3003d5c req-83e71eed-de82-4cc1-90bb-0cf3b9074dbc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042458 Oct 04 18:33:08.831288 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3327/6544] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:09.216595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:09.218611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:09.220560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:09.232639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.233200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.233660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.234416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:09.235065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:09.235506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:09.330585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:09.339672 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e57ba2c5-edef-49f1-be4f-515869760f84 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1299 microversion: 2.1 time: 0.130031 Oct 04 18:33:09.340274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3218/6545] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:09 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1299 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.364798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.365520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.373069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.373819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.374086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.374769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.375242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.375688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.460661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.468796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a58d5766-b776-4ecc-9f50-19efddd513f7 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1471 microversion: 2.1 time: 0.109094 Oct 04 18:33:10.469453 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3328/6546] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.491017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.492341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.499517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.500070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.500520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.501235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.501726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.502192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.589372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:10.597945 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-945d79ed-3c66-4640-81a7-48edafafa061 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1471 microversion: 2.1 time: 0.110770 Oct 04 18:33:10.598931 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3219/6547] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1471 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.624127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.624680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.630813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.631323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.631783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.633318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.633978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.634435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.717133 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbddfdc4-7eaa-4d39-9f30-6e939ee29f47 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1624 microversion: 2.1 time: 0.096955 Oct 04 18:33:10.717738 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3329/6548] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1624 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.740213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.740980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.748149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.748825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.749388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.750136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.750603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.751037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.892318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.893822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:10.894033 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f14c1066-e2dc-46a8-a2a9-b00d4d7050c0 tempest-TestSecurityGroupsBasicOps-389254668 tempest-TestSecurityGroupsBasicOps-389254668-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1914 microversion: 2.1 time: 0.157944 Oct 04 18:33:10.894605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3220/6549] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1914 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:10.905978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:10.998984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:10.999704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.006286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.006837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.008215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.009068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.009629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.010193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.036971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:11.064693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-005c2d06-2384-4e0d-9f78-569732994829 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1835 microversion: 2.1 time: 0.175972 Oct 04 18:33:11.065872 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3330/6550] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:10 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1835 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:11.090179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.090810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.096828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.097334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.098011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.098785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.099394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.099778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.135398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d2291166-f5db-4656-bd12-e4902ddac714 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 204 len: 0 microversion: 2.1 time: 0.140041 Oct 04 18:33:11.137449 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3221/6551] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:10 2022] DELETE /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:33:11.146908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:11.147632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.153958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.154453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.155023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.155730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.156189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.156616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.242865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.251590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:11.253777 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e2ea0f2b-afbd-49c7-9be1-93c617517bfc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1682 microversion: 2.1 time: 0.168426 Oct 04 18:33:11.254453 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3331/6552] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:11.266063 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f97224dc-def2-46ba-a978-0593402faa05 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1477 microversion: 2.1 time: 0.118299 Oct 04 18:33:11.266063 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3222/6553] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:11 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1477 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:11.354559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:11.356859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:11.366102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.285197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.285819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.293222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.293718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.294200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.294902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.295393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.295833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.336839 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14dee62b-3d0a-4965-a535-f87dbc697c47 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action" status: 200 len: 32641 microversion: 2.1 time: 0.986049 Oct 04 18:33:12.337517 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3223/6554] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:11 2022] POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action => generated 32641 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:33:12.382644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.390501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7676643b-5834-4448-a205-6cb9bde6e19b tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1477 microversion: 2.1 time: 0.109211 Oct 04 18:33:12.391247 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3332/6555] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1477 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:12.486315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:12.487036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.500650 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.501593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.502170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.503030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.503690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.504249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.553242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '5f44ed6c246a44499833bef79de6fcdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0aac0c951034c9992c994cfaa89d910', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:12.553869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] flavor_id is None. Assuming migration. {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 04 18:33:12.554429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:33:12.818994 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b52bc34-ccb6-4800-8657-3d36597759f6 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action" status: 202 len: 0 microversion: 2.1 time: 0.336461 Oct 04 18:33:12.819935 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3224/6556] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:12 2022] POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:12.828033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:12.828671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:12.834580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.835085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.836076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:12.836792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:12.837314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:12.837961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.063777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.073428 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a8e9e22-ecdb-4e80-b417-773920c4e1c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1691 microversion: 2.1 time: 0.249201 Oct 04 18:33:13.103742 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3333/6557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:12 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1691 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:13.268642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010782f-304e-421f-a176-d220f2083efe", "name": "network-vif-deleted", "tag": "72a8f02a-1a80-416f-a366-98bb689a04c3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:13.281003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.282298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.282825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.310719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] Creating event network-vif-deleted:72a8f02a-1a80-416f-a366-98bb689a04c3 for instance 4010782f-304e-421f-a176-d220f2083efe on n-h2-831194-21 Oct 04 18:33:13.319623 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-106547e6-4698-4cba-9e19-5b1cda7aab02 req-a26c92b4-92cb-4402-a431-a00f0d213f3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056381 Oct 04 18:33:13.324536 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3225/6558] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:13.417400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:13.418194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:13.426691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.427683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.428382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.430055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.431183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.432400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.492013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:13.493653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:13.494355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:13.495260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lazy-loading 'fault' on Instance uuid 4010782f-304e-421f-a176-d220f2083efe {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:13.553162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:13.563499 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3839a025-632e-4acc-a90b-362fc954e9ce tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 200 len: 1331 microversion: 2.1 time: 0.152983 Oct 04 18:33:13.564169 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3334/6559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:13 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.115151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.115935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.126573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.127386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.129079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.130652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.131375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.131820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.294944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:14.303341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8f46fbf-1d67-4efd-9c7e-e2aaf8a4dbbe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1691 microversion: 2.1 time: 0.205351 Oct 04 18:33:14.303904 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3226/6560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:14.589277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:14.589965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: 4010782f-304e-421f-a176-d220f2083efe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:14.596903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.597344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.597795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.598522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:14.598989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:14.599429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:14.613301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] HTTP exception thrown: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Request method failure captured: Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe HTTP/1.1 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHwKXgOG705ywPsoCfNOOyOcbvDyK1bVFuG2pwOoiEM2DpPMDxzImnXPi57ROASnGe9SMjinZpzDxL91EAvFdP6laeAEDLzQjfRZyOSUGbc7YaJPiz544ZN3m2II4MTR3J_bQJJPvpAnVCmZqjHm-M5MVQCnkcK3eTE8X_N0cRReWiI Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1cc4bb995e0b4843b3b41ae2e95efcb1 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1cc4bb995e0b4843b3b41ae2e95efcb1 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestSecurityGroupsBasicOps-1113577359-project Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 849445be07fc453fbb9706c1313b4535 Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1113577359-project Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '4010782f-304e-421f-a176-d220f2083efe'} Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.614980 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Returning 404 to user: Instance 4010782f-304e-421f-a176-d220f2083efe could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2df9baa4-7d29-4f44-a458-ab4203a5cb67 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe" status: 404 len: 111 microversion: 2.1 time: 0.031059 Oct 04 18:33:14.620911 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3335/6561] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:14 2022] GET /compute/v2.1/servers/4010782f-304e-421f-a176-d220f2083efe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:15.328242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:15.328967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:15.336533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.337274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.337795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.339259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:15.339916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:15.340891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:15.498656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:15.506784 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e6730102-7fe5-4c08-94fb-200a280c7287 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1691 microversion: 2.1 time: 0.183075 Oct 04 18:33:15.507527 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3227/6562] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:15 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1691 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:16.530946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:16.532179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:16.540163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.540948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.541759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.542771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:16.543571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:16.544207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:16.797056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:16.807434 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef4ae6b8-417f-4331-ae92-3cddea916b1a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.280229 Oct 04 18:33:16.811892 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3336/6563] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:16 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:17.831760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:17.832970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:17.841845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.842585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.843267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:17.844209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:17.844900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:17.845551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:18.064750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:18.085002 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86308feb-53f5-4b54-a5a6-31d05021fd51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.257138 Oct 04 18:33:18.087306 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3228/6564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:17 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:19.115030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:19.115654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:19.123424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.123925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.124380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.125088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:19.125558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:19.126043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:19.273311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:19.283074 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6e1d732-c021-4432-9651-38dbc1644e1c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.171222 Oct 04 18:33:19.283659 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3337/6565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:19 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.237971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1416490-cb35-45d4-80ac-4a992d6dc4b6", "tag": "ca480ab7-8998-49b4-8152-f362247fb775"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:20.241036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.241689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.254680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.257619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.259771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.262429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.263480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.264041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.264554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.269488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.270309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.292020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:20.294679 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] Creating event network-changed:ca480ab7-8998-49b4-8152-f362247fb775 for instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 on n-h1-831194-21 Oct 04 18:33:20.304037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8b56c3ca-ec04-422a-8bdd-f219fc88652f req-450e723e-e81e-43ce-9d39-0364b177de8d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071616 Oct 04 18:33:20.311542 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3338/6566] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:20.314676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:20.323925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.324914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.334058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.334878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.342616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.343726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.344456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.346045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.427570 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-641b40f6-9e64-4183-af34-42c5dbc62737 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 204 len: 0 microversion: 2.1 time: 0.196617 Oct 04 18:33:20.433442 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3229/6567] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:20 2022] DELETE /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:20.441100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:20.441968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:20.453500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.454594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.455204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.457649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:20.458320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:20.459151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:20.609967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.622395 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2b7f174b-f632-4839-b81c-918a7204703f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.306831 Oct 04 18:33:20.630067 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3339/6568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:20.672690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:20.683003 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40370525-e0a1-4eeb-8c99-9459187b514f tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1767 microversion: 2.1 time: 0.247820 Oct 04 18:33:20.683772 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3230/6569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:20 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1767 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:21.661432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.662187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.670105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.670615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.671066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.671779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.672417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.672856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.708245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:21.709049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:21.716696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.717304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.718395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.719307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:21.722423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:21.722999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:21.897760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.906102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:21.915788 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c27f92b-6869-4ac1-ab50-e31aab899398 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1767 microversion: 2.1 time: 0.211696 Oct 04 18:33:21.916771 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3231/6570] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1767 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:21.920136 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-834c1583-e9b8-4b8a-9a71-4b353c6fe186 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.267837 Oct 04 18:33:21.930752 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3340/6571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:21 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:22.625072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1416490-cb35-45d4-80ac-4a992d6dc4b6", "name": "network-vif-deleted", "tag": "ca480ab7-8998-49b4-8152-f362247fb775"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:22.635145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.635626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.636053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.653118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] Creating event network-vif-deleted:ca480ab7-8998-49b4-8152-f362247fb775 for instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 on n-h1-831194-21 Oct 04 18:33:22.658923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-136ea374-984b-416e-bf00-49431775e66d req-ae259fba-2540-481a-aa60-205063731605 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042660 Oct 04 18:33:22.659536 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3232/6572] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:22.941496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.942805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.946134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:22.947400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:22.952660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.953396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.954126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.956355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.957130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.957605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.957903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.958152 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.958645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.958972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:22.959538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:22.960088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:22.983033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:23.016503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:23.017290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:23.017756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:23.018271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lazy-loading 'fault' on Instance uuid d1416490-cb35-45d4-80ac-4a992d6dc4b6 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:23.071382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '849445be07fc453fbb9706c1313b4535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc4bb995e0b4843b3b41ae2e95efcb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.083697 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e7d49b7-b88e-47aa-8a4e-22bfc57c40eb tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 200 len: 1384 microversion: 2.1 time: 0.146397 Oct 04 18:33:23.087850 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3341/6573] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 1384 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:23.201019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:23.210048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e24e4fce-ca12-43ac-a3c5-f309d1b714bf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.270360 Oct 04 18:33:23.210871 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3233/6574] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:22 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:24.114853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.115478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] [instance: d1416490-cb35-45d4-80ac-4a992d6dc4b6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.123472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.124050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.124408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.125120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.125582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.126121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.140379 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] HTTP exception thrown: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Request method failure captured: Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 HTTP/1.1 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHwKXgOG705ywPsoCfNOOyOcbvDyK1bVFuG2pwOoiEM2DpPMDxzImnXPi57ROASnGe9SMjinZpzDxL91EAvFdP6laeAEDLzQjfRZyOSUGbc7YaJPiz544ZN3m2II4MTR3J_bQJJPvpAnVCmZqjHm-M5MVQCnkcK3eTE8X_N0cRReWiI Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1cc4bb995e0b4843b3b41ae2e95efcb1 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1cc4bb995e0b4843b3b41ae2e95efcb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1cc4bb995e0b4843b3b41ae2e95efcb1 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1113577359 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestSecurityGroupsBasicOps-1113577359-project Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 849445be07fc453fbb9706c1313b4535 Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1113577359-project Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'd1416490-cb35-45d4-80ac-4a992d6dc4b6'} Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:24.142084 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Returning 404 to user: Instance d1416490-cb35-45d4-80ac-4a992d6dc4b6 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7403980c-d3d5-407d-9d7c-a46ef8d9fd92 tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6" status: 404 len: 111 microversion: 2.1 time: 0.032525 Oct 04 18:33:24.146845 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3342/6575] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/d1416490-cb35-45d4-80ac-4a992d6dc4b6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:24.233675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:24.234380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:24.242696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.243173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.243825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.244712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:24.245765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:24.246992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:24.412083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:24.423579 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16040e37-7807-4167-83e4-5e9a069f181c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.193995 Oct 04 18:33:24.426004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3234/6576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:24 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:25.451942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:25.453966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:25.465434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.466089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.466370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.467091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:25.467566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:25.468006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:25.727781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:25.735461 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f679b886-d72a-47db-b6d2-a6cd13a8537d tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.287626 Oct 04 18:33:25.736142 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3343/6577] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:25 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:26.761583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:26.762168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:26.776902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.777707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.778402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:26.779466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:26.780129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:26.781046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.340258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:27.350729 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ec83912-4874-4716-babe-3998f6288351 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.594263 Oct 04 18:33:27.352883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3235/6578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:26 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:27.848939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:27.849584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:27.857402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.858148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.858741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.859657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:27.860281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:27.860857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:27.894062 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4b70b9f-084f-4168-8b34-fd629128c3d2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/ips" status: 200 len: 147 microversion: 2.1 time: 0.217695 Oct 04 18:33:27.895443 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3344/6579] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:33:27 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/ips => generated 147 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:28.378987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.379726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:28.405316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.419704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.421611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.422484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:28.424489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:28.426928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:28.536205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27ef7798-db22-40de-b0e6-462e7356d74e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] Calling method '.version_select at 0x7fbdbc8b50d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:28.581289 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27ef7798-db22-40de-b0e6-462e7356d74e tempest-TestSecurityGroupsBasicOps-1113577359 tempest-TestSecurityGroupsBasicOps-1113577359-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1276788523" status: 202 len: 0 microversion: 2.1 time: 0.050596 Oct 04 18:33:28.585132 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3345/6580] 10.222.0.42 () {58 vars in 1278 bytes} [Tue Oct 4 18:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1276788523 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:28.665278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:28.676263 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-764e4ed6-cced-462f-9d58-7374584df070 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1696 microversion: 2.1 time: 0.302828 Oct 04 18:33:28.677364 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3236/6581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:28 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1696 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:29.489507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-unplugged", "status": "completed", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:29.501754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.502294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.502746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.515240 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Creating event network-vif-unplugged:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h1-831194-21 Oct 04 18:33:29.526239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] Instance 3b2f3496-54d9-4717-8436-2db757bfe225 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:29.541236 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e3dfd0bd-21c4-4cfd-a3ac-2e6befa20765 req-49147d6f-35be-4f15-85f8-9238b5871172 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055404 Oct 04 18:33:29.542051 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3346/6582] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:29.708219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:29.711173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:29.741190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.742334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.743476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:29.744456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:29.745111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:29.745734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.027639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:30.037006 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a9111c2-05b5-4f0b-b27e-b1538abbe387 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1695 microversion: 2.1 time: 0.337596 Oct 04 18:33:30.051506 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3237/6583] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:29 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1695 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:30.433671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee197622-bb2a-40fa-9d86-907c6fc0f087"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:30.436354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:30.438490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:30.447212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.448015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.448545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.449389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:30.449963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:30.450478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:30.772436 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55c32e3b-5e2a-4d94-a199-43f842c9d39b tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "POST /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.343317 Oct 04 18:33:30.773330 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3347/6584] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:33:30 2022] POST /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:31.066148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:31.066822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:31.070002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:31.084738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.085395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.086032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.086773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.087241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.090092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.338181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:31.351086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-21ddee5a-1ac6-406d-bc47-34411d878256 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1695 microversion: 2.1 time: 0.290252 Oct 04 18:33:31.353883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3238/6585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:31 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:31.570847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:31.583084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:31.583584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:31.584041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:31.602058 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Creating event network-changed:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h1-831194-21 Oct 04 18:33:31.609861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] Instance 3b2f3496-54d9-4717-8436-2db757bfe225 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:31.630201 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-83c452ff-47d0-4987-b9f9-6478ed504cb8 req-08a4457e-8b68-4c7e-a6f6-ef181d7edcb2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065733 Oct 04 18:33:31.631629 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3348/6586] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:32.380785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:32.382190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:32.390860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.391382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.392473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.393221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:32.393688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:32.394661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:32.547825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:32.557107 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd71e03f-499a-4ed7-9473-2a22692bd2ca tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1693 microversion: 2.1 time: 0.180623 Oct 04 18:33:32.557705 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3239/6587] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:32 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1693 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.584859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.587789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.595646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.596705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.597378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.598304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.598976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.599624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.771333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:33.781623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66be84c4-95e7-4c27-947f-e9757cfe6775 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1690 microversion: 2.1 time: 0.202708 Oct 04 18:33:33.783124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3349/6588] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1690 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:33.805855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:33.806481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.813446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.813894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.814343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.815048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.815594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.815942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.932404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0e8c04af-07d3-4eb1-b4a2-89967bb58423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action" status: 202 len: 0 microversion: 2.1 time: 0.130986 Oct 04 18:33:33.933325 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3240/6589] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:33:33 2022] POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:33.944115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:33.946865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:33.954666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.956003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.957344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:33.958347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:33.958922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:33.959594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:34.228068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:34.241384 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23a305e6-8b71-4903-8eaf-bcbd5667f036 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.303287 Oct 04 18:33:34.242913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3350/6590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:33 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:35.274927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:35.277050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:35.287413 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.288317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.290443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.291698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:35.292407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:35.293147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:35.481964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:35.490683 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-132f1aa1-c87e-46f1-8ad6-28beee62108b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.226326 Oct 04 18:33:35.491561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3241/6591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:35 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:36.514909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:36.515547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:36.522633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.523144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.524242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.524971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:36.525451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:36.525929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:36.683560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:36.710354 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6cc1aaf6-a701-4c8b-8bb0-8db212ac0b49 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.199177 Oct 04 18:33:36.730616 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3351/6592] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:36 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:37.173899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-plugged", "status": "completed", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:37.185694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.186286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.186804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.202190 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Creating event network-vif-plugged:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h1-831194-21 Oct 04 18:33:37.208757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] Instance 3b2f3496-54d9-4717-8436-2db757bfe225 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:37.221678 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-60b250fc-dc3d-4abd-bc2f-834f5612677f req-495b2f81-2eda-4761-b9b6-ce1e1a2bf22b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051564 Oct 04 18:33:37.222328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3242/6593] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:37.737166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:37.737806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:37.746024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.747239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.747789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:37.748603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:37.749146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:37.749854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.011619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:38.020973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1981fac-7043-4e4c-bca1-4f8d26d451bd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.287760 Oct 04 18:33:38.021547 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3352/6594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:37 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:38.130938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-unplugged", "status": "completed", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:38.141483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:38.142326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:38.142784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:38.158484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Creating event network-vif-unplugged:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:33:38.161733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:38.168428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] Instance 3b2f3496-54d9-4717-8436-2db757bfe225 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:38.183585 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-83256e3b-0f5e-421f-8908-e9cccb3cfbe2 req-3c7091f2-fabe-46da-834f-ac61e25a542e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056668 Oct 04 18:33:38.184257 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3243/6595] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:39.045319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.046532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.056766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.057620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.058346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.060584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.061363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.061935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.309319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.322435 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-21a0ba02-549d-4238-b4fa-2f89e744c568 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.281109 Oct 04 18:33:39.334073 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3353/6596] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:39.422736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.423280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.430908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.431336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.431787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.432561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.433027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.433464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.468155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:39.546150 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-25315cd8-5120-40b5-9e4e-8490cb3142a0 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 204 len: 0 microversion: 2.1 time: 0.128139 Oct 04 18:33:39.546592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3244/6597] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:39 2022] DELETE /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:39.556091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:39.556777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:39.563093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.563600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.564086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.564909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:39.565392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:39.565857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:39.708150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:39.717351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b75755d1-aeb8-446e-a874-f21327d08636 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1576 microversion: 2.1 time: 0.166235 Oct 04 18:33:39.717953 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3354/6598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:39 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.207326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:40.218189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.218781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.219313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.231790 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Creating event network-changed:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:33:40.237234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] Instance 3b2f3496-54d9-4717-8436-2db757bfe225 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:33:40.248746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8c65bf20-ad50-4550-8114-0a6e689b785d req-998a2b39-8c00-4f1c-a74e-d6602f636230 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045481 Oct 04 18:33:40.249565 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3245/6599] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:40.348094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.349131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.357324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.357932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.358531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.359510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.360238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.360781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.511044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.519036 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df28d2f8-527f-451b-996a-22e21b72e490 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.174924 Oct 04 18:33:40.519609 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3355/6600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:40.755996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:40.757387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:40.782370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.783027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.783657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.784676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:40.785307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:40.785967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:40.932949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:40.940939 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4d57124-3966-448b-b8c8-a625e9b6162b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1576 microversion: 2.1 time: 0.200816 Oct 04 18:33:40.941529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3246/6601] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:40 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.543529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.544192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.551269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.551780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.552250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.553053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.553535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.554014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.695958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:41.705069 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e04d94d7-a400-40fc-a850-471c6398a736 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1689 microversion: 2.1 time: 0.165878 Oct 04 18:33:41.705693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3356/6602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:41.965149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:41.965883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:41.975357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.975357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.975716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:41.977470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:41.978283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:41.978982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.160399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:42.169797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d5eefbd-5d8b-4fdf-a865-daf4118b15a5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1576 microversion: 2.1 time: 0.209258 Oct 04 18:33:42.170394 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3247/6603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:41 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:42.734699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:42.741989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:42.762236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.763912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.764402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:42.767606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:42.768126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:42.768592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.181257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.196148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.197218 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-189bd972-eea1-41f9-b838-e2102906af65 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1682 microversion: 2.1 time: 0.470451 Oct 04 18:33:43.198849 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3357/6604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:42 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1682 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:43.211732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.232733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.233480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.234695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.235642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.236261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.238629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.246059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.247733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.267758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.268362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.268832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.269590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.270096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.270530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.416076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:43.418249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lazy-loading 'services' on Instance uuid 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:33:43.545273 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-649161ac-6772-4267-8ac1-351094666653 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments/ee197622-bb2a-40fa-9d86-907c6fc0f087" status: 202 len: 0 microversion: 2.1 time: 0.301756 Oct 04 18:33:43.545594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3358/6605] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:33:43 2022] DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments/ee197622-bb2a-40fa-9d86-907c6fc0f087 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:33:43.573380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:43.598585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:43.604834 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-771dd2b4-3b9c-43bb-9fc8-5a7b4b07239b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1576 microversion: 2.1 time: 0.416056 Oct 04 18:33:43.606756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:43.609822 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3248/6606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1576 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:43.623053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.623908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.624580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.635238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:43.635868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:43.636549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:43.675588 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69eb2bf9-ab24-4954-9adf-199277f7ee21 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112871 Oct 04 18:33:43.676459 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3359/6607] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:43 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:43.999428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d99db2f-707e-4592-b01c-95d7d92a4f4b", "name": "network-vif-deleted", "tag": "d79c389d-9b55-4011-a367-7891dd6c8c54"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:44.019025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.019513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.024864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.043500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] Creating event network-vif-deleted:d79c389d-9b55-4011-a367-7891dd6c8c54 for instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b on n-h2-831194-21 Oct 04 18:33:44.065331 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6ab622a1-0935-4c9a-8ade-c3264cc7bc14 req-bea075bb-ad4a-499d-990c-e4cd539d8531 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069781 Oct 04 18:33:44.069000 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3249/6608] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:44.632594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.634623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.641614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.642393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.643032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.643919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.644558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.645169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.690177 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:44.692571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:44.699198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.699697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.700145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.700887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.701540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.701999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:44.739240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:44.751246 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9fdceff3-b6e9-46c8-9c02-252c2895793b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1224 microversion: 2.1 time: 0.122324 Oct 04 18:33:44.753237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-212cdd62-f189-4c0c-b06c-05e01f784c3e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068290 Oct 04 18:33:44.758756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3360/6609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1224 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:44.759461 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3250/6610] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:44 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:44.972364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-plugged", "status": "completed", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:44.984906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:44.993921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:44.994587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.016959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] Creating event network-vif-plugged:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:33:45.025400 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5f5aaf0b-10f4-4ba3-9ef0-82db053a0b47 req-b963fb55-3747-4667-89f9-77ded9f120da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056845 Oct 04 18:33:45.026641 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3361/6611] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:45.766274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.768542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.777924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.778688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.779288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.780172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.780620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:45.781305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.781507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:45.782137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.790851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.791761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.792977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.794275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:45.795164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:45.796647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:45.828500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea9978d6-4b07-475c-a67d-3536ebb553d6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066469 Oct 04 18:33:45.829564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3251/6612] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:45.872264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:45.880946 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8385616d-3ccc-4c8e-a7b2-06b495726ef3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1224 microversion: 2.1 time: 0.105861 Oct 04 18:33:45.881527 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3362/6613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:45 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:46.842099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.844218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.851060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.851543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.852142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.852844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.853297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.853724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.884713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-727cdd4d-9300-4f3d-a5dd-eb8059b9c3b2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 Oct 04 18:33:46.885284 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3252/6614] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:46.903904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:46.904531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:46.911498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.911995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.912447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.913155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:46.913663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:46.914558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:46.980190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:46.988065 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b982609a-834b-4a38-971e-262178c0c21c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1224 microversion: 2.1 time: 0.088013 Oct 04 18:33:46.988637 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3363/6615] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:46 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:47.898254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:47.901086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:47.908747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.909251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.909744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.910517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:47.910980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:47.911449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:47.947121 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8220841-f94d-4e1d-8870-02bf05cd2ad0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053166 Oct 04 18:33:47.947712 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3253/6616] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:47 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:48.013331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.014045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.020905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.021412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.021897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.022614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.023084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.023526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.088829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:48.096932 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96d1b385-72e1-4f7f-a1fb-455042c8c624 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 200 len: 1224 microversion: 2.1 time: 0.088493 Oct 04 18:33:48.097568 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3364/6617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:48.960080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:48.964906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:48.972225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.972716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.973347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:48.974064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:48.974679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:48.975265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.049482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-81545357-6f56-40f0-894f-5293214bb519 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093828 Oct 04 18:33:49.053135 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3254/6618] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:48 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:49.120533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:49.121699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:49.129987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.130491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.131137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.131857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.132329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.132764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.147280 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b HTTP/1.1 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8d99db2f-707e-4592-b01c-95d7d92a4f4b'} Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:49.149050 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f929d009-5b98-4b91-8694-2ba42c556e15 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 404 len: 111 microversion: 2.1 time: 0.035545 Oct 04 18:33:49.155046 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3365/6619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:49 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:33:49.267460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-980384598", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-268794580", "security_groups": [{"name": "tempest-secgroup-smoke-1873706191"}], "block_device_mapping_v2": [{"uuid": "c6c43d83-e289-42f7-80b0-50d92bbb0ed7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:49.411043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:33:49.827553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:33:49.828098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:33:49.828496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:33:49.828911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:33:49.829329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:33:49.843093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.843849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.844458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.845385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:49.846045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:49.846635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:49.873599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:33:49.882858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:33:49.952216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:33:49.954596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6c43d83-e289-42f7-80b0-50d92bbb0ed7',volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:33:50.064997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.067510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.074915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.075554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.076233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.077338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:50.078305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:50.079008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:50.109654 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-126714c6-23a0-4c15-9e76-44af5479c488 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843754 Oct 04 18:33:50.110746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3255/6620] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:33:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:33:50.123008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c324bba3-3b61-4ed3-a3f7-f074cba12ee8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:50.123555 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-15fbb0a7-f46c-4194-97a7-b267ec271280 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062487 Oct 04 18:33:50.124021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c324bba3-3b61-4ed3-a3f7-f074cba12ee8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:50.125162 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3366/6621] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:33:50.197639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c324bba3-3b61-4ed3-a3f7-f074cba12ee8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:50.207557 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c324bba3-3b61-4ed3-a3f7-f074cba12ee8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1093 microversion: 2.1 time: 0.088930 Oct 04 18:33:50.208547 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3256/6622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:50 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1093 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:51.136966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.139952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.147076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.147703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.148322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.149640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.150291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.150743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.184957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce54cd2e-93e3-4b21-8edf-0734d274b377 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051997 Oct 04 18:33:51.185534 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3367/6623] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:51.230854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:51.231480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:51.239518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.240132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.250929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.252014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:51.252666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:51.253283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:51.333720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:51.344008 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-092db27b-fa83-4c1d-aecd-2b2615162985 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1191 microversion: 2.1 time: 0.117845 Oct 04 18:33:51.345200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3257/6624] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:51 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:52.198644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.201224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.215147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.215938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.216559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.217448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.218104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.218705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.252202 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d23b53d9-f8e6-469a-8764-16fd986fe147 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057539 Oct 04 18:33:52.253323 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3368/6625] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:52.372792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:52.373324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:52.383363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.384280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.384727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.385453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:52.385937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:52.386376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:52.685481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:52.693917 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb5944a0-70d1-4fd8-992c-89d4f688243d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1277 microversion: 2.1 time: 0.329046 Oct 04 18:33:52.694677 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3258/6626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:52 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1277 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.267502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.270602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.272939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394", "tag": "4115a9fe-061f-4d25-82af-7495fbe18d99"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:53.281057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.282100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.283562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.284951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.285712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.286649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.313064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.313847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.314827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.357369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] Creating event network-changed:4115a9fe-061f-4d25-82af-7495fbe18d99 for instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 on n-h1-831194-21 Oct 04 18:33:53.361506 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8097a6b8-c212-4453-8a4d-e0b22380569c tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099475 Oct 04 18:33:53.363480 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3259/6627] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 04 18:33:53.373566 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1ad7fe1a-d603-4a7e-ae2e-7342acd13cfb req-7103ccec-f4bf-49a1-ab0d-9db73a29b463 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116817 Oct 04 18:33:53.374936 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3369/6628] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:53.468475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.469613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.480242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.481428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.482084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.483073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.483700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.484297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.533546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:33:53.576258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:33:53.649920 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c37fd14f-10e2-4a72-b256-4bff905413c1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 204 len: 0 microversion: 2.1 time: 0.184015 Oct 04 18:33:53.654337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3260/6629] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:33:53 2022] DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:33:53.663294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.666532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.675444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.676340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.677063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.678627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.680157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.681705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.720191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:53.720920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:53.729482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.739350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.741327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.743742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:53.754721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:53.755422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:53.909700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.922784 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-452a940f-dc9a-4bef-afee-e1f38eae03b1 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1679 microversion: 2.1 time: 0.265050 Oct 04 18:33:53.923703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3370/6630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:53.959801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:53.969013 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd966862-6c86-4622-937f-9cadf04b3604 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1277 microversion: 2.1 time: 0.253467 Oct 04 18:33:53.970605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3261/6631] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:53 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1277 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:54.951983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:54.952614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:54.960074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.960657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.961115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.961938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:54.962414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:54.962858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:54.999663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:55.000624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:55.011514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.012011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.012453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.013168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:55.013634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:55.014093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:55.172168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.186636 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80d236b3-3b45-4628-8666-398bddb92156 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1679 microversion: 2.1 time: 0.238885 Oct 04 18:33:55.217217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3371/6632] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1679 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:55.245746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:55.254745 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fc86cae-0182-4643-922b-7564334ec7b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1277 microversion: 2.1 time: 0.259146 Oct 04 18:33:55.255909 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3262/6633] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:54 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:56.217522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.218170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.226367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.228295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.229035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.233745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.235238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.235917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.280878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:56.281983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:56.294894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.295505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.296022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.298236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.310421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.311044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.543946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.564125 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce9d60ea-03b7-4ff8-8dc6-2e87bba6a86c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1277 microversion: 2.1 time: 0.287172 Oct 04 18:33:56.579257 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3263/6634] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1277 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:33:56.629254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72348d69cbd14e588c07dbb1f0651096', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0b16a926aec4eb8a11d43fede625277', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:56.638527 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96f3ae97-bbda-4a03-99cf-e5f3d359ced0 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 200 len: 1679 microversion: 2.1 time: 0.424406 Oct 04 18:33:56.639881 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3372/6635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:56 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 1679 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:56.858052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc", "name": "network-vif-deleted", "tag": "f08ab938-2c52-496a-8500-3feab6b6e413"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:33:56.874839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:56.875768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:56.876527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:56.892571 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] Creating event network-vif-deleted:f08ab938-2c52-496a-8500-3feab6b6e413 for instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc on n-h1-831194-21 Oct 04 18:33:56.900781 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05ca0586-135d-43a4-8a34-df6473c1a68c req-e0ffc042-098d-4303-ab37-b4a62f9db230 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056287 Oct 04 18:33:56.906465 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3264/6636] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:33:57.591088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.591764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.605513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.607578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.608242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.609012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.609491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.609955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.666063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.667450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:57.685690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.686716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.689947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.691096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:57.691882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:57.692337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:57.735088 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc HTTP/1.1 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc'} Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:33:57.740466 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:33:57.745766 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:33:57.747712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:33:57.752578 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5541029d-8888-4fbe-a439-9bb8bf1d7734 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 404 len: 111 microversion: 2.1 time: 0.090850 Oct 04 18:33:57.754313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3265/6637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:33:57.768259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6135e68-8ffb-491d-999a-c268b9866e0a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '.version_select at 0x7fbdbd9c49d0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:57.811740 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6135e68-8ffb-491d-999a-c268b9866e0a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784001903" status: 202 len: 0 microversion: 2.1 time: 0.048866 Oct 04 18:33:57.813858 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3266/6638] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1784001903 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:33:57.835425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:57.845459 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c63e9995-5bb3-4d05-9742-44465982359c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1277 microversion: 2.1 time: 0.259448 Oct 04 18:33:57.846615 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3373/6639] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:57 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:33:58.878228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:33:58.879629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:33:58.891510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.893303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.893765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:58.896253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:33:58.897113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:33:58.897840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:33:59.054702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:33:59.064349 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a6c18ce-ce47-4ccd-99f7-6b16501b597a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.194878 Oct 04 18:33:59.065068 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3267/6640] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:33:58 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:00.089354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:00.091264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:00.099216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.103317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.103795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.104562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:00.105044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:00.105494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:00.255481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:00.264705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9905478-5a09-4519-84b6-7df32f22fbbb tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.179309 Oct 04 18:34:00.265288 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3374/6641] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:00 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.290073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.291588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.294039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:01.296499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:01.297759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:01.305010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.306053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.306729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.307692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.308452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.309098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.489047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:01.498172 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc96ebe8-1f73-4019-ad3a-899e58d8e419 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.212790 Oct 04 18:34:01.498764 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3268/6642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:01 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:01.965192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:01.965738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:01.968687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=56 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:01.974385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.974898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.975355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.976082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:01.976552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:01.978023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:01.999107 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc HTTP/1.1 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc'} Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:02.001011 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.006376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:02.008702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a703852-905a-4414-a62f-f8e30c204297 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 404 len: 111 microversion: 2.1 time: 0.046191 Oct 04 18:34:02.008702 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3375/6643] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:01 2022] DELETE /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:02.016825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.017603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.025028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.026313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.027263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.028094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.029080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.029651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.049656 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc HTTP/1.1 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc'} Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:02.051465 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae213f9a-9b26-43d9-bef5-fd8eb700f6f6 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc" status: 404 len: 111 microversion: 2.1 time: 0.041849 Oct 04 18:34:02.058634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3269/6644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/3e341fc4-ef7e-4feb-a8b7-84ac3867a8bc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:02.539686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:02.541562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:02.561656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.562332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.564544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.565982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:02.566601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:02.568823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:02.756693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:02.771874 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b5f86fe1-c37d-4459-909b-1fddf8bccf46 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.253917 Oct 04 18:34:02.794743 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3376/6645] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:02 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:03.803250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:03.804043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:03.829683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.830528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.831155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:03.832050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:03.833138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:03.834037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:04.001494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:04.017170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-052f0374-9ced-4d8e-a6f9-8e7d8cb179f3 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.217709 Oct 04 18:34:04.018441 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3270/6646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:03 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.043007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.043652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.052951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.053567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.054216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.055057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.055860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.056497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.075426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:05.246679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:05.256318 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e807b371-2bd1-4603-a476-4fe99dd1ccb8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.217592 Oct 04 18:34:05.256984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3377/6647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:05.372769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.373546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.380875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.381384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.381815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.382546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.383033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.384072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.398521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 HTTP/1.1 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '83736f69-d32f-4398-acb4-801996fd9c46'} Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:05.400354 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22469c16-9d2f-4e3f-97e6-63a1edbae5e4 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 404 len: 111 microversion: 2.1 time: 0.033111 Oct 04 18:34:05.404347 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3271/6648] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:05 2022] DELETE /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:05.416461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.417171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: 83736f69-d32f-4398-acb4-801996fd9c46] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.424073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.424580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.425035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.425753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.426261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.426710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.444549 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 HTTP/1.1 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '83736f69-d32f-4398-acb4-801996fd9c46'} Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.447123 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance 83736f69-d32f-4398-acb4-801996fd9c46 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:05.452015 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3c29a2b-46c5-4a5a-9fc0-cc4be3c9561e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46" status: 404 len: 111 microversion: 2.1 time: 0.036241 Oct 04 18:34:05.453280 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3378/6649] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/83736f69-d32f-4398-acb4-801996fd9c46 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:05.458313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.458898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.466356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.466947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.467476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.468184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.468755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.469196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.486152 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 HTTP/1.1 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'fedcbcff-2ee9-411d-a907-18a780ca6391'} Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:05.487758 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdd7fbe3-d91c-4788-87da-d7d27fedfb5e tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 404 len: 111 microversion: 2.1 time: 0.035541 Oct 04 18:34:05.495980 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3272/6650] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:05 2022] DELETE /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:05.502676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:05.503377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: fedcbcff-2ee9-411d-a907-18a780ca6391] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.510332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.510949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.511500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.512489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.512967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.513416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.528026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 HTTP/1.1 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'fedcbcff-2ee9-411d-a907-18a780ca6391'} Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:05.529658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance fedcbcff-2ee9-411d-a907-18a780ca6391 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-afbfadc7-11e2-4cbe-ab46-2828be25b57a tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391" status: 404 len: 111 microversion: 2.1 time: 0.032305 Oct 04 18:34:05.536217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3379/6651] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:05 2022] GET /compute/v2.1/servers/fedcbcff-2ee9-411d-a907-18a780ca6391 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:05.573496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:05.576764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:05.590364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.591343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.591955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.592878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:05.593625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:05.594310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:05.702341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d8d2413-353e-4247-b542-b515f23e45d3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action" status: 200 len: 63205 microversion: 2.1 time: 0.135309 Oct 04 18:34:05.704140 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3273/6652] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:34:05 2022] POST /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225/action => generated 63205 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:34:06.281746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:06.283056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:06.292907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.293682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.294372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.295368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:06.296000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:06.296718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:06.467934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:06.477926 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-940711b0-5542-4890-9691-0ae890388cef tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.201498 Oct 04 18:34:06.490622 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3380/6653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:06 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:07.504619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:07.506076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:07.514834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.515651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.516329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.517280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:07.518208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:07.518862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:07.726863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:07.739126 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-855a3152-a2b1-404c-8f21-f1f3e99c490a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.239279 Oct 04 18:34:07.743743 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3274/6654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:07 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.770586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.771971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.780077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.780824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.781451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.782411 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.783046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.783675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.903841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.904363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.915974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.916522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.916961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.917688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.918178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.918610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.951958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:08.957470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 HTTP/1.1 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'dcd44d48-a5ed-4ddf-ad5c-544549654be1'} Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:08.964539 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5cff0118-7fd3-4371-8f4b-4260a47f67bd tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 404 len: 111 microversion: 2.1 time: 0.067055 Oct 04 18:34:08.972139 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3275/6655] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:08 2022] DELETE /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:08.974537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:08.975166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] [instance: dcd44d48-a5ed-4ddf-ad5c-544549654be1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:08.979016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f973281d-fc52-4313-a5d4-f48a963ed710 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.212238 Oct 04 18:34:08.995987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.996489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.996698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3381/6656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:08.997151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:08.998601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:08.999078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:08.999610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.015865 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] HTTP exception thrown: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Request method failure captured: Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 HTTP/1.1 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHs3oZR59Ekzj4gTj65DZGERv8vP7fTi98otbqHn1FoNwt4FOGLJH3ONsKoctqRgTA7UWQnb3efn7a61JdLpG3ayoOACCADQuZpM13RbZ4T2Bq_gHBCsoQBtRwsoaI21swxR_FUSFv0NiNkMNpCoV4lKMqNGxpvKnvXnuD1XI40fAaY Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a0b16a926aec4eb8a11d43fede625277"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: a0b16a926aec4eb8a11d43fede625277 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-595531970 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 72348d69cbd14e588c07dbb1f0651096 Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-AttachVolumeNegativeTest-595531970-project Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'dcd44d48-a5ed-4ddf-ad5c-544549654be1'} Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:09.017426 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] Returning 404 to user: Instance dcd44d48-a5ed-4ddf-ad5c-544549654be1 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d4fea33-2fe9-4ad1-8862-bcc1f28997f2 tempest-AttachVolumeNegativeTest-595531970 tempest-AttachVolumeNegativeTest-595531970-project] 10.222.0.42 "GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1" status: 404 len: 111 microversion: 2.1 time: 0.048161 Oct 04 18:34:09.027792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3276/6657] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:08 2022] GET /compute/v2.1/servers/dcd44d48-a5ed-4ddf-ad5c-544549654be1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:34:09.470978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394", "name": "network-vif-plugged", "status": "completed", "tag": "4115a9fe-061f-4d25-82af-7495fbe18d99"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:09.496032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:09.497730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:09.498491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:09.523022 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] Creating event network-vif-plugged:4115a9fe-061f-4d25-82af-7495fbe18d99 for instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 on n-h1-831194-21 Oct 04 18:34:09.541526 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-44005822-67d2-45f6-bc1c-102783f5b8b9 req-ca03cf63-0933-4344-a29c-f6944368011f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076266 Oct 04 18:34:09.543029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3382/6658] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:10.002808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:10.003345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:10.015536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.016035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.016477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.019476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:10.019967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:10.020410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:10.509390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:10.525021 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b3d8ddd4-b75d-4d86-8482-ae1208118658 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1265 microversion: 2.1 time: 0.524854 Oct 04 18:34:10.527278 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3277/6659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:09 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1265 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.552996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.553854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.577306 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.577968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.578574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.579447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.580159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.581119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.784792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:11.795010 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee3bb32e-fd14-4cab-b89f-a4680a2511b8 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1451 microversion: 2.1 time: 0.248150 Oct 04 18:34:11.795588 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3383/6660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1451 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:11.818216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:11.819414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:11.827859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.829434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.830101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:11.831604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:11.832260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:11.832888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.013168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:12.014231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:12.021148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.022072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.022745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.023727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:12.024928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:12.025880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:12.098666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:12.121486 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b013ef9-b9cc-4815-b96c-6334217b74b1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1451 microversion: 2.1 time: 0.307372 Oct 04 18:34:12.139791 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3278/6661] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:11 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1451 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:12.237022 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-37af69ad-6664-4d9b-bd03-dd0fff2008a4 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1835 microversion: 2.1 time: 0.227438 Oct 04 18:34:12.237600 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3384/6662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:12 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1835 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:13.669088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.675333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.687654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:13.693755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.694727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.695922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.697599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.701076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.701646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.703406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.705029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.706266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.728030 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] Creating event network-changed:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:34:13.734731 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-47ad4c16-eae6-4094-b72e-34639669ed53 req-50ad893c-36d2-4335-949e-d58dd230a702 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052798 Oct 04 18:34:13.744867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3385/6663] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:13.762275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:34:13.919451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9dc6e576-2192-49e8-bd97-113c8e97d67b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 204 len: 0 microversion: 2.1 time: 0.255992 Oct 04 18:34:13.920844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3279/6664] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:34:13 2022] DELETE /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:34:13.929716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:13.931508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:13.938779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.939606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.940335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:13.941521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:13.942340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:13.943011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:14.313202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:14.325037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7917057e-df18-4d4c-bdb0-11dd3286dcad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1688 microversion: 2.1 time: 0.399200 Oct 04 18:34:14.326436 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3386/6665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:13 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1688 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:15.352969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:15.354314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:15.360904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.361483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.362129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.363131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:15.363792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:15.364308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:15.523576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:15.532696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:15.536233 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2b55c3a9-ccbc-497a-97e0-8dd722d174ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1688 microversion: 2.1 time: 0.189314 Oct 04 18:34:15.537449 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3280/6666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:15 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:16.043584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394", "tag": "4115a9fe-061f-4d25-82af-7495fbe18d99"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:16.077861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.078440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.078839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.094770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] Creating event network-changed:4115a9fe-061f-4d25-82af-7495fbe18d99 for instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 on n-h1-831194-21 Oct 04 18:34:16.102085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7e3a9f40-e7b6-4d18-9f2b-0e8a3f755ade req-22a61d36-9248-47b5-84f1-c9ecf2f5551d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062776 Oct 04 18:34:16.103796 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3387/6667] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:16.562208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:16.562833 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:16.579775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.581286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.581674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.585995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:16.587939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:16.588764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:16.777949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:16.788079 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0870e7a1-b357-4c80-8711-2cfa1b6ab268 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 200 len: 1621 microversion: 2.1 time: 0.230040 Oct 04 18:34:16.793406 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3281/6668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:16 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 1621 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:17.253628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ce63ed9-7339-42ed-b73e-0cfede0a58a3 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Action: 'create', calling method: .version_select at 0x7fbdbc4d9700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-652977379", "metadata": {"Type": "work"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ce63ed9-7339-42ed-b73e-0cfede0a58a3 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 121 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-652977379", "metadata": {"Type": "work"}}} Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-652977379', 'metadata': {'Type': 'work'}}}} Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '#$%' Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:34:17.259782 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5ce63ed9-7339-42ed-b73e-0cfede0a58a3 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5ce63ed9-7339-42ed-b73e-0cfede0a58a3 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.255234 Oct 04 18:34:17.264974 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3388/6669] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 18:34:17 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 257 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 04 18:34:17.271766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0c09a8a-6adb-4d75-8393-9023e9e5cfe9 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Action: 'create', calling method: .version_select at 0x7fbdbd7608b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2122696327", "metadata": {"Type": "work"}}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0c09a8a-6adb-4d75-8393-9023e9e5cfe9 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 120 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2122696327", "metadata": {"Type": "work"}}} Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2122696327', 'metadata': {'Type': 'work'}}}} Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi '0' Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:34:17.276067 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.281330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b0c09a8a-6adb-4d75-8393-9023e9e5cfe9 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.282795 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b0c09a8a-6adb-4d75-8393-9023e9e5cfe9 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.015055 Oct 04 18:34:17.286776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3282/6670] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 18:34:17 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:17.299356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d1ac693-cbc6-4b44-ab48-991ecab6f936 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Action: 'create', calling method: .version_select at 0x7fbdbc664790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1634675918", "metadata": {"Type": "work"}}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d1ac693-cbc6-4b44-ab48-991ecab6f936 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 119 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1634675918", "metadata": {"Type": "work"}}} Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1634675918', 'metadata': {'Type': 'work'}}}} Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '' Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:34:17.309127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d1ac693-cbc6-4b44-ab48-991ecab6f936 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.313465 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d1ac693-cbc6-4b44-ab48-991ecab6f936 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018574 Oct 04 18:34:17.324857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b46248-602e-41fe-8926-2d64a2f729e1 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Calling method '.version_select at 0x7fbdbc6f4700>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.342952 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3389/6671] 10.222.0.42 () {60 vars in 1156 bytes} [Tue Oct 4 18:34:17 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:34:17.355615 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-72b46248-602e-41fe-8926-2d64a2f729e1 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] HTTP exception thrown: Volume tempest-invalid-331098592 could not be found. Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b46248-602e-41fe-8926-2d64a2f729e1 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-331098592 HTTP/1.1 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: exception: Volume tempest-invalid-331098592 could not be found. Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'tempest-invalid-331098592'} Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-331098592 could not be found. (HTTP 404) (Request-ID: req-648442b3-c160-4a96-9029-4e12b9ca74eb) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.366588 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-331098592 could not be found. Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-331098592 could not be found. Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-331098592 could not be found. Oct 04 18:34:17.371975 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.377598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72b46248-602e-41fe-8926-2d64a2f729e1 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 404 to user: Volume tempest-invalid-331098592 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.377598 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72b46248-602e-41fe-8926-2d64a2f729e1 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-331098592" status: 404 len: 98 microversion: 2.1 time: 0.059315 Oct 04 18:34:17.378367 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3283/6672] 10.222.0.42 () {58 vars in 1215 bytes} [Tue Oct 4 18:34:17 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-331098592 => generated 98 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 04 18:34:17.389112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-815591ad-72f7-4901-9408-6869816cce81 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004315 Oct 04 18:34:17.391048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3390/6673] 10.222.0.42 () {58 vars in 1140 bytes} [Tue Oct 4 18:34:17 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:34:17.406914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e517e891-88d7-4453-8bd6-a6a24af64881 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009483 Oct 04 18:34:17.407851 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3284/6674] 10.222.0.42 () {58 vars in 1137 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 04 18:34:17.419974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c5f4bc7-b336-4ed6-9bc0-02ae8eb7cec5 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Calling method '.version_select at 0x7fbdbd39a040>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.512110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7c5f4bc7-b336-4ed6-9bc0-02ae8eb7cec5 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] HTTP exception thrown: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c5f4bc7-b336-4ed6-9bc0-02ae8eb7cec5 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/os-volumes/e66ee7b2-1ede-4e80-beb9-55d800a24ad8 HTTP/1.1 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: method: Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: exception: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e66ee7b2-1ede-4e80-beb9-55d800a24ad8'} Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. (HTTP 404) (Request-ID: req-47d470f5-9b17-4e0c-9378-631f23e369d1) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:34:17.514325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7c5f4bc7-b336-4ed6-9bc0-02ae8eb7cec5 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 404 to user: Volume e66ee7b2-1ede-4e80-beb9-55d800a24ad8 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7c5f4bc7-b336-4ed6-9bc0-02ae8eb7cec5 tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/e66ee7b2-1ede-4e80-beb9-55d800a24ad8" status: 404 len: 109 microversion: 2.1 time: 0.100299 Oct 04 18:34:17.519775 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3391/6675] 10.222.0.42 () {58 vars in 1248 bytes} [Tue Oct 4 18:34:17 2022] DELETE /compute/v2.1/os-volumes/e66ee7b2-1ede-4e80-beb9-55d800a24ad8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:17.527156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3770fe81-1327-4b5a-bab0-990b6a1f6b0b tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Calling method '.version_select at 0x7fbdbc7f0820>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.578194 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3770fe81-1327-4b5a-bab0-990b6a1f6b0b tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] HTTP exception thrown: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3770fe81-1327-4b5a-bab0-990b6a1f6b0b tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Request method failure captured: Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/os-volumes/c51c95b0-65d8-48ca-8732-bfab0710f1c5 HTTP/1.1 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHyo4lIDM8Rjq3MLTd-FhJl79W-t3FtPsIO0ihOB_oFadgHw6oQjnaYdRuxGCCuuqtHfhEyfxPFcYewM9fKtIrCSW8rT_LvnZHCTWtsey-IyGvNiZ4hTn5HgOZ_kqGXCGi0Ccq04mlsRdCdEhwV1N5yVO5pKxN0F8F_g5T4X1qMpO1w Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_775d3ba7842c499cb30dfcd0c0fa9460"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 775d3ba7842c499cb30dfcd0c0fa9460 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesNegativeTest-73137740 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: e1a4617215954766801bfdd60217cea8 Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesNegativeTest-73137740-project Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: method: Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: exception: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c51c95b0-65d8-48ca-8732-bfab0710f1c5'} Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. (HTTP 404) (Request-ID: req-a97fa9be-bb0c-4403-a4c8-f5f3cf34a6f5) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 04 18:34:17.580321 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3770fe81-1327-4b5a-bab0-990b6a1f6b0b tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] Returning 404 to user: Volume c51c95b0-65d8-48ca-8732-bfab0710f1c5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3770fe81-1327-4b5a-bab0-990b6a1f6b0b tempest-VolumesNegativeTest-73137740 tempest-VolumesNegativeTest-73137740-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/c51c95b0-65d8-48ca-8732-bfab0710f1c5" status: 404 len: 109 microversion: 2.1 time: 0.059419 Oct 04 18:34:17.584524 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3285/6676] 10.222.0.42 () {58 vars in 1245 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/os-volumes/c51c95b0-65d8-48ca-8732-bfab0710f1c5 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:17.827753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:17.828566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: 3b2f3496-54d9-4717-8436-2db757bfe225] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:17.836147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.837228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.838256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.839314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:17.839961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:17.840587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:17.858086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] HTTP exception thrown: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Request method failure captured: Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 HTTP/1.1 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHt-0BnwV2rFzV2hLLW2yaLqlHbGOJrThXPXVfij2tfnCzKqjxv7oMkGlVbQMqo1_1qeYIH56aDp3b2ijHpp5u35DmmSjyFglfemElCnGqSMxDe9pXwWx4lVvOek0GuKreknZH0OJ_pkDYjbqoIC-c0_Ug1emqp1Q567JpjK1DS5nDU Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: dc578eb8835546d4a127279e3cd8a38b Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3b2f3496-54d9-4717-8436-2db757bfe225'} Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.860273 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Returning 404 to user: Instance 3b2f3496-54d9-4717-8436-2db757bfe225 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:34:17.864776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3194f730-be17-4157-9432-d3f4a0d6ce26 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225" status: 404 len: 111 microversion: 2.1 time: 0.044954 Oct 04 18:34:17.866120 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3392/6677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:17 2022] GET /compute/v2.1/servers/3b2f3496-54d9-4717-8436-2db757bfe225 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:34:18.124888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b2f3496-54d9-4717-8436-2db757bfe225", "name": "network-vif-deleted", "tag": "18008bd3-5f68-4d8f-987b-7251d49408ff"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:18.139075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:18.139924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:18.140614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:18.159391 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] Creating event network-vif-deleted:18008bd3-5f68-4d8f-987b-7251d49408ff for instance 3b2f3496-54d9-4717-8436-2db757bfe225 on n-h2-831194-21 Oct 04 18:34:18.181485 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a35486aa-ca4a-4e07-8063-23c33cceef7a req-74d16f52-0683-4fc5-a2ce-ddf8567a8252 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060367 Oct 04 18:34:18.184823 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3286/6678] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:22.841075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ceb82c30-3ba5-40ed-b786-7fa826cf42f5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '.version_select at 0x7fbdbc4d9670>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:22.890450 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ceb82c30-3ba5-40ed-b786-7fa826cf42f5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-963653783" status: 202 len: 0 microversion: 2.1 time: 0.054213 Oct 04 18:34:22.895501 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3393/6679] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 18:34:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-963653783 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:34:22.950045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7ac8cc7-6bb8-4715-a79f-a14d2c04fee3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: .version_select at 0x7fbdc1d57ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1459838130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDxb0NN7ZNwO9XTmpGRIl6ipxUtsLdgqIl7hVRfNglG6zwl2/7M64K5y+v8u3eD2f0Aa6s1uZk0Zs8yVwzKMNbqTJNuxZjrd/6ZpkTFkTzHsgeVqgnhk6m22LQ9wRsBaQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:22.967318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a7ac8cc7-6bb8-4715-a79f-a14d2c04fee3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:22.974157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a7ac8cc7-6bb8-4715-a79f-a14d2c04fee3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:23.013846 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7ac8cc7-6bb8-4715-a79f-a14d2c04fee3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.071467 Oct 04 18:34:23.015134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3287/6680] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:34:22 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:34:31.836638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=45 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:31.841771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1480624029", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5b6b5a06-a4c2-4b8e-b316-2a09c3e45b63"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1459838130", "security_groups": [{"name": "tempest-secgroup-smoke-1156010339"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:31.963580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] validate_networks() for [('5b6b5a06-a4c2-4b8e-b316-2a09c3e45b63', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:34:32.182581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.491624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:34:32.492249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:34:32.492904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:34:32.494798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:34:32.495514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:34:32.509808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.510966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.511829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.513270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:32.513943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:32.514726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:32.563594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:34:32.573336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:34:32.588823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:34:32.591546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:34:32.654066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-037f1834-5ecb-436b-bdca-19ee7af2b72c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.819114 Oct 04 18:34:32.657170 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3394/6681] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:34:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:34:32.671142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-acee35fe-4e93-4439-b384-54fb0922b971 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:32.671906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-acee35fe-4e93-4439-b384-54fb0922b971 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:32.679363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.682864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:32.794700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-acee35fe-4e93-4439-b384-54fb0922b971 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:32.804218 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-acee35fe-4e93-4439-b384-54fb0922b971 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1267 microversion: 2.1 time: 0.136648 Oct 04 18:34:32.816054 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3288/6682] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:32 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:33.832327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:33.834361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:33.841935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.842720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.843365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.844286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:33.845066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:33.845702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:33.931421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:33.940184 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-debcbf50-1da5-4dfe-bbaf-e33260ce6045 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1319 microversion: 2.1 time: 0.113169 Oct 04 18:34:33.944365 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3395/6683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:33 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1319 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:34.965919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:34.966610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:34.979256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.979763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.980214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:34.983683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:34.983683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:34.983683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:35.123695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:35.136092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e43428c-0003-43b7-8b93-047b8a9d5726 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1325 microversion: 2.1 time: 0.174414 Oct 04 18:34:35.156100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3289/6684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:34 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1325 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.166191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:36.168000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:36.178526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.180268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.181869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.182939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.183955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.184635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.486207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:36.498410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-62dbaa30-bb30-4907-84a6-72a71cb7ee63 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.338525 Oct 04 18:34:36.498614 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3396/6685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:36 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:36.513968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:36.539970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:36.541550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:36.542077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:36.566500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] Creating event network-changed:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h2-831194-21 Oct 04 18:34:36.582268 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7b5a58a8-f22c-4783-9abd-2da3ac50585b req-c83530bb-27b8-4aa0-9c53-225ce1a0193c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071419 Oct 04 18:34:36.585196 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3290/6686] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:37.528964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:37.530449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:37.538581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.539147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.539942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.540924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:37.541569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:37.542272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:37.754178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:37.772012 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cda3fa89-f9ee-4408-978d-dc8ad255c098 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.246553 Oct 04 18:34:37.773096 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3397/6687] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:37 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:38.802185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:38.804254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:38.817600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.818663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.819514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:38.820364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:38.820859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:38.821282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:39.018785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:39.028569 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78525807-8de4-4fb9-b5e2-3063f1609442 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.232563 Oct 04 18:34:39.029178 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3291/6688] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:38 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:40.056182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:40.058158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:40.068697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.069187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.069779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.071406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:40.072576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:40.073219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:40.243575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:40.252384 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ea34f23-7298-4e72-a8e1-6d114f65e5b9 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.201572 Oct 04 18:34:40.253348 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3398/6689] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:40 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:41.276364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:41.277017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:41.283443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.283945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.284390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.285095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:41.285554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:41.286030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:41.446298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:41.455744 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9e98e201-d8db-4df8-a0d0-aa174fd36506 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.183653 Oct 04 18:34:41.456422 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3292/6690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:41 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:34:42.480732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:42.481557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:42.488789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.489134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.489778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.490536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:42.491004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:42.491502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:42.545473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:42.581674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:42.699519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:42.708706 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9aa639fd-8cb5-49d5-8a4b-b62d4d2665db tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.232513 Oct 04 18:34:42.709295 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3399/6691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:42 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:43.163334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "name": "network-vif-plugged", "status": "completed", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:43.171970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:34:43.177072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.177809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.178284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.194317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] Creating event network-vif-plugged:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h2-831194-21 Oct 04 18:34:43.201355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-05800f15-fd2f-4b61-814e-8b5920fec72b req-eb623110-6a84-4a97-a112-c7f7a579f3f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042150 Oct 04 18:34:43.202404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3293/6692] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:43.735342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:43.736051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:43.743150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.744161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.744622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.745801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:43.746308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:43.746757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:43.943726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:43.953435 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ddf1fd3-fde8-48f2-a3fa-f4423f7dac43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1393 microversion: 2.1 time: 0.222290 Oct 04 18:34:43.954051 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3400/6693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:43 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1393 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:44.978631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:44.979617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:44.986039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.986529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.986968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:44.987670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:44.988125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:44.988551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.138135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.148262 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48584fb1-9a9b-437e-ab23-4d5d449eff55 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1565 microversion: 2.1 time: 0.175776 Oct 04 18:34:45.148860 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3294/6694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:44 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1565 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:45.172219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:45.172862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:45.183417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.184286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.185123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.186427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:45.187271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:45.188317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:45.347720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:45.356570 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-827ce3b1-dde7-4bbd-bc28-a06819422c43 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1565 microversion: 2.1 time: 0.188190 Oct 04 18:34:45.357155 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3401/6695] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:45 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1565 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:34:47.521779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:34:47.522546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:34:47.524492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:34:47.530762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.531527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.532148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.533066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.533525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.534160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.542366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:34:47.542873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:34:47.543483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:34:47.558407 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] Creating event network-changed:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h2-831194-21 Oct 04 18:34:47.564013 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f5840355-1b44-4bfa-ad79-3ac4dd71d844 req-fcb83b5a-9a10-4b5c-969e-26ec7f53da41 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043390 Oct 04 18:34:47.564635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3402/6696] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:34:48.175808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:34:48.186963 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1e015ae-874a-4ddf-b907-53ed79fc966e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1565 microversion: 2.1 time: 0.670006 Oct 04 18:34:48.186963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3295/6697] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:34:47 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1565 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:09.554668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:09.557041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=46 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:09.561104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:09.563942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:09.574494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.574747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.575158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.575890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:09.576393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:09.577002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:09.648694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b6f593a-bdb0-4f80-b25e-1bf441314b0b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action" status: 200 len: 24574 microversion: 2.1 time: 0.096192 Oct 04 18:35:09.649653 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3403/6698] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:09 2022] POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action => generated 24574 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 18:35:20.722905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:20.723676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:20.726429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=17 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.727283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=34 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:20.734944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.735381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.735831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.736550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:20.737013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:20.737512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:20.880640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:20.895147 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e865a9b9-6705-412f-946c-a2184dd32e41 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1684 microversion: 2.1 time: 0.176113 Oct 04 18:35:20.895956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3296/6699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:20 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1684 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:21.018085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:21.020833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.026595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:21.026797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:21.031853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.032359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.032809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.033767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.034403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.034984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.121796 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fbd9a688-d077-4f45-bba0-f698e8759feb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action" status: 200 len: 32642 microversion: 2.1 time: 0.107755 Oct 04 18:35:21.127548 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3404/6700] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:21 2022] POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action => generated 32642 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:21.272230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:21.272930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.279639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.280236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.280753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.281530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.282144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.282644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.429890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47aa2c67-47ab-4b71-a1fe-8ab5e9ac00f2 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1837 microversion: 2.1 time: 0.161373 Oct 04 18:35:21.430730 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3297/6701] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:21 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1837 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:21.465088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:21.467691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:21.475050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.475560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.476013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.476760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:21.477231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:21.477669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:21.512895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lazy-loading 'flavor' on Instance uuid cfecb6ff-3e19-487b-a711-5017dda5801c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:35:21.525954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Going to try to live migrate instance to another host {{(pid=128849) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 04 18:35:22.967521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b2e37c2-8c14-47f4-be9b-2727b971e5c1 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action" status: 202 len: 0 microversion: 2.1 time: 1.507055 Oct 04 18:35:22.972356 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3405/6702] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:21 2022] POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action => generated 0 bytes in 1513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:22.977624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:22.978315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:22.987602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.988127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.988554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:22.989259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:22.989719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:22.990462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:23.179970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:23.191621 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-090fca13-08fd-4dd0-b4d1-42bf2cf17021 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.217943 Oct 04 18:35:23.192556 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3298/6703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:22 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:24.218950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:24.219610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:24.228011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.229121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.229863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.231072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.231379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.231962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.320506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "name": "network-vif-unplugged", "status": "completed", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:24.333885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:24.335546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:24.336361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:24.349581 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] Creating event network-vif-unplugged:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h2-831194-21 Oct 04 18:35:24.356062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6efb2afd-3793-40a0-928e-91679c4e6351 req-0908201e-346c-49bc-9374-5d4e7b318fe2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044970 Oct 04 18:35:24.357564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3299/6704] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:24.664031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:24.672545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92a8c41f-9240-4069-9e0f-93740cbc5546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.457820 Oct 04 18:35:24.673409 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3406/6705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:24 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:25.698202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:25.698776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:25.705920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.706421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.706867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.707577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:25.708132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:25.708751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:25.875747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:25.884009 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-684f5e54-badc-479d-8ee2-38467950f2df tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.191022 Oct 04 18:35:25.885786 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3300/6706] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:25 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:26.378876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:26.390685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.391188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.391638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.402850 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] Creating event network-changed:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h2-831194-21 Oct 04 18:35:26.407753 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3122d902-4604-4563-b8c0-af1f22f1af60 req-d54302bd-3040-4aab-ace4-24615eb509c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Oct 04 18:35:26.408354 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3407/6707] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:26.911038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:26.911704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:26.919461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.919944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.920509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:26.921233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:26.921867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:26.922432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.093665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:27.105213 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97324a18-15d5-47ae-a511-712738f2d164 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.199546 Oct 04 18:35:27.105918 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3301/6708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:26 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:27.887479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Calling method '.version_select at 0x7fbdbc70a790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:27.889339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.889885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.890347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.905980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.906482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.906943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.918595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:27.919090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:27.919546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:27.925589 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81b2472a-8095-4663-979f-0c83a74fbf14 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1653693883-project-admin] 10.222.0.42 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.177811 Oct 04 18:35:27.926200 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3408/6709] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:35:27 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:35:28.134869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:28.135644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:28.143036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.143452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.143900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.144620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:28.145083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:28.145522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:28.383859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:28.392478 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a14df43d-034d-44fb-a5ff-e4202290cfe3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.261834 Oct 04 18:35:28.402483 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3302/6710] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:28 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:29.422706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:29.423559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:29.430748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.431564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.432339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.433180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:29.433786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:29.434363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:29.636174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:29.644262 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b9092051-e839-4f88-b19a-e5f4a409d4d0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.225610 Oct 04 18:35:29.644852 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3409/6711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:29 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:30.669544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:30.671041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:30.682917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.683773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.684773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.686127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:30.686637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:30.687339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:30.958118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:30.966755 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-55486e60-cdd1-43c3-b473-3f1e42671794 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1694 microversion: 2.1 time: 0.302028 Oct 04 18:35:30.967453 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3303/6712] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:30 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1694 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:31.992839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:31.993534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.003925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.004383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.005434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.005567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.006060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.006503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.274475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.284003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1172897-c064-4bba-9253-33e37147429b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1684 microversion: 2.1 time: 0.295149 Oct 04 18:35:32.284604 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3410/6713] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:31 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1684 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.309432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.310074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.317018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.317515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.317988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.318701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.319161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.319591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.539276 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2022fbdc-6005-4c0f-ace8-3e1b8c291a55 tempest-TestNetworkAdvancedServerOps-1491972844 tempest-TestNetworkAdvancedServerOps-1491972844-project-admin] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1837 microversion: 2.1 time: 0.234071 Oct 04 18:35:32.540004 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3304/6714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1837 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.563967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:32.564621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.570810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.571318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.571807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.573792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.574370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.574862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.785495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:32.796473 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d94acb1-0581-49b6-bfe5-988109fa33c7 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1684 microversion: 2.1 time: 0.236621 Oct 04 18:35:32.797063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3411/6715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:32 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1684 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:32.908064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:32.910470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:32.918205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.918709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.919158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.919876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:32.920340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:32.920773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:32.978772 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ebf07226-2c1d-40b7-8632-8a489adda6c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action" status: 200 len: 38670 microversion: 2.1 time: 0.074162 Oct 04 18:35:32.980513 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3305/6716] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:35:32 2022] POST /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c/action => generated 38670 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:35:34.272779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.273389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.282099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:34.296932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.298172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.298915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.299731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.300390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.301043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.303996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.305169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.305874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.333433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] Creating event network-changed:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h1-831194-21 Oct 04 18:35:34.335929 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:35:34.342187 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-018e0497-501f-4457-aed8-68126a0a9582 req-194d480c-6fe1-4f2b-9ec2-2b726131be79 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064196 Oct 04 18:35:34.343404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3306/6717] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:34.483067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f333752-e275-4e9f-8c04-7cdab7ded546 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 204 len: 0 microversion: 2.1 time: 0.213705 Oct 04 18:35:34.484648 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3412/6718] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:35:34 2022] DELETE /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:35:34.494461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:34.495091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:34.506161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.506987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.507662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.508631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:34.510646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:34.511326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:34.977988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:34.990473 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d51e670-3721-4df7-8015-bec899826da2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 200 len: 1690 microversion: 2.1 time: 0.500815 Oct 04 18:35:35.007107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3307/6719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:34 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 1690 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:35.761262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfecb6ff-3e19-487b-a711-5017dda5801c", "name": "network-vif-deleted", "tag": "ff7d141a-d55f-414f-bf60-0a11ad6f15d0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:35.778238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:35.778823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:35.779595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:35.791558 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] Creating event network-vif-deleted:ff7d141a-d55f-414f-bf60-0a11ad6f15d0 for instance cfecb6ff-3e19-487b-a711-5017dda5801c on n-h1-831194-21 Oct 04 18:35:35.796898 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f215329a-3e4c-4e3f-ae8e-dde592a494e2 req-0efa097a-82d7-4461-9fb3-5af80b4248aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217061 Oct 04 18:35:35.798092 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3413/6720] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:36.017003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:36.017794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: cfecb6ff-3e19-487b-a711-5017dda5801c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:36.027001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.027947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.028329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.029270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:36.029737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:36.030198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:36.049204 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] HTTP exception thrown: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Request method failure captured: Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c HTTP/1.1 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHt-0BnwV2rFzV2hLLW2yaLqlHbGOJrThXPXVfij2tfnCzKqjxv7oMkGlVbQMqo1_1qeYIH56aDp3b2ijHpp5u35DmmSjyFglfemElCnGqSMxDe9pXwWx4lVvOek0GuKreknZH0OJ_pkDYjbqoIC-c0_Ug1emqp1Q567JpjK1DS5nDU Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dc578eb8835546d4a127279e3cd8a38b Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'cfecb6ff-3e19-487b-a711-5017dda5801c'} Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:35:36.050843 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Returning 404 to user: Instance cfecb6ff-3e19-487b-a711-5017dda5801c could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ee827fe4-bb39-4b55-b090-983313f7db1f tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c" status: 404 len: 111 microversion: 2.1 time: 0.039322 Oct 04 18:35:36.057952 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3308/6721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:36 2022] GET /compute/v2.1/servers/cfecb6ff-3e19-487b-a711-5017dda5801c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:35:39.713167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-45f375c5-8544-4a0f-b4eb-639e483bfef2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '.version_select at 0x7fbdbc72b9d0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:39.856356 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-45f375c5-8544-4a0f-b4eb-639e483bfef2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1459838130" status: 202 len: 0 microversion: 2.1 time: 0.156707 Oct 04 18:35:39.857591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3414/6722] 10.222.0.42 () {58 vars in 1284 bytes} [Tue Oct 4 18:35:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1459838130 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:35:39.905371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfce87e3-b810-4697-99f8-4cd5ba9c543a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: .version_select at 0x7fbdbc8d25e0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1649210468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJZTAydxcAuyrp0GocYR6auYeIdv0lPRzPWPhmTWKylMzKtqlEZ5vEWHZ8Oc6gtYLCbBjESLrszZUKwpSHK4bjmysRFuTxFpN4DQq4ETmehDEPLrrdqvOWS0nUIgQLCTQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:39.930071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bfce87e3-b810-4697-99f8-4cd5ba9c543a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:39.937215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bfce87e3-b810-4697-99f8-4cd5ba9c543a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:39.966373 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfce87e3-b810-4697-99f8-4cd5ba9c543a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.069060 Oct 04 18:35:39.967130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3309/6723] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:35:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:48.271894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:48.280190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1149919563", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "45a4393a-3c0e-4983-8469-906f41c2525b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1649210468", "security_groups": [{"name": "tempest-secgroup-smoke-2024344442"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:48.445113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] validate_networks() for [('45a4393a-3c0e-4983-8469-906f41c2525b', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:35:49.021744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:35:49.022338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:35:49.022950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:35:49.023450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:35:49.023985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:35:49.034192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.034706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.035159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.036273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:49.037029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:49.037716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:49.062874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:35:49.070995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Getting quotas for user dc578eb8835546d4a127279e3cd8a38b and project 9e9d5dc1f5c0477b9dc65646ef128999. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:35:49.091643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:35:49.094160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:35:49.169097 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1f7f1ed9-5c43-4588-a70a-ea8472a90505 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.899536 Oct 04 18:35:49.173898 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3415/6724] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:35:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:35:49.179604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=64 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:49.187300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b86271cd-94f3-4a55-bd9d-07e5120f1a33 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:49.188134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b86271cd-94f3-4a55-bd9d-07e5120f1a33 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:49.293112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b86271cd-94f3-4a55-bd9d-07e5120f1a33 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:49.308986 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b86271cd-94f3-4a55-bd9d-07e5120f1a33 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1267 microversion: 2.1 time: 0.131411 Oct 04 18:35:49.310672 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3310/6725] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:49 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1267 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:50.341504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:50.343293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:50.353006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.354525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.355335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.356375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:50.357238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:50.358582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:50.446171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:50.458598 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-463463c3-5e81-4bc3-b98d-0e61323f695a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1319 microversion: 2.1 time: 0.122580 Oct 04 18:35:50.459204 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3416/6726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:50 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1319 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:51.489639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:51.508671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:51.513361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:51.540381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.541326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.542184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.543844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:51.544652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:51.545375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:51.673249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:51.688774 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b5a5d58e-5673-4224-b193-c132859e7383 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1325 microversion: 2.1 time: 0.206177 Oct 04 18:35:51.689943 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3311/6727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:51 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1325 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:52.716601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:52.717355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:52.726854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:52.736942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.738084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.738628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:52.739623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:52.740082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:52.740651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.108290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:53.126198 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ae48d2c-5214-488a-a792-4f3bbde06fcf tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.413829 Oct 04 18:35:53.142126 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3417/6728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:52 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:53.242563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:53.259445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:53.260405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:53.261205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:53.278166 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] Creating event network-changed:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:35:53.286162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c9b90c99-accc-479a-bbc7-a2e38cd01943 req-bb7b672c-e582-4d28-a1db-4ce82d3d2334 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046928 Oct 04 18:35:53.287090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3312/6729] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:35:54.153092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:54.153804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:54.177897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.179028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.179348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.180140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:54.180626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:54.180626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:54.429584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:54.444409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25f4490d-1d62-497c-9a56-7d633af280bb tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.295459 Oct 04 18:35:54.445668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3418/6730] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:54 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:55.490819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:55.501388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:55.530465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.535883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.536716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.537765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:55.543069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:55.543852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:55.889615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:55.903871 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c6a30e3d-d4e9-4042-adb6-3fdc2efa8d01 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.422442 Oct 04 18:35:55.904968 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3313/6731] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:55 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:56.932110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:56.933700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:56.943688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.953170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.954399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:56.955821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:56.956849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:56.957580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:57.220476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:57.230541 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99d0ccb9-dbbd-44c2-9afd-feb99f86dd37 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.302416 Oct 04 18:35:57.231774 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3419/6732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:56 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:35:58.267566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:58.282340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:58.302516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.303493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.305864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.307560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:58.310963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:58.311764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:58.696658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:35:58.712450 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e9c9e490-32fc-4163-9938-b0a04cc3da00 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.457367 Oct 04 18:35:58.716179 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3314/6733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:58 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:35:59.722923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "name": "network-vif-plugged", "status": "completed", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:35:59.730705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:59.743768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:35:59.744292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:59.745556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:35:59.757749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:35:59.762678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.763331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.763657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.764446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.765732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.768282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.774492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:35:59.788162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:35:59.788627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:35:59.797884 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] Creating event network-vif-plugged:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:35:59.808237 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a6c64d00-bb98-4ec1-95bb-98b119fe7875 req-6f1fc07d-ed8e-4e23-b70f-cd8b4c6e4fe7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088832 Oct 04 18:35:59.809251 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3420/6734] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:00.231080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:00.247759 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f790aea4-31f2-40cd-be8c-ce07383c43fe tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1393 microversion: 2.1 time: 0.510919 Oct 04 18:36:00.253076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3315/6735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:35:59 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1393 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:01.287113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.288450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.300942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.301757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.302431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.306811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.307705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.308477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.504946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.515404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cc57bc5-2100-4cf3-9754-c0cc1e95576c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1566 microversion: 2.1 time: 0.234003 Oct 04 18:36:01.516158 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3421/6736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1566 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:01.540515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:01.541851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:01.549305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.549888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.550356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.551167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:01.551945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:01.552391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:01.784830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:01.794300 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12ecd258-9af6-4ed2-909c-448eb9155124 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1566 microversion: 2.1 time: 0.257925 Oct 04 18:36:01.810271 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3316/6737] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:01 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1566 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:02.026352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1987791835", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-268794580", "security_groups": [{"name": "tempest-secgroup-smoke-1873706191"}], "block_device_mapping_v2": [{"uuid": "08ec19ce-025b-40d7-8c26-96d35fc0d0c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:02.192963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] validate_networks() for [('b6782cbc-08ee-4e71-bbc2-9ebb1aa9cede', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:36:02.945156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:02.946582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:02.947428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:02.948345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:02.948898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:02.960244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.961071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.961754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.962793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:02.963667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:02.964589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:02.991184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:36:03.001424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Getting quotas for user f47a20c5663c4e06b73d20943faba14c and project d1e72d0958f849eeb547a5989ea40167. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:36:03.118335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:36:03.121233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='08ec19ce-025b-40d7-8c26-96d35fc0d0c4',volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:36:03.311499 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c23172b-4ecd-4ec4-acdb-a77fc0f6f94e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.290331 Oct 04 18:36:03.312967 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3422/6738] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:36:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:36:03.325024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-61b358af-d7da-40a1-a3ba-1f84d213bc8e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:03.326581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-61b358af-d7da-40a1-a3ba-1f84d213bc8e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:03.404389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-61b358af-d7da-40a1-a3ba-1f84d213bc8e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:03.418400 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-61b358af-d7da-40a1-a3ba-1f84d213bc8e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1094 microversion: 2.1 time: 0.097617 Oct 04 18:36:03.419794 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3317/6739] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:03 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1094 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:04.442001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:04.444151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:04.453511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.454843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.456617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.458691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:04.459590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:04.460285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:04.583180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:04.606843 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6920603-8254-4535-986b-a4cd03e52113 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1192 microversion: 2.1 time: 0.164193 Oct 04 18:36:04.609135 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3423/6740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:04 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1192 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.245165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:05.247031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.248798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.272278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.274855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.276180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.276913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.280421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.281673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.296095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.300672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.305809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.334858 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] Creating event network-changed:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:36:05.350415 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-9dc0dbb0-8acf-437b-8a31-d8af9c91f9bd req-330f0173-6fff-42d3-b80c-82d0beddf892 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117750 Oct 04 18:36:05.357260 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3424/6741] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:05.638370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:05.639184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:05.647094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.647687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.648454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.649247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:05.649779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:05.650829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:05.661300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.675817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8835a3b7-91f9-48b2-bdbb-8a908bc05a2b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1684 microversion: 2.1 time: 0.448792 Oct 04 18:36:05.689055 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3318/6742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1684 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:05.882617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:05.896553 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-472461a5-eb48-46cf-b4ac-fa60ad9976cd tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1210 microversion: 2.1 time: 0.263515 Oct 04 18:36:05.914631 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3425/6743] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:05 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1210 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:06.930355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:06.932812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:06.946487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.950276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.953859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:06.957342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:06.958237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:06.959952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.329703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:07.339786 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-31daabaf-5b39-4ccc-a523-09e88917502c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1278 microversion: 2.1 time: 0.416262 Oct 04 18:36:07.351528 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3319/6744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:06 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1278 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:07.859149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f482fa49-fb0f-47e2-bfd3-c05e3b7952c1", "tag": "c2ae1faf-7655-407b-ae08-e12494234042"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:07.875892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:07.877324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:07.880163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:07.902512 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] Creating event network-changed:c2ae1faf-7655-407b-ae08-e12494234042 for instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 on n-h1-831194-21 Oct 04 18:36:07.912935 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-463e802e-ef47-4323-bbb4-29f66ab116a6 req-c7220961-662a-4277-bd45-7373866e3ce5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059900 Oct 04 18:36:07.914412 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3426/6745] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:08.368672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:08.370387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:08.387502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.388194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.390521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:08.391547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:08.392252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:08.393807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:09.068859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:09.087128 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-570f4179-98ea-4f93-b909-3e58d72218d4 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1278 microversion: 2.1 time: 0.722126 Oct 04 18:36:09.089330 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3320/6746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:08 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1278 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:10.116972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:10.117735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:10.125240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.126056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.126523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.127259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:10.127740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:10.128342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:10.280396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:10.289611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4b28bff-c61b-47cd-86c7-dc88cdfb6af1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1278 microversion: 2.1 time: 0.176961 Oct 04 18:36:10.290686 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3427/6747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:10 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:11.312974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:11.313585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:11.319527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.320022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.320458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.321273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:11.321728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:11.323949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:11.482915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:11.491836 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-836c9899-7734-41e0-ade6-fe4de4c95bd6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.183081 Oct 04 18:36:11.492416 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3321/6748] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:11 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:12.530015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:12.530601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:12.537964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.538477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.538937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.539663 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:12.540138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:12.540580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:12.790128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:12.800522 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68ee71d3-19c3-4585-b963-e553c27e52b6 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.274456 Oct 04 18:36:12.801400 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3428/6749] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:12 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:13.824970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:13.825640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:13.828904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:13.834892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.835392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.835862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.836584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:13.837042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:13.837477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:13.994452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:14.002307 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-64131793-a315-4720-b2cc-5505efab0803 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.181881 Oct 04 18:36:14.002870 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3322/6750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:13 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:15.030968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:15.031696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:15.033994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:15.034912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:15.044495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.044995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.045649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.046407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:15.046875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:15.047315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:15.301434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:15.310300 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b13d41c-19da-4d84-99b2-0b5e5add6c05 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.285070 Oct 04 18:36:15.310886 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3429/6751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:15 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:16.333329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:16.334175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:16.341991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.342487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.342927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.343633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:16.344121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:16.344550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:16.502505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:16.511415 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-246b6a59-c1e9-45d8-a01a-03286d3ea947 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.181921 Oct 04 18:36:16.512019 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3323/6752] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:16 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:17.538498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:17.540254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:17.552919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.554110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.554684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.555983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:17.557168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:17.559148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:17.808137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:17.817243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5a93170-37bb-4052-977b-cfaa4ec96a4e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.285528 Oct 04 18:36:17.817775 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3430/6753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:17 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:18.848254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:18.849494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:18.862846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.863125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.863663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:18.864456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:18.864978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:18.865422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:19.156442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:19.165383 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37d0a393-33c7-4352-b921-974f3b2e8669 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.323458 Oct 04 18:36:19.166464 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3324/6754] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:18 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:20.189048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:20.190553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:20.204617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.205132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.205584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.206337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:20.206977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:20.208717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:20.218042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=77 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:20.365203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:20.375729 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9aff1712-d756-4cf7-af32-85b64aac593d tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.190528 Oct 04 18:36:20.376991 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3431/6755] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:20 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:21.402405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:21.403037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:21.410263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.410907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.411514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.412583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:21.413041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:21.413457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:21.418337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=75 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:21.565282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:21.575020 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-797e47bb-656a-4dea-89be-32b52f6f2e90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.178940 Oct 04 18:36:21.575609 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3325/6756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:21 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:22.207902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f482fa49-fb0f-47e2-bfd3-c05e3b7952c1", "name": "network-vif-plugged", "status": "completed", "tag": "c2ae1faf-7655-407b-ae08-e12494234042"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:22.219987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.220593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.221128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.236158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] Creating event network-vif-plugged:c2ae1faf-7655-407b-ae08-e12494234042 for instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 on n-h1-831194-21 Oct 04 18:36:22.243077 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-aa98e4d5-68c1-4c3b-a22b-e1fa1c688cb5 req-1b7db4ec-60df-4680-b880-10638ef0fd22 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038825 Oct 04 18:36:22.244716 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3432/6757] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:22.602423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:22.604212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:22.608945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:22.618047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.618931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.620238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.621497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:22.622378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:22.623174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:22.794738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:22.803440 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5fdc5c0e-10e8-4d26-bbee-401eec4ccf89 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1266 microversion: 2.1 time: 0.207956 Oct 04 18:36:22.804032 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3326/6758] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:22 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:23.829599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:23.830463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:23.832643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:23.839304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.839829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.840293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:23.841035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:23.841515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:23.842011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.038702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.053649 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87015edc-cfd7-48ab-a427-c4af2922550c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1453 microversion: 2.1 time: 0.230025 Oct 04 18:36:24.054854 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3433/6759] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:23 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1453 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:24.093304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:24.093960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:24.103053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.104387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.105020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.105758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:24.106248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:24.106685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:24.330615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:24.341241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0510404b-114e-47a4-84e2-61b137148e36 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1453 microversion: 2.1 time: 0.251983 Oct 04 18:36:24.341891 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3327/6760] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:24 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1453 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:26.251916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:26.257187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:26.271843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.272906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.273593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.274843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.275540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.276168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.356135 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9e0af149-1581-4c15-9f20-f6972028cc8a tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action" status: 200 len: 24572 microversion: 2.1 time: 0.113630 Oct 04 18:36:26.357199 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3434/6761] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:26 2022] POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action => generated 24572 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:36:26.536438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f482fa49-fb0f-47e2-bfd3-c05e3b7952c1", "tag": "c2ae1faf-7655-407b-ae08-e12494234042"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:26.558215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:26.559560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:26.560673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:26.589316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] Creating event network-changed:c2ae1faf-7655-407b-ae08-e12494234042 for instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 on n-h1-831194-21 Oct 04 18:36:26.597578 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-10e0db66-47e1-4e95-baf0-a9fb6cacad1d req-a9befc27-d1ba-4bfe-b14a-358ebe39fecf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067854 Oct 04 18:36:26.598905 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3328/6762] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:36:37.393587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:37.397140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.399943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.400618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=17 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.410417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.410932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.411379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.412105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.412579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.413021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.510572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:36:37.511013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:36:37.511509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:36:37.511950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:36:37.512378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:36:37.577358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.583914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.584442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.584906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.585937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.586416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.586869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.621243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9db50b72-b27a-433f-b4f0-1536d83716c3 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action" status: 202 len: 1138 microversion: 2.1 time: 0.231890 Oct 04 18:36:37.622471 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3435/6763] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:36:37 2022] POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action => generated 1138 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 04 18:36:37.642171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.643509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=19 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:36:37.649388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:37.651176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:37.658387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.658925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.659458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.660269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:37.660781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:37.661303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:37.816238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:37.825120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-682a3bab-81b0-43be-a898-289d8489ab90 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.185140 Oct 04 18:36:37.825716 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3329/6764] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:37 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:38.853655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:38.855512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:38.864635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.865348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.865574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:38.866767 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:38.867019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:38.868697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:39.032147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:39.040497 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-209ff7c4-1b3f-4025-8d4d-fbefac7a90cd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.194313 Oct 04 18:36:39.041124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3436/6765] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:38 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:40.066647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:40.067288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:40.076076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.076780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.077407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.078589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:40.079231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:40.079954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:40.271686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:40.284244 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-88f6b9b5-ba28-4448-96f7-6333a2d0f969 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.222611 Oct 04 18:36:40.284888 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3330/6766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:40 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:41.316446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:41.317199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:41.327550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.327550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.327550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.327550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:41.328013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:41.328416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:41.514967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:41.523028 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13616e22-fd26-44e3-9d24-8304b53c34e1 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.211288 Oct 04 18:36:41.523613 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3437/6767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:41 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:42.549747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:42.551477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:42.560355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.561009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.561484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.562402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:42.562909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:42.563572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:42.729573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:42.737638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-229f4fe9-ea7d-4fc0-9cdc-7d709ed31a93 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.192962 Oct 04 18:36:42.738579 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3331/6768] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:42 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:43.765244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:43.766227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:43.774753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.775272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.776381 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.777123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:43.777603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:43.778086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:43.964170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:43.975673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81bf9850-04cf-4785-8720-faa009474a9e tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.214544 Oct 04 18:36:43.987761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3438/6769] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:43 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:45.005667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:45.007515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:45.017872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.018685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.019216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.020023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:45.020520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:45.021020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:45.221425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:45.236687 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b390b98-8d60-4c61-b929-fb4ce18c75e6 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.236465 Oct 04 18:36:45.237630 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3332/6770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:44 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:46.269685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:46.270591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:46.279666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.280174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.280977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.282400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:46.282904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:46.283361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:46.439058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:46.454268 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d563911-2121-48df-92b7-7f70e1a5a819 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.189797 Oct 04 18:36:46.455034 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3439/6771] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:46 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:47.484881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:47.485538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:47.493739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.494157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.495047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.495893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:47.496368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:47.496798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:47.661788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:47.671515 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab89e232-0512-4ad8-a6bd-45be13bbc5b5 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.190501 Oct 04 18:36:47.672149 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3333/6772] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:47 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:48.696409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:48.697085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:48.705430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.705984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.706451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.707174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:48.707653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:48.708103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:48.847126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:48.855747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-659529f4-3a19-43f1-abdc-3ff4fdbc82dc tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.163275 Oct 04 18:36:48.856320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3440/6773] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:48 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:49.883000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:49.883809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:49.893081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.893615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.894119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:49.894872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:49.895338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:49.895775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:50.059284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:50.074247 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-722ff235-0fd9-4533-bcd6-e333b0ed7049 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.197307 Oct 04 18:36:50.074844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3334/6774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:49 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:51.107671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:51.108304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:51.115811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.116325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.116795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.117585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:51.118110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:51.118610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:51.278239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:51.286464 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b91d010d-703b-4251-b4b5-69feb051b11c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.182930 Oct 04 18:36:51.287825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3441/6775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:51 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:52.313373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:52.314158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:52.322382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.322893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.323514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.324073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:52.324540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:52.324976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:52.465631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:52.475120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-209447c7-4e80-416b-b8b8-edde7965e21c tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.166283 Oct 04 18:36:52.476003 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3335/6776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:52 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:53.499956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:53.500596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:53.507903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.508415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.508880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.509604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:53.510274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:53.510746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:53.662545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:53.671993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56434d19-2a79-4e57-a3bb-a179a35286ad tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1693 microversion: 2.1 time: 0.175936 Oct 04 18:36:53.672589 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3442/6777] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:53 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:54.696195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:54.696839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:54.704760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.705260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.705712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.706446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:54.706910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:54.707344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:54.844396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:54.852404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2e412a45-122c-4101-bc70-57b43f75d423 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1699 microversion: 2.1 time: 0.160259 Oct 04 18:36:54.852983 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3336/6778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:54 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:55.877568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:55.878299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:55.885759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.886351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.886814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:55.887545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:55.888019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:55.888475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:56.026512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:56.040005 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87a18a76-8e83-44cd-a7c5-78a919cfc3a0 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1699 microversion: 2.1 time: 0.166301 Oct 04 18:36:56.040596 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3443/6779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:55 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1699 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:36:57.066956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:36:57.067613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:36:57.084072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.085140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.085140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.086824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:57.087640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:57.088987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:57.291300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:36:57.301197 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68bb1860-eafe-4166-84b6-2ab35a66c4f2 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1684 microversion: 2.1 time: 0.239795 Oct 04 18:36:57.303379 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3337/6780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:36:57 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1684 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:36:58.052872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "name": "network-vif-unplugged", "status": "completed", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:36:58.065695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:36:58.066238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:36:58.066697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:36:58.080640 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] Creating event network-vif-unplugged:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:36:58.086469 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a826847d-882a-47ba-8425-6cc4d2faa4b4 req-546cf646-3b35-42f2-8a97-a4fb78d002ec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.214497 Oct 04 18:36:58.087087 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3444/6781] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:00.101076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "name": "network-vif-plugged", "status": "completed", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:00.111657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:00.112150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:00.115169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:00.124937 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] Creating event network-vif-plugged:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:37:00.130178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-18b5e55b-8933-4422-887d-43ce737e9ad5 req-42048e03-bf26-4ff4-81d7-9e8d1704f49e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032974 Oct 04 18:37:00.131236 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3338/6782] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:21.522313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=24 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.523261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:21.529148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:21.531469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:21.538810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.539309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.539765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.540478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:21.540950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:21.542149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:21.613599 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a6f9ad5-b088-487b-980b-8b10bfe30a70 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action" status: 200 len: 24572 microversion: 2.1 time: 0.093506 Oct 04 18:37:21.620697 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3445/6783] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:37:21 2022] POST /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77/action => generated 24572 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 18:37:30.306446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1598931318", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:30.314363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=20 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:30.315015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=56 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:30.362895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] validate_networks() for None {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:30.949163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:30.949607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:30.950138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:30.950593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:30.951019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:30.960287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.960784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.961225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.962019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:30.962482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:30.962919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:30.982249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Getting quotas for project d3e39e04d7ca4767997631ca9843e729. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:30.987766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Getting quotas for user c0629bab0ae24692aea615920690c5d4 and project d3e39e04d7ca4767997631ca9843e729. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:31.001609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:31.003991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:31.051267 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ac6b621-ba23-4785-b26f-e25182f0c535 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749243 Oct 04 18:37:31.051932 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3339/6784] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:31.064120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d39295f2-d69b-4aac-9913-584a64b7fa22 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:31.064930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d39295f2-d69b-4aac-9913-584a64b7fa22 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:31.132386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d39295f2-d69b-4aac-9913-584a64b7fa22 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:31.140809 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d39295f2-d69b-4aac-9913-584a64b7fa22 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1214 microversion: 2.1 time: 0.081284 Oct 04 18:37:31.141387 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3446/6785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:31 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:32.166905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:32.167621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:32.174000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.174626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.175077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.175780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:32.176242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:32.176675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:32.242787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:32.251405 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ff22287-9361-406f-ae46-f15ef6284127 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1266 microversion: 2.1 time: 0.090647 Oct 04 18:37:32.251995 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3340/6786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:32 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.276796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.277448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.280038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:33.285684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.286224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.286680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.287406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.288072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.288682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.361546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:33.370159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9fe09100-6e5c-4721-bee4-8ae212451572 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1272 microversion: 2.1 time: 0.097876 Oct 04 18:37:33.370859 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3447/6787] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:33.526448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:33.532563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.535397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.537450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.537972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.538611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.551947 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] Creating event network-changed:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:37:33.553746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.554349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.555209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.556167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.558133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.558435 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a3941866-31ad-4221-af05-5a93647ff18c req-2d69e735-2ae3-47bf-9516-c055559113fb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036090 Oct 04 18:37:33.559048 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3448/6788] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:33.559424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.597215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:37:33.693677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d46f6850-0b3f-43de-97c0-60d2829a6e51 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 204 len: 0 microversion: 2.1 time: 0.172807 Oct 04 18:37:33.699608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3341/6789] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:37:33 2022] DELETE /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:37:33.708982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:33.709581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:33.717267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.718101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.718817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:33.719879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:33.720581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:33.721106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.022250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.030598 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2e439f4-81a0-4478-995a-a97bab5c72dd tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1690 microversion: 2.1 time: 0.325945 Oct 04 18:37:34.031185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3449/6790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:33 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1690 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:34.394760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:34.395679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:34.403421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.403939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.404416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.405188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.405677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.406126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.562841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:34.570670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-67b29a52-928c-409b-a0ea-fe7a8a754241 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.180240 Oct 04 18:37:34.571255 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3342/6791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:34 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:34.746667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e34fa93f-b86b-4e30-bbd6-aa38aa278f83", "tag": "6a6e5773-9aa1-4d36-addd-d85c0f0689b0"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:34.760996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:34.761755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:34.762379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:34.772629 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] Creating event network-changed:6a6e5773-9aa1-4d36-addd-d85c0f0689b0 for instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 on n-h2-831194-21 Oct 04 18:37:34.777608 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f5c8c332-71fd-4698-b1db-aba251a23c39 req-f00db8d3-4dc2-48ce-a96a-12f359864a3c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176527 Oct 04 18:37:34.778220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3450/6792] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:35.056010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.056550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.063424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.063921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.064377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.065086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.065547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.066026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.266338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.274517 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc53954d-0bf7-4d4e-8cb1-c29a81ca9b83 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1690 microversion: 2.1 time: 0.222512 Oct 04 18:37:35.275577 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3343/6793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:35.596024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:35.596761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:35.607293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.607806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.608266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.609556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.609556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.609908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.739428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6e840a3-e4c7-4fa8-82f1-b5827bafdb77", "name": "network-vif-deleted", "tag": "a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:35.750132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:35.750611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:35.751132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:35.766745 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] Creating event network-vif-deleted:a2cabf90-b2a4-4c06-bcd1-1d53d3e94b98 for instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 on n-h2-831194-21 Oct 04 18:37:35.771469 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-31713b0e-ba48-4536-8225-5c9b12b2d513 req-5ce180eb-0cc6-47ad-a5c4-2eee9f999790 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036571 Oct 04 18:37:35.772317 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3344/6794] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:37:35.831723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:35.841815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b8131ff-48a6-4d68-9ac8-6e6edb445598 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.249930 Oct 04 18:37:35.842840 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3451/6795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:35 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.300334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.300959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.307295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.307871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.308316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.309011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.309472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.309935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.340943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.341425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.341888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.342340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lazy-loading 'fault' on Instance uuid f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:37:36.384747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc578eb8835546d4a127279e3cd8a38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9d5dc1f5c0477b9dc65646ef128999', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:36.392430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1bb1556e-7e90-460b-a550-da850b7246ce tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 200 len: 1357 microversion: 2.1 time: 0.096409 Oct 04 18:37:36.393006 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3345/6796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 1357 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:36.864724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:36.865362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:36.872480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.872983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.873438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:36.874186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:36.874656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:36.875099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.015654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:37.024233 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc0352ea-1345-4919-aaaf-e3792af508a2 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.163080 Oct 04 18:37:37.024972 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3452/6797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:36 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:37.416717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:37.417537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] [instance: f6e840a3-e4c7-4fa8-82f1-b5827bafdb77] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:37.424116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.424603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.425042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.425735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:37.426230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:37.426646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:37.440628 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] HTTP exception thrown: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Request method failure captured: Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 HTTP/1.1 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHt-0BnwV2rFzV2hLLW2yaLqlHbGOJrThXPXVfij2tfnCzKqjxv7oMkGlVbQMqo1_1qeYIH56aDp3b2ijHpp5u35DmmSjyFglfemElCnGqSMxDe9pXwWx4lVvOek0GuKreknZH0OJ_pkDYjbqoIC-c0_Ug1emqp1Q567JpjK1DS5nDU Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e9d5dc1f5c0477b9dc65646ef128999"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9e9d5dc1f5c0477b9dc65646ef128999 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1829697922 Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: dc578eb8835546d4a127279e3cd8a38b Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1829697922-project Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'f6e840a3-e4c7-4fa8-82f1-b5827bafdb77'} Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.442295 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Returning 404 to user: Instance f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5392138e-b30f-4142-8a81-12d3a69a4592 tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77" status: 404 len: 111 microversion: 2.1 time: 0.031609 Oct 04 18:37:37.448092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3346/6798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:37 2022] GET /compute/v2.1/servers/f6e840a3-e4c7-4fa8-82f1-b5827bafdb77 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:37:38.047661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:38.048283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:38.055466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.055978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.056458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.058164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:38.058705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:38.059155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:38.313163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:38.320932 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f86c0530-4c8d-4339-90bc-74e6a6fa2c8e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.277331 Oct 04 18:37:38.321500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3453/6799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:38 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:39.344893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:39.345526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:39.352745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.353248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.353727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.354473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:39.355040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:39.356762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:39.579898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:39.589098 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cf3c1afb-ae63-46a1-a6b1-9040bc99e811 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.247656 Oct 04 18:37:39.589783 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3347/6800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:39 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:40.615255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:40.615889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:40.626843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.629947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.630413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.634418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:40.635823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:40.636292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:40.951921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:40.960744 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ad8bfb39-b4d4-4603-97e1-5b27a867754e tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.349375 Oct 04 18:37:40.961401 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3454/6801] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:40 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:41.286158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0d86112d-46cc-4718-8826-9266fdb39b3b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] Calling method '.version_select at 0x7fbdc1dbbc10>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.292131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:41.292959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:41.309532 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0d86112d-46cc-4718-8826-9266fdb39b3b tempest-TestNetworkAdvancedServerOps-1829697922 tempest-TestNetworkAdvancedServerOps-1829697922-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649210468" status: 202 len: 0 microversion: 2.1 time: 0.027831 Oct 04 18:37:41.313956 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3348/6802] 10.222.0.42 () {58 vars in 1284 bytes} [Tue Oct 4 18:37:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1649210468 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:37:41.988362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:41.988997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:41.991007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:41.997979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:41.998524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:41.998981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.000030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.000713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.001200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.155069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:42.165192 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8b9304a3-7cd5-4f58-9b5c-4435d97e9576 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.180461 Oct 04 18:37:42.167246 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3455/6803] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:41 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:42.191809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34fa93f-b86b-4e30-bbd6-aa38aa278f83", "name": "network-vif-plugged", "status": "completed", "tag": "6a6e5773-9aa1-4d36-addd-d85c0f0689b0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:42.203151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:42.203996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:42.204343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:42.222756 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] Creating event network-vif-plugged:6a6e5773-9aa1-4d36-addd-d85c0f0689b0 for instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 on n-h2-831194-21 Oct 04 18:37:42.227839 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-0c75a146-814f-498a-9e40-528958a44e22 req-463e1e7c-0d6d-463c-8b86-8268629337b6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039600 Oct 04 18:37:42.228674 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3349/6804] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:43.189033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:43.189665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:43.196476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.196982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.198194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.198919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:43.199462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:43.199836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:43.342475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:43.350728 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-81221098-9b1e-48d2-9393-d6a919440857 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1314 microversion: 2.1 time: 0.165535 Oct 04 18:37:43.351315 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3456/6805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:43 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.376061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:44.377790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.384564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.385655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.385965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.386667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.387131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.387596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.533669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:44.541969 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ed5315c-3faf-407e-8b51-526b116a6342 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1462 microversion: 2.1 time: 0.170978 Oct 04 18:37:44.542562 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3350/6806] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:44 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1462 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:37:44.565733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fd13404-c7d5-42cb-b1af-c78f1abc7114", "device": "/dev/sdb"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:44.568715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:44.577242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.577784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.578349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.579122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:44.579647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:44.580111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:44.876954 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6802f7fc-a0e5-49e9-95d4-a8cbd8ef92c0 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "POST /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315876 Oct 04 18:37:44.877670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3457/6807] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:37:44 2022] POST /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:56.418409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:56.419211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:56.628945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a842aef-a0aa-40a3-a0e5-f24feda3bbc0 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Action: 'create', calling method: .version_select at 0x7fbdbd0f9310>, body: {"keypair": {"name": "tempest-TestServerBasicOps-555319139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOJDRrddoau0UFHUliZTOg8SJf/zUCk1QcgcufCGxStmw/ht1lnyAAtExiaA3766assp4RuBo4OetkyOh88bm448qQxcjs0IGGaIybvKBm8V8Y+spnI+LTzYFbhq6UQV3g=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:56.652724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1a842aef-a0aa-40a3-a0e5-f24feda3bbc0 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for project 2184ac42370f4575a207559652c788f1. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:56.660117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1a842aef-a0aa-40a3-a0e5-f24feda3bbc0 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for user 7f74bdb391ec4f78b77ad5eff138b41d and project 2184ac42370f4575a207559652c788f1. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:56.710946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a842aef-a0aa-40a3-a0e5-f24feda3bbc0 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.296566 Oct 04 18:37:56.711661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3351/6808] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:37:56 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:37:57.819264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=28 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:57.820927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:37:57.828596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1357183330", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-555319139", "security_groups": [{"name": "tempest-secgroup-smoke-1245521149"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "22e976a1-346d-4b07-beb3-7eb868262f43"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:37:57.987243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] validate_networks() for [('22e976a1-346d-4b07-beb3-7eb868262f43', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:37:58.761484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for project 2184ac42370f4575a207559652c788f1. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:58.768291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for user 7f74bdb391ec4f78b77ad5eff138b41d and project 2184ac42370f4575a207559652c788f1. Resources: dict_keys(['metadata_items']) {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:58.785462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:37:58.786385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:37:58.787130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:37:58.787817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:37:58.788362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:37:58.798709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.799368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.799831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.802001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:37:58.802604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:37:58.803101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:37:58.829848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for project 2184ac42370f4575a207559652c788f1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:37:58.834139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Getting quotas for user 7f74bdb391ec4f78b77ad5eff138b41d and project 2184ac42370f4575a207559652c788f1. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:37:58.850563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:37:58.853464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:37:58.912423 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-34dfa7e0-9c7e-4565-934e-a56a59413fc4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.095111 Oct 04 18:37:58.917576 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3458/6809] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:37:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:37:58.930590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8b8d483-8feb-4b89-b148-bfee83a4e9c3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:37:58.935913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8b8d483-8feb-4b89-b148-bfee83a4e9c3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:37:59.041232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c8b8d483-8feb-4b89-b148-bfee83a4e9c3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:37:59.049805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8b8d483-8feb-4b89-b148-bfee83a4e9c3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1302 microversion: 2.1 time: 0.126716 Oct 04 18:37:59.050412 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3352/6810] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:37:58 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1302 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:00.086041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:00.086839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:00.094471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.095370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.095891 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.096857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:00.097394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:00.097936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:00.171460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:00.184291 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a0fe830-4183-4a99-8df8-121cb5c49467 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1354 microversion: 2.1 time: 0.108193 Oct 04 18:38:00.184873 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3459/6811] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:00 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:01.209237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:01.209912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:01.226253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.226788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.227222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.227948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:01.228496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:01.229606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:01.522983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:01.532894 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-af752fa1-d9da-42ed-b510-4d1298c1424e tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.328090 Oct 04 18:38:01.546400 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3353/6812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:01 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:02.561438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:02.562997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:02.578616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.579106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.579579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.580266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.580913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.581357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.606838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b601a69c-b756-4a2f-bddf-644e8f34df3f", "tag": "7c038bca-630d-4860-8966-64530c94ccf8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:02.624106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:02.629102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:02.629794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:02.653503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] Creating event network-changed:7c038bca-630d-4860-8966-64530c94ccf8 for instance b601a69c-b756-4a2f-bddf-644e8f34df3f on n-h1-831194-21 Oct 04 18:38:02.662469 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c7767bc4-dd74-4586-922a-aa8d68b61717 req-f4ece026-6fa6-40ee-99ba-449caa5e8c7f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059225 Oct 04 18:38:02.663946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3354/6813] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:02.779294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:02.788408 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a55c343-e76e-4a6d-933b-8eae2be550b2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.233932 Oct 04 18:38:02.804984 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3460/6814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:02 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:03.814902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:03.816226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:03.824878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.825626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.826258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:03.827159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:03.827775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:03.828533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:04.070915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:04.090230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c6de488b-a7b2-4fbd-884f-f586e57d19bf tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.280533 Oct 04 18:38:04.091108 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3355/6815] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:03 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:05.115400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:05.116876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:05.132451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.132451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.134658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.134658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:05.134658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:05.137095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:05.287756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:05.297720 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3266dc9e-5393-45e3-b833-5f81183e0d15 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.186854 Oct 04 18:38:05.298581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3461/6816] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:05 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:06.321670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:06.323225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:06.330707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.331441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.331890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.332789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:06.333259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:06.333915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:06.498577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:06.522045 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-08918add-2841-4afb-95e1-9a805e446f25 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.190045 Oct 04 18:38:06.522045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3356/6817] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:06 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.532976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.533606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.540530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.541609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.542628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.543572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.544048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.544698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.733123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:07.742503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b22922a1-4eeb-4e41-b4e1-9918144998a3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.213491 Oct 04 18:38:07.743802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3462/6818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:07 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:07.805305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:07.806424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:07.812725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f482fa49-fb0f-47e2-bfd3-c05e3b7952c1", "tag": "c2ae1faf-7655-407b-ae08-e12494234042"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:07.816425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.817087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.817790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.824355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.825503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.826199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.835689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:07.838439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:07.839757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:07.840267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] Creating event network-changed:c2ae1faf-7655-407b-ae08-e12494234042 for instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 on n-h1-831194-21 Oct 04 18:38:07.848319 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7d6cc2d5-80f1-474e-8249-cdb37648355e req-0cc589d7-a81f-4a57-a499-91de6a0098ca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039288 Oct 04 18:38:07.853026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3463/6819] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:07.896362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:08.004719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0e34dd89-f7ea-4b4b-8599-d16f2fee065b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 204 len: 0 microversion: 2.1 time: 0.203612 Oct 04 18:38:08.006383 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3357/6820] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:07 2022] DELETE /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:08.016797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.017933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.028090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.028941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.029584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.030578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.031313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.032094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.183826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.193622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ad3b21a-a188-43d9-b221-4fc387d6a641 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1578 microversion: 2.1 time: 0.181530 Oct 04 18:38:08.194334 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3464/6821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:08.762363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b601a69c-b756-4a2f-bddf-644e8f34df3f", "name": "network-vif-plugged", "status": "completed", "tag": "7c038bca-630d-4860-8966-64530c94ccf8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:08.767487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:08.769017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:08.776367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.776832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.777391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:08.781059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:08.790281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] Creating event network-vif-plugged:7c038bca-630d-4860-8966-64530c94ccf8 for instance b601a69c-b756-4a2f-bddf-644e8f34df3f on n-h1-831194-21 Oct 04 18:38:08.796493 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-64526b09-c638-42a4-a84c-23a405239bf8 req-9a9ea062-f137-4489-af92-4ba59b556b42 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038514 Oct 04 18:38:08.802851 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3358/6822] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:08.812959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:08.850963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=10 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:08.975168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:08.986501 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fcf47b71-4d45-40b3-98e3-1a5b8fdf9e7a tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.222990 Oct 04 18:38:08.987379 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3465/6823] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:08 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:09.217409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:09.222398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:09.223449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:09.230823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.231328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.231766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.232735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:09.233401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:09.234042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:09.467753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:09.477919 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1bc9cd6-222d-4cdb-abe9-b77b7ef28077 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1578 microversion: 2.1 time: 0.262310 Oct 04 18:38:09.479026 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3359/6824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:09 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1578 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.011945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.012621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.019665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.020173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.020633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.021352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.021857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.022300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.161348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.170676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc298ed2-2787-47ca-89bf-e4b7e947ab94 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1428 microversion: 2.1 time: 0.163638 Oct 04 18:38:10.171265 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3466/6825] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1428 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:10.502213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:10.502993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:10.513312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.514299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.514978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.516235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.516977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.517845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.704294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:10.713637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-05b84c37-5054-4ade-ac03-8ada30251e7a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1459 microversion: 2.1 time: 0.215107 Oct 04 18:38:10.733999 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3360/6826] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:10 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1459 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:10.875985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f482fa49-fb0f-47e2-bfd3-c05e3b7952c1", "name": "network-vif-deleted", "tag": "c2ae1faf-7655-407b-ae08-e12494234042"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:10.890689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:10.891275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:10.891808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:10.909260 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] Creating event network-vif-deleted:c2ae1faf-7655-407b-ae08-e12494234042 for instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 on n-h1-831194-21 Oct 04 18:38:10.914913 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-741e18cc-61d8-40e3-817e-e427d715ef6c req-c1debf60-f5ad-4582-83ed-bb59e9a97946 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045693 Oct 04 18:38:10.915634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3467/6827] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:11.195212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.195835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.203817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.204665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.205115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.205883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.210443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.210944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.371678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.379613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba0909eb-4e6f-4b2f-a85b-c679e8d36278 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1608 microversion: 2.1 time: 0.188722 Oct 04 18:38:11.380191 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3361/6828] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1608 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:11.405103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.405972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.412312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.413085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.413615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.414434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.414979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.415489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.556139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.564420 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0811acae-b2f9-4f2c-afb7-4bcfb61a4222 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1608 microversion: 2.1 time: 0.164634 Oct 04 18:38:11.565280 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3468/6829] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1608 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.589641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.590311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.596937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.597440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.597923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.598627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.599089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.599523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.736825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:11.737462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:11.743632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.744763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.744990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.745438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.746554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:11.747134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:11.747481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:11.755697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89a83b84-762a-4aa6-98d9-39a4a2e6edaa tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1608 microversion: 2.1 time: 0.171263 Oct 04 18:38:11.756282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3362/6830] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1608 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:11.839809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:11.851641 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-61916376-ab3b-49d4-aadc-e1a7c64b94f5 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1225 microversion: 2.1 time: 0.118670 Oct 04 18:38:11.852241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3469/6831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:11 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:12.877068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:12.877668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:12.885783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.886811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.887258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:12.887986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:12.888598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:12.888875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:13.289850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:13.298965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6ad99d01-3763-4257-b8d3-7c2b001c83a1 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1225 microversion: 2.1 time: 0.426852 Oct 04 18:38:13.299655 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3363/6832] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:12 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1225 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:14.015407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b601a69c-b756-4a2f-bddf-644e8f34df3f", "tag": "7c038bca-630d-4860-8966-64530c94ccf8"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:14.027872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.028531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.029386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.043166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] Creating event network-changed:7c038bca-630d-4860-8966-64530c94ccf8 for instance b601a69c-b756-4a2f-bddf-644e8f34df3f on n-h1-831194-21 Oct 04 18:38:14.050021 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2e6c8efc-66b2-4d59-b7e3-94dffd9e7457 req-53294815-2b4e-4a87-a8ab-4d50f132e760 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038482 Oct 04 18:38:14.051272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3470/6833] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:14.323586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:14.326795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:14.334440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.335283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.335970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.337259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:14.338571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:14.339267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:14.414150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:14.423757 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e5eec8ed-8598-4b1f-8106-6f69eb56980a tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1225 microversion: 2.1 time: 0.104578 Oct 04 18:38:14.425386 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3364/6834] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:14 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:15.450782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:15.451517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:15.458151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.458658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.459150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.459878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:15.460406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:15.460887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:15.530229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:15.538971 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf67f43e-d6e9-4f92-be8e-82327c68119b tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1225 microversion: 2.1 time: 0.094033 Oct 04 18:38:15.539553 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3471/6835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:15 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:16.566688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:16.567393 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:16.575397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.575981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.576501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.577297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.577863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.578299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.611316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:16.611808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:16.612250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:16.612709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lazy-loading 'fault' on Instance uuid f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:16.656056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:16.663961 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-760c72df-4973-4a65-994f-f5336a195d08 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 200 len: 1230 microversion: 2.1 time: 0.103834 Oct 04 18:38:16.664542 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3365/6836] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:16 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:17.688168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:17.688797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: f482fa49-fb0f-47e2-bfd3-c05e3b7952c1] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:17.695863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.696365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.696815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.697766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:17.698519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:17.698966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:17.712835 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 HTTP/1.1 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'f482fa49-fb0f-47e2-bfd3-c05e3b7952c1'} Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:17.714761 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-14a02eaf-14d8-4ea9-a81a-a46c91d010dc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1" status: 404 len: 111 microversion: 2.1 time: 0.031976 Oct 04 18:38:17.719660 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3472/6837] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:17 2022] GET /compute/v2.1/servers/f482fa49-fb0f-47e2-bfd3-c05e3b7952c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:24.066471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.067530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.074293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394", "tag": "4115a9fe-061f-4d25-82af-7495fbe18d99"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:24.089339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.089852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.090300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.091010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.091471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.091902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.097654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.098179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.098631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.129155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] Creating event network-changed:4115a9fe-061f-4d25-82af-7495fbe18d99 for instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 on n-h1-831194-21 Oct 04 18:38:24.129277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:38:24.134945 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7805312d-74cc-40ef-b6a1-5ce1a10fb0a7 req-221ae4a0-56c7-4c6e-be84-9ec3267a2881 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064515 Oct 04 18:38:24.138964 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3473/6838] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:38:24.242041 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7317a610-80f1-4c8f-8dc6-db7014aa4430 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 204 len: 0 microversion: 2.1 time: 0.179234 Oct 04 18:38:24.244971 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3366/6839] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:24 2022] DELETE /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:38:24.256889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:24.257898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:24.272172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.273721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.278905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.280043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:24.281033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:24.291781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:24.454870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:24.464497 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ce0fda54-369a-4fbc-8fcd-d2c58217d7c7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1575 microversion: 2.1 time: 0.214738 Oct 04 18:38:24.465084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3474/6840] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:24 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1575 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:25.489035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:25.489730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:25.497202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.497783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.498245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.498939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:25.499386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:25.499808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:25.503993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:25.653443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:25.661309 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9debeda-a34a-4099-90b0-d67428fcafc7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1575 microversion: 2.1 time: 0.176606 Oct 04 18:38:25.661904 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3367/6841] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:25 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1575 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:26.700942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:26.706684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:26.714412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.715323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.716080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.717785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:26.722655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:26.723468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:26.949504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:26.961206 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b16863b-4e77-41b7-8ab3-743ac2bda275 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1575 microversion: 2.1 time: 0.277458 Oct 04 18:38:26.962059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3475/6842] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:26 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1575 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:27.155540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394", "name": "network-vif-deleted", "tag": "4115a9fe-061f-4d25-82af-7495fbe18d99"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:38:27.166572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:27.180770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.183066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.183984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.196806 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] Creating event network-vif-deleted:4115a9fe-061f-4d25-82af-7495fbe18d99 for instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 on n-h1-831194-21 Oct 04 18:38:27.203022 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ae0fdce3-012c-4fea-8f8f-408eb978f3fe req-e63a2c26-8f90-4a48-b424-aa0fd9abc739 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051343 Oct 04 18:38:27.204315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3368/6843] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:27.985521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:27.986370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:27.989457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:27.995547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.996222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.996783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:27.997636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:27.998284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:27.999456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:28.003958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=85 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:28.082248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:28.100486 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5601be2d-6ba9-4d1d-b3a0-1a6b111df6a9 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1224 microversion: 2.1 time: 0.118804 Oct 04 18:38:28.101887 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3476/6844] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:27 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:29.126294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:29.127811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:29.136997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.137550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.138062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.138838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:29.139483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:29.141032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:29.220282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:29.229341 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4ad9d625-12fa-4d18-a892-63643c1ebf1e tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1224 microversion: 2.1 time: 0.107368 Oct 04 18:38:29.233896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3369/6845] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:29 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:38:30.254921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:30.255670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:30.263814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.264419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.264964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.265772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:30.266285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:30.266849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:30.338751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:30.348710 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9dfe5428-2b6f-419d-b528-2ddfad89ce90 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1224 microversion: 2.1 time: 0.097632 Oct 04 18:38:30.350647 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3477/6846] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:30 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:31.372463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:31.373165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:31.380337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.380848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.381292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.382033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:31.382494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:31.382924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:31.455438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f47a20c5663c4e06b73d20943faba14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1e72d0958f849eeb547a5989ea40167', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:38:31.467108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f15e691c-9272-431a-8bc0-5e42375ed90c tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 200 len: 1224 microversion: 2.1 time: 0.098718 Oct 04 18:38:31.467707 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3370/6847] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:31 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:38:32.490141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:32.490953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:32.498697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.499206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.499658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.500375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:32.500871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:32.501308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:32.516618 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 HTTP/1.1 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394'} Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:32.518325 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-50d73b00-1dcb-48a4-b918-32ea63e47917 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394" status: 404 len: 111 microversion: 2.1 time: 0.033668 Oct 04 18:38:32.523721 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3478/6848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:32 2022] GET /compute/v2.1/servers/fadce7cf-b9ff-4bba-a02b-6ef3aaa0c394 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:33.020676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.021236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.029674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.030388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.030841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.031565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.032064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.032659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.049443 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b HTTP/1.1 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '8d99db2f-707e-4592-b01c-95d7d92a4f4b'} Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:33.051229 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9672324e-d9dc-46a2-9a5d-8bb1898cbbdc tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 404 len: 111 microversion: 2.1 time: 0.036929 Oct 04 18:38:33.056107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3371/6849] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:38:33 2022] DELETE /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:33.071516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:33.074209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] [instance: 8d99db2f-707e-4592-b01c-95d7d92a4f4b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:33.082075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.082593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.083054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.084281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:33.084281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:33.084696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:33.100812 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] HTTP exception thrown: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Request method failure captured: Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b HTTP/1.1 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPHpes9QNUlAwS7R14Pa0QspByUx8kTnixf-YNiJE-gsUcRQE-FckJiVdLD7uvYDhDTxCWZyDIJLFAmQrwkW_JmAsv1mOn4TYutf7Oj2AZ59JIebj_T5EJWhQ_t6ctm2jQ4XDs_sJvvVrUMyhzRmhqlz2yXADX7t51ylTrdBf49o9IGQ Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d1e72d0958f849eeb547a5989ea40167"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d1e72d0958f849eeb547a5989ea40167 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestVolumeBootPattern-1783307567 Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: f47a20c5663c4e06b73d20943faba14c Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestVolumeBootPattern-1783307567-project Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '8d99db2f-707e-4592-b01c-95d7d92a4f4b'} Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:38:33.102577 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Returning 404 to user: Instance 8d99db2f-707e-4592-b01c-95d7d92a4f4b could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c064cb25-d894-49dd-add0-eb52151c81a7 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b" status: 404 len: 111 microversion: 2.1 time: 0.037601 Oct 04 18:38:33.113184 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3479/6850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:38:33 2022] GET /compute/v2.1/servers/8d99db2f-707e-4592-b01c-95d7d92a4f4b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:38:36.609595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb206d9a-2b66-4d18-a7ec-a876d57f0590 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] Calling method '.version_select at 0x7fbdc1dbb160>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:36.648204 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb206d9a-2b66-4d18-a7ec-a876d57f0590 tempest-TestVolumeBootPattern-1783307567 tempest-TestVolumeBootPattern-1783307567-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-268794580" status: 202 len: 0 microversion: 2.1 time: 0.046674 Oct 04 18:38:36.649043 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3372/6851] 10.222.0.42 () {58 vars in 1260 bytes} [Tue Oct 4 18:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-268794580 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:38:55.767286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:55.767874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:55.775739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=7 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:55.776514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=15 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:55.778721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.779230 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.779682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.780514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:55.780959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:55.781396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:55.811561 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1dffd05c-28bf-4501-a95e-fa2e9ffa74cd tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.048150 Oct 04 18:38:55.812066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3480/6852] 10.222.0.42 () {58 vars in 1293 bytes} [Tue Oct 4 18:38:55 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f/os-server-password => generated 116 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:38:58.360686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:38:58.361198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:38:58.364282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=20 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.364992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:38:58.372123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.372603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.373328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.374372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:38:58.374863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:38:58.375294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:38:58.465196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lazy-loading 'services' on Instance uuid e34fa93f-b86b-4e30-bbd6-aa38aa278f83 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:38:58.544001 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5a36c663-5e1c-463f-90d1-5debbb573ce3 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83/os-volume_attachments/1fd13404-c7d5-42cb-b1af-c78f1abc7114" status: 202 len: 0 microversion: 2.1 time: 0.186962 Oct 04 18:38:58.545292 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3373/6853] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:38:58 2022] DELETE /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83/os-volume_attachments/1fd13404-c7d5-42cb-b1af-c78f1abc7114 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:39:03.946669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:03.947877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:03.955036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.955547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.956003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.956748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:03.957252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:03.957724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:03.985036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:39:04.070243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1e7297a-8982-477e-b449-15325fd58471 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 204 len: 0 microversion: 2.1 time: 0.127391 Oct 04 18:39:04.070879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3481/6854] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:39:03 2022] DELETE /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:39:04.081470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:04.082814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:04.090031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.090527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.090976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.091684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:04.092137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:04.092563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:04.233635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:04.242263 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef6ec58c-688a-45bd-9676-766512b495e4 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1468 microversion: 2.1 time: 0.166393 Oct 04 18:39:04.242861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3374/6855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:04 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1468 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:05.267292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:05.267945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:05.275709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.276254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.276686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.277412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:05.277911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:05.278360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:05.434817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:05.442658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c9b136a-1104-4571-b595-c66318f544fe tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1468 microversion: 2.1 time: 0.179774 Oct 04 18:39:05.443206 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3482/6856] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:05 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1468 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:06.208977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e34fa93f-b86b-4e30-bbd6-aa38aa278f83", "name": "network-vif-deleted", "tag": "6a6e5773-9aa1-4d36-addd-d85c0f0689b0"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:39:06.219797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.220340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.220784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.232882 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] Creating event network-vif-deleted:6a6e5773-9aa1-4d36-addd-d85c0f0689b0 for instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 on n-h2-831194-21 Oct 04 18:39:06.238404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-914c604d-f4a9-40cd-b570-e062ab84fcd5 req-ca524c50-e899-4ee7-9926-57e9fe73888a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033151 Oct 04 18:39:06.239125 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3375/6857] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:39:06.467065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:06.467840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:06.475084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.475584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.476207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.476978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.480198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.480684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.518944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:06.519441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:06.520061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:06.520521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lazy-loading 'fault' on Instance uuid e34fa93f-b86b-4e30-bbd6-aa38aa278f83 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:39:06.571965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0629bab0ae24692aea615920690c5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3e39e04d7ca4767997631ca9843e729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:39:06.580349 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f8e2ccd-b1a5-43c8-a096-db90d4aee5c9 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 200 len: 1304 microversion: 2.1 time: 0.117696 Oct 04 18:39:06.581101 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3483/6858] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:06 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 1304 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:39:07.612819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:39:07.613530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] [instance: e34fa93f-b86b-4e30-bbd6-aa38aa278f83] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:39:07.620941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.621436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.621912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.622628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:39:07.623184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:39:07.623516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:39:07.637667 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] HTTP exception thrown: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Request method failure captured: Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 HTTP/1.1 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH1oLwn2DE4x7CAqbY-3cOAasAN3YrmHRn0qnWwp6rhE1Dg3n3HMZJlkBLhTDkugqBX9-1hEFSNSiKVqGQLZJuNKUbr6Zd6-Xm82JmRdDEbReP1JU0zOWY5nEX6g-OC8eRtmR-HBtoTbhmEiy1DD7E3vQgIozyXctgHvAGoi89vfDUs Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d3e39e04d7ca4767997631ca9843e729 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-VolumesBackupsTest-2027055465 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d3e39e04d7ca4767997631ca9843e729"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d3e39e04d7ca4767997631ca9843e729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d3e39e04d7ca4767997631ca9843e729"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d3e39e04d7ca4767997631ca9843e729"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-VolumesBackupsTest-2027055465 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d3e39e04d7ca4767997631ca9843e729 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-VolumesBackupsTest-2027055465 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-VolumesBackupsTest-2027055465-project Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: c0629bab0ae24692aea615920690c5d4 Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-VolumesBackupsTest-2027055465-project Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'e34fa93f-b86b-4e30-bbd6-aa38aa278f83'} Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:39:07.639322 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] Returning 404 to user: Instance e34fa93f-b86b-4e30-bbd6-aa38aa278f83 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c957963-6634-48ad-a18e-c953869ae476 tempest-VolumesBackupsTest-2027055465 tempest-VolumesBackupsTest-2027055465-project] 10.222.0.42 "GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83" status: 404 len: 111 microversion: 2.1 time: 0.035477 Oct 04 18:39:07.642871 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3376/6859] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:39:07 2022] GET /compute/v2.1/servers/e34fa93f-b86b-4e30-bbd6-aa38aa278f83 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:42:59.625024 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:42:59.626036 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:42:59.630576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:59.632010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:42:59.632797 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:42:59.633150 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:42:59.634425 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:42:59.634637 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:42:59.635725 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:42:59.635840 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:42:59.842529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:42:59.843054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:42:59.856355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.856862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.858478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.859388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:42:59.859908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:42:59.860375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:42:59.893336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:42:59.986411 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b1b91dd-1c4d-4943-aa81-c7fc784e58f3 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 204 len: 0 microversion: 2.1 time: 0.361739 Oct 04 18:42:59.986411 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3484/6860] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:42:59 2022] DELETE /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:42:59.996484 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:42:59.997472 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 18:42:59.998827 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:42:59.999014 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:42:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:43:00.001146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=8 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:00.001921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:43:00.004735 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:43:00.004918 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:43:00.010701 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:43:00.010839 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:43:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f (ip 10.222.0.42) !!! Oct 04 18:43:00.034634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:00.035314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:00.045576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.046250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.046708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.047433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:00.047899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:00.048334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:00.306470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:00.314404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9f3500f9-a525-4d02-85b7-993006e710d5 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1733 microversion: 2.1 time: 0.320942 Oct 04 18:43:00.314974 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3377/6861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:42:59 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1733 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:01.341447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:01.342331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:01.357228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.357743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.358233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.358968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:01.359453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:01.359903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:01.363845 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36690. Oct 04 18:43:01.386175 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36692. Oct 04 18:43:01.641901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:01.656102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b4c38ce-1f70-46b3-aa07-f59834477a79 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1733 microversion: 2.1 time: 0.320657 Oct 04 18:43:01.657332 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3485/6862] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:01 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:02.678194 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36710. Oct 04 18:43:02.679572 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 36708. Oct 04 18:43:02.688311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:02.692870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:02.735062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.735623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.736091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.737291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.750322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.750908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.874563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b601a69c-b756-4a2f-bddf-644e8f34df3f", "name": "network-vif-deleted", "tag": "7c038bca-630d-4860-8966-64530c94ccf8"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:43:02.898719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:02.900984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:02.902820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:02.914408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f74bdb391ec4f78b77ad5eff138b41d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2184ac42370f4575a207559652c788f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:43:02.924959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79e52530-053b-4a87-ad05-140bc992490b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 200 len: 1383 microversion: 2.1 time: 0.246790 Oct 04 18:43:02.925808 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3486/6863] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:02 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 1383 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:43:02.927448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] Creating event network-vif-deleted:7c038bca-630d-4860-8966-64530c94ccf8 for instance b601a69c-b756-4a2f-bddf-644e8f34df3f on n-h1-831194-21 Oct 04 18:43:02.946237 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8e4507b7-f682-44f2-8590-df5729813e92 req-ffc4d9cd-95d5-4555-aaed-d3b2ca2c8f01 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281545 Oct 04 18:43:02.947368 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3378/6864] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:43:03.949752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:03.950514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:03.967635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.968158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.968644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.969552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:03.970062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:03.970510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:03.994673 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] HTTP exception thrown: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Request method failure captured: Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f HTTP/1.1 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH1-40Gb7pUNTDjN609sZr23oTOnscwYL7zAccr47uR8cuotXRjfdDX-q1d9AQRSVVjvj5vppYy9euh3pIebn0bXTfcz3JQ87bBzFBt2yueTgJXNeqv2AZB3XXFCaTNPdMPDKA4JSSHQU59erxv0N3QT1B2qTI0gh4wYv7GUInKAsp4 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2184ac42370f4575a207559652c788f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2184ac42370f4575a207559652c788f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7f74bdb391ec4f78b77ad5eff138b41d Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b601a69c-b756-4a2f-bddf-644e8f34df3f'} Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.000943 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.004504 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.006856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Returning 404 to user: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.007993 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eff4b8f5-3c27-40b5-954a-182843a83fb2 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 404 len: 111 microversion: 2.1 time: 0.062886 Oct 04 18:43:04.009143 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3487/6865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:03 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:04.603476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.604639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.611458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.612130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.612910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.613781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.614459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.615096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.633558 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] HTTP exception thrown: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Request method failure captured: Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f HTTP/1.1 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH1-40Gb7pUNTDjN609sZr23oTOnscwYL7zAccr47uR8cuotXRjfdDX-q1d9AQRSVVjvj5vppYy9euh3pIebn0bXTfcz3JQ87bBzFBt2yueTgJXNeqv2AZB3XXFCaTNPdMPDKA4JSSHQU59erxv0N3QT1B2qTI0gh4wYv7GUInKAsp4 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2184ac42370f4575a207559652c788f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2184ac42370f4575a207559652c788f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 7f74bdb391ec4f78b77ad5eff138b41d Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b601a69c-b756-4a2f-bddf-644e8f34df3f'} Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:04.635335 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Returning 404 to user: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.638917 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-59d70192-d01c-4eca-a7f1-efd20aec70f4 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 404 len: 111 microversion: 2.1 time: 0.042855 Oct 04 18:43:04.640646 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3379/6866] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:43:04 2022] DELETE /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:04.646910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.649545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] [instance: b601a69c-b756-4a2f-bddf-644e8f34df3f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:43:04.658711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.659259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.659737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.660662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:43:04.661158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:43:04.661618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:43:04.680073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] HTTP exception thrown: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Request method failure captured: Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f HTTP/1.1 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH1-40Gb7pUNTDjN609sZr23oTOnscwYL7zAccr47uR8cuotXRjfdDX-q1d9AQRSVVjvj5vppYy9euh3pIebn0bXTfcz3JQ87bBzFBt2yueTgJXNeqv2AZB3XXFCaTNPdMPDKA4JSSHQU59erxv0N3QT1B2qTI0gh4wYv7GUInKAsp4 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/2184ac42370f4575a207559652c788f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/2184ac42370f4575a207559652c788f1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_2184ac42370f4575a207559652c788f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 2184ac42370f4575a207559652c788f1 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestServerBasicOps-192852510 Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 7f74bdb391ec4f78b77ad5eff138b41d Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestServerBasicOps-192852510-project Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'b601a69c-b756-4a2f-bddf-644e8f34df3f'} Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:43:04.681546 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Returning 404 to user: Instance b601a69c-b756-4a2f-bddf-644e8f34df3f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7eb21567-523b-489c-99d1-1b9eea47440b tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f" status: 404 len: 111 microversion: 2.1 time: 0.041207 Oct 04 18:43:04.685388 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3488/6867] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:43:04 2022] GET /compute/v2.1/servers/b601a69c-b756-4a2f-bddf-644e8f34df3f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:43:04.873961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f9a2f42-7d00-4c01-8a6a-74b341b97b64 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] Calling method '.version_select at 0x7fbdbc6c0940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:43:04.918040 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f9a2f42-7d00-4c01-8a6a-74b341b97b64 tempest-TestServerBasicOps-192852510 tempest-TestServerBasicOps-192852510-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-555319139" status: 202 len: 0 microversion: 2.1 time: 0.049106 Oct 04 18:43:04.923109 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3380/6868] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 18:43:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-555319139 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:48.871455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:48.872203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:49.021650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-549591833", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:49.080222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] validate_networks() for None {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:44:49.321637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:44:49.322122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:44:49.322666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:44:49.323201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:44:49.323645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:44:49.333885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.334393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.334858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.335623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:49.336118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:49.336569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:49.354535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Getting quotas for project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:49.359971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Getting quotas for user df40d45e68f64f4d8ba746bbef4be487 and project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:49.375655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:44:49.378006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:44:49.425623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-099cb8bd-59bc-4ae2-aaf4-2edf7d8c5ea9 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555475 Oct 04 18:44:49.426475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3489/6869] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:44:49.437658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:49.438553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:49.445765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78435f38-a894-4171-9a67-935f9c340f06 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:49.446597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78435f38-a894-4171-9a67-935f9c340f06 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:49.520735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-78435f38-a894-4171-9a67-935f9c340f06 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:49.528731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78435f38-a894-4171-9a67-935f9c340f06 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1221 microversion: 2.1 time: 0.093530 Oct 04 18:44:49.529312 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3381/6870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:49 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:50.553758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:50.554332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:50.561642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.562235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.562704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.563438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:50.563953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:50.564400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:50.631180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:50.639413 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1be173f9-3d0b-40b4-99b3-a810991bcbba tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1273 microversion: 2.1 time: 0.091121 Oct 04 18:44:50.639978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3490/6871] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:50 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:51.665936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:51.667185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:51.675601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.676106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.676555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.677272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:51.677726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:51.678420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:51.943753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:51.951831 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fe392cf3-48e5-4332-a3a6-6dee3d85173e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.291385 Oct 04 18:44:51.952529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3382/6872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:51 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:52.424535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474f0ffb-56ab-4b8e-8a3d-4662f4e1828c", "tag": "1c242beb-e0bf-46e2-b81c-49e4266acc70"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:52.438120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.438120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.438120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.454546 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] Creating event network-changed:1c242beb-e0bf-46e2-b81c-49e4266acc70 for instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c on n-h1-831194-21 Oct 04 18:44:52.459207 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f4023236-182f-4b27-8160-606c4d68be2f req-c8c680a1-e370-42d5-8ce5-82f5ea511f02 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039373 Oct 04 18:44:52.459867 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3491/6873] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:52.976743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:52.977383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:52.984486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.984978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.985415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:52.986143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:52.986594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:52.987201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:53.220490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:53.228529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03b8f8f5-fe7d-45f8-a27c-ea9ca8a71022 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.255753 Oct 04 18:44:53.229134 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3383/6874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:52 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:54.254724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:54.255603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:54.261947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.262465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.262930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.263656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:54.264132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:54.264583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:54.407989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:54.415845 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-41df70e8-a3b1-4d94-9380-73fead5c0db1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.166964 Oct 04 18:44:54.416438 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3492/6875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:54 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:55.439635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:55.440254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:55.447768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.448264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.448712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.449420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:55.449913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:55.450352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:55.583192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:55.592609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c8e72d4-8105-4fbf-ad6b-750e6919a27e tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.156833 Oct 04 18:44:55.593200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3384/6876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:55 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:56.617968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:56.618743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:56.632452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.632958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.633404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.634152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.634617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.635050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.697483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474f0ffb-56ab-4b8e-8a3d-4662f4e1828c", "name": "network-vif-plugged", "status": "completed", "tag": "1c242beb-e0bf-46e2-b81c-49e4266acc70"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:56.710699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:56.712114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:56.712114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:56.727361 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] Creating event network-vif-plugged:1c242beb-e0bf-46e2-b81c-49e4266acc70 for instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c on n-h1-831194-21 Oct 04 18:44:56.734149 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5d2e8709-8f9e-414a-8672-cc9cddb6f26d req-09e52b29-5920-4a48-a1ee-d22f0dcd7c93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138041 Oct 04 18:44:56.734871 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3493/6877] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:56.804156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:56.812802 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f669d8b6-95a3-4a17-94e7-a713d02e5a81 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.200077 Oct 04 18:44:56.813928 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3385/6878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:56 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:44:57.836682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:57.838485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:57.844566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.845068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.845520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.846275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:57.847400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:57.847954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:57.984188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:57.993232 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fe1d9f46-d658-4d15-b0f8-ed72491596e7 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1321 microversion: 2.1 time: 0.160757 Oct 04 18:44:57.993816 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3494/6879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:57 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.016374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.017429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.026040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.026541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.026990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.027727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.028215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.028654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.170524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.178699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c3eb6dc4-1d31-494e-8c96-31b783e1f57b tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1471 microversion: 2.1 time: 0.166210 Oct 04 18:44:59.179286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3386/6880] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.258578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3df999b-29a6-4293-9ab9-e36597f0c7bc tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '.version_select at 0x7fbdbc53b8b0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.339875 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3df999b-29a6-4293-9ab9-e36597f0c7bc tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/210fdce4c627461ba897a6f5b73ebd11" status: 200 len: 371 microversion: 2.1 time: 0.139960 Oct 04 18:44:59.340455 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3495/6881] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/os-quota-sets/210fdce4c627461ba897a6f5b73ebd11 => generated 371 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:59.353307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7313d9e0-1e3c-42fe-9c5f-360e7629e27c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-97154393", "id": 1314310669, "os-flavor-access:is_public": "True"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.372414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7313d9e0-1e3c-42fe-9c5f-360e7629e27c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022830 Oct 04 18:44:59.372990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3387/6882] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:59.385592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1314310669"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.387870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.389912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:59.405599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.406823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.407287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.408030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.408511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.408958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.621726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ea03a8d9ee645c69c41b32a5c3865ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210fdce4c627461ba897a6f5b73ebd11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:44:59.629107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-97154393 {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:44:59.636252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.636750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.637203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.637976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.638576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.639082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.662359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Getting quotas for project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:44:59.668234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Getting quotas for user df40d45e68f64f4d8ba746bbef4be487 and project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:44:59.683026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] ram quota exceeded for 210fdce4c627461ba897a6f5b73ebd11, tried to resize instance. Oct 04 18:44:59.683593 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Request method failure captured: Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action HTTP/1.1 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 39 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH8guCe3kHKr-ouR18ak8EeYyRXjeorTMT5vwOyfna6pUTYRFdJXUjBqIq48QMG6JszLqVx3vfKthz1FTNw4sKx9p0uQHTE76Tof3oQFkR-x-wt7yisyySy13Tk8XxKPsR5ingaydJMnJ6HuvheV1LQSTfWiBH985HCQags80_-sCkE Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 210fdce4c627461ba897a6f5b73ebd11 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader,admin Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader,admin Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 210fdce4c627461ba897a6f5b73ebd11 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersAdminNegativeTestJSON-478578842-project-admin Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 6ea03a8d9ee645c69c41b32a5c3865ef Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersAdminNegativeTestJSON-478578842-project-admin Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: {"resize": {"flavorRef": "1314310669"}} Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '474f0ffb-56ab-4b8e-8a3d-4662f4e1828c', 'body': {'resize': {'flavorRef': '1314310669'}}} Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:59.685717 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-66220908-a0e7-4cac-b3ba-9397ff26ab3c tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action" status: 403 len: 118 microversion: 2.1 time: 0.305608 Oct 04 18:44:59.690344 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3496/6883] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action => generated 118 bytes in 307 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:44:59.698230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e0f1fa4-db69-4786-84fe-3f491feaddba tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.700972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:44:59.718925 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e0f1fa4-db69-4786-84fe-3f491feaddba tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/1314310669" status: 202 len: 0 microversion: 2.1 time: 0.024388 Oct 04 18:44:59.719522 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3388/6884] 10.222.0.42 () {58 vars in 1161 bytes} [Tue Oct 4 18:44:59 2022] DELETE /compute/v2.1/flavors/1314310669 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:44:59.731513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3e567270-20d0-4fb1-95f3-7c5bbcd19e0f tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.755516 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3e567270-20d0-4fb1-95f3-7c5bbcd19e0f tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027710 Oct 04 18:44:59.756105 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3497/6885] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:44:59.783531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ef579100-adf7-4d45-82f1-bfbdc9881997 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '.version_select at 0x7fbdbc6b4670>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:44:59.875266 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ef579100-adf7-4d45-82f1-bfbdc9881997 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "GET /compute/v2.1/os-quota-sets/210fdce4c627461ba897a6f5b73ebd11" status: 200 len: 371 microversion: 2.1 time: 0.098867 Oct 04 18:44:59.875845 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3389/6886] 10.222.0.42 () {58 vars in 1242 bytes} [Tue Oct 4 18:44:59 2022] GET /compute/v2.1/os-quota-sets/210fdce4c627461ba897a6f5b73ebd11 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:59.887895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c70304c5-a841-4caf-b77f-13eadcadf6a3 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-862374032", "id": 405402359, "os-flavor-access:is_public": "True"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.912265 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c70304c5-a841-4caf-b77f-13eadcadf6a3 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.028053 Oct 04 18:44:59.912869 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3498/6887] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/flavors => generated 433 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:44:59.925707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "405402359"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:44:59.928153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:44:59.934589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.935084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.935532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:44:59.936278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:44:59.936840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:44:59.937345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.104497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '6ea03a8d9ee645c69c41b32a5c3865ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '210fdce4c627461ba897a6f5b73ebd11', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.111043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-862374032 {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:45:00.118057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.118538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.118968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.119683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.120162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.120584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.149061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Getting quotas for project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:00.154888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Getting quotas for user df40d45e68f64f4d8ba746bbef4be487 and project 9e3c0532f1d440aa9a51bf11dc23730b. Resources: {'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:00.170176 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.compute.api [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] cores quota exceeded for 210fdce4c627461ba897a6f5b73ebd11, tried to resize instance. Oct 04 18:45:00.170730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Request method failure captured: Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action HTTP/1.1 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 38 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH8guCe3kHKr-ouR18ak8EeYyRXjeorTMT5vwOyfna6pUTYRFdJXUjBqIq48QMG6JszLqVx3vfKthz1FTNw4sKx9p0uQHTE76Tof3oQFkR-x-wt7yisyySy13Tk8XxKPsR5ingaydJMnJ6HuvheV1LQSTfWiBH985HCQags80_-sCkE Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 210fdce4c627461ba897a6f5b73ebd11 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader,admin Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader,admin Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_210fdce4c627461ba897a6f5b73ebd11"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 210fdce4c627461ba897a6f5b73ebd11 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-478578842 Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-478578842-project-admin Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 6ea03a8d9ee645c69c41b32a5c3865ef Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-478578842-project-admin Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: {"resize": {"flavorRef": "405402359"}} Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '474f0ffb-56ab-4b8e-8a3d-4662f4e1828c', 'body': {'resize': {'flavorRef': '405402359'}}} Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:45:00.172761 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1a592aff-f7d1-4e87-82c6-60c154f0f492 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action" status: 403 len: 113 microversion: 2.1 time: 0.253065 Oct 04 18:45:00.177226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3390/6888] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:44:59 2022] POST /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c/action => generated 113 bytes in 255 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:00.183486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-775770a0-91a3-40b7-bb98-b93795be2cb0 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.201743 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-775770a0-91a3-40b7-bb98-b93795be2cb0 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "DELETE /compute/v2.1/flavors/405402359" status: 202 len: 0 microversion: 2.1 time: 0.022085 Oct 04 18:45:00.202531 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3499/6889] 10.222.0.42 () {58 vars in 1158 bytes} [Tue Oct 4 18:45:00 2022] DELETE /compute/v2.1/flavors/405402359 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:00.211402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57e9dbdb-59ef-4968-ad6d-d715e6bc4db8 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.233371 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57e9dbdb-59ef-4968-ad6d-d715e6bc4db8 tempest-ServersAdminNegativeTestJSON-478578842 tempest-ServersAdminNegativeTestJSON-478578842-project-admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025707 Oct 04 18:45:00.234053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3391/6890] 10.222.0.42 () {58 vars in 1146 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:00.257317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.257855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.270093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.270778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.271064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.271788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.272257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.272697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.298566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:00.379871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1af1dcd-68c6-4168-9b2b-9e0da68d6169 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 204 len: 0 microversion: 2.1 time: 0.126638 Oct 04 18:45:00.380500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3500/6891] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:00 2022] DELETE /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:45:00.389959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:00.390586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:00.398051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.398549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.398996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.399710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:00.400173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:00.400608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:00.538846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:00.546729 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e91304f8-2f51-49d7-b4ff-8658966a0eae tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1477 microversion: 2.1 time: 0.161556 Oct 04 18:45:00.547313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3392/6892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:00 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1477 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:01.572099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:01.572818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:01.579112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.579583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.580647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.580811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:01.581247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:01.581687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:01.719704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:01.730355 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2eff0bcf-177a-4983-b65e-e4d2cf742afb tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1477 microversion: 2.1 time: 0.163414 Oct 04 18:45:01.730943 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3501/6893] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:01 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1477 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:02.542195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474f0ffb-56ab-4b8e-8a3d-4662f4e1828c", "name": "network-vif-deleted", "tag": "1c242beb-e0bf-46e2-b81c-49e4266acc70"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:02.554714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.555304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.555816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.573207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] Creating event network-vif-deleted:1c242beb-e0bf-46e2-b81c-49e4266acc70 for instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c on n-h1-831194-21 Oct 04 18:45:02.579783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-07724b60-bb4e-4737-ae19-1f4227fde17a req-7754dbec-5250-45a7-bdec-b9c62ecea013 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041564 Oct 04 18:45:02.580539 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3393/6894] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:02.756281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:02.756942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:02.764367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.764873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.765329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.766075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.766567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.767298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.800274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:02.800775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:02.801226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:02.801715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lazy-loading 'fault' on Instance uuid 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:45:02.844968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df40d45e68f64f4d8ba746bbef4be487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e3c0532f1d440aa9a51bf11dc23730b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:02.852942 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-263455ad-b70e-4fb6-8ef9-c0bb585e1dc1 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 200 len: 1311 microversion: 2.1 time: 0.101307 Oct 04 18:45:02.853541 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3502/6895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:02 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:03.878974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:03.879624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] [instance: 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:03.886179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.886682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.887131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.887844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:03.888306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:03.888738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:03.904120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] HTTP exception thrown: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Request method failure captured: Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c HTTP/1.1 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH8gHwG6p0BvQvFaX-9ON42ioAIz7qyQ5H6CQccXMffJqzMGZVOiSq6n2Qb5kK4EWb6gQCQujCW_2KYryiKtTt8yZxzmk6q5s_LTNaTuTeZ8Tf1-OkGMTMEJp1loRcvr7nfiGLNoGpJ0icvYN3yr3bUE_R6pkQY-s7MsKsiOlXe6EdQ Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 9e3c0532f1d440aa9a51bf11dc23730b Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1173471643 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9e3c0532f1d440aa9a51bf11dc23730b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e3c0532f1d440aa9a51bf11dc23730b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9e3c0532f1d440aa9a51bf11dc23730b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9e3c0532f1d440aa9a51bf11dc23730b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1173471643 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 9e3c0532f1d440aa9a51bf11dc23730b Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1173471643 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersAdminNegativeTestJSON-1173471643-project Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: df40d45e68f64f4d8ba746bbef4be487 Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1173471643-project Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '474f0ffb-56ab-4b8e-8a3d-4662f4e1828c'} Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.905809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] Returning 404 to user: Instance 474f0ffb-56ab-4b8e-8a3d-4662f4e1828c could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e7053bd2-e8df-4633-80fe-0266c5a92277 tempest-ServersAdminNegativeTestJSON-1173471643 tempest-ServersAdminNegativeTestJSON-1173471643-project] 10.222.0.42 "GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c" status: 404 len: 111 microversion: 2.1 time: 0.034374 Oct 04 18:45:03.914448 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3394/6896] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:03 2022] GET /compute/v2.1/servers/474f0ffb-56ab-4b8e-8a3d-4662f4e1828c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:10.370458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.371315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:10.509455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1675049049", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4e3c5b0a-4fba-4172-940e-f92a6b084c80"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:10.568670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] validate_networks() for [('4e3c5b0a-4fba-4172-940e-f92a6b084c80', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:45:11.016603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:11.017305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:11.017806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:11.019223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:11.019671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:11.029948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.030451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.030913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.031665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:11.032142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:11.032672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:11.052595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Getting quotas for project 29ff08960db24faba2a94b7e33113be7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:45:11.058363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Getting quotas for user 3d2b4bb51149403a9f0ef40332d446b4 and project 29ff08960db24faba2a94b7e33113be7. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:45:11.072638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:45:11.079806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:45:11.144223 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ac31bc29-87a4-4b1f-8098-3c63ea829435 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779065 Oct 04 18:45:11.151088 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3503/6897] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:45:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:45:11.156546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfc9a8f3-54df-4c52-bbbd-1cf669c37b6f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:11.157513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfc9a8f3-54df-4c52-bbbd-1cf669c37b6f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:11.160937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.163760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:11.227745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfc9a8f3-54df-4c52-bbbd-1cf669c37b6f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:11.235519 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfc9a8f3-54df-4c52-bbbd-1cf669c37b6f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1215 microversion: 2.1 time: 0.082847 Oct 04 18:45:11.236297 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3395/6898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:11 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:12.271301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:12.272690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:12.283523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.284986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.287241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.292224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:12.293127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:12.294068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:12.417393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:12.428693 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-249753ff-18d2-4cfe-84eb-4fb9355a2371 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1267 microversion: 2.1 time: 0.170724 Oct 04 18:45:12.429508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3504/6899] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:12 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:13.453323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:13.454018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:13.468040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.468605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.469264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.470295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:13.471111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:13.472860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:13.719351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:13.728260 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0cb6583a-1d70-4aec-b509-9a5bc881def2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.278906 Oct 04 18:45:13.729296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3396/6900] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:13 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:14.395674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:14.429643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.430995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.431812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.447689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] Creating event network-changed:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h1-831194-21 Oct 04 18:45:14.455308 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-50434a19-7618-417e-9a50-fa77c7c643c4 req-8c3dc7fe-22ca-42b3-9efc-d1953528c5ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064141 Oct 04 18:45:14.457232 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3505/6901] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:14.760426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:14.770931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:14.778724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.779691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.780154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:14.780905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:14.781384 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:14.781893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:15.272616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:15.280686 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28be7fee-436a-4a0b-8f82-96116ee9d023 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.531444 Oct 04 18:45:15.281124 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3397/6902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:14 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:16.308730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:16.310305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:16.318268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.318849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.319312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.320048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:16.320532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:16.320959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:16.492341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:16.500711 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0229423f-5d5c-4cb5-b1c8-d674e55b5aa0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.197995 Oct 04 18:45:16.501320 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3506/6903] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:16 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:17.525173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:17.525799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:17.532987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.533568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.534376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.535225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:17.536008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:17.536613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:17.676626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:17.684461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd0c820a-3f81-4ffc-92dd-c23fb02a064c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.163282 Oct 04 18:45:17.685046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3398/6904] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:17 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:18.714856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:18.716029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:18.727530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.728457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.729270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.730918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.731790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.732611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.761227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "name": "network-vif-plugged", "status": "completed", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:18.774517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:18.775149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:18.775685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:18.793965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] Creating event network-vif-plugged:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h1-831194-21 Oct 04 18:45:18.801256 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e303e195-5235-400c-b6ea-61212893e420 req-3fdb485e-7c2e-4a36-b5c7-a3bcffc6bbf9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043511 Oct 04 18:45:18.802542 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3399/6905] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:19.056315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:19.210303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:19.223799 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1e919973-b252-45c4-99ba-f86c47c21550 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.518189 Oct 04 18:45:19.224434 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3507/6906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:18 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:20.251410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:20.254252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:20.258690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:20.268100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.269059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.269239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.270123 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:20.270830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:20.271309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:20.275670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=74 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:20.427224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:20.438923 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a177a2eb-82cd-49fc-b14e-d6e634e0552c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1315 microversion: 2.1 time: 0.193825 Oct 04 18:45:20.439638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3400/6907] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:20 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.466479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.467118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.469844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:21.470604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:21.472661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:21.479916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.480446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.480912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.481650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.482160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.482612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.634594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.645757 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c6e9586-ec5f-45a9-94f1-2b7099a32856 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1501 microversion: 2.1 time: 0.183072 Oct 04 18:45:21.646388 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3508/6908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1501 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:21.669926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:21.672233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.674832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:21.682094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.682665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.683152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.683904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.684410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.684885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.718155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:21.724361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Old instance type m1.heat2, new instance type m1.heat {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:45:21.731185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:45:21.731613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:45:21.732097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:45:21.732524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:45:21.732944 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:45:21.803000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d6834814-283d-438b-89c5-dd44d1d39d55 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "POST /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5/action" status: 202 len: 0 microversion: 2.1 time: 0.137282 Oct 04 18:45:21.804008 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3401/6909] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:45:21 2022] POST /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:45:21.815624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:21.816481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:21.823338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.823973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.824662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:21.825409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:21.825919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:21.826417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:22.008281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:22.017597 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6ab562a7-0f42-49a1-b2db-552857eb690c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1510 microversion: 2.1 time: 0.207209 Oct 04 18:45:22.020795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3509/6910] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:21 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:23.041627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:23.042296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:23.050233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.051013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.051458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.052160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:23.052616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:23.053039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:23.198721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:23.207215 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d91bf456-0ec5-4cc0-8dc3-2a6b93b649b0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1510 microversion: 2.1 time: 0.170422 Oct 04 18:45:23.207990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3402/6911] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:23 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:24.231256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:24.231890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:24.239265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.239777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.240244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.241006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:24.241481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:24.241963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:24.380321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:24.388237 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b6ba5de3-5215-4d5e-b9e7-390c6029c93d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.160915 Oct 04 18:45:24.388810 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3510/6912] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:24 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:25.412955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:25.413508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:25.420385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.420870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.421307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.422029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:25.422488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:25.422916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:25.557095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:25.570125 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eb8430f6-ab47-41f0-aa28-773b515fde1f tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.161097 Oct 04 18:45:25.570714 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3403/6913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:25 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:26.594300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:26.594937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:26.602088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.602601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.603067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.603780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:26.604260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:26.604703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:26.742803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:26.751933 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8caa8f3a-8f6d-4c5f-827b-e3657225b5d5 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.161474 Oct 04 18:45:26.753090 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3511/6914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:26 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:27.777077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:27.777741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:27.786114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.786633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.787137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.787863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:27.788329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:27.788760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:27.927675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:27.935569 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-75a6271e-50c6-45a5-9d7e-797161b76993 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.162424 Oct 04 18:45:27.936148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3404/6915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:27 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:28.959978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:28.960619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:28.967677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.968354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.968654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:28.969378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:28.969874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:28.970331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:29.113010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:29.120937 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb54a6ec-111d-445e-b363-133198951479 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.165784 Oct 04 18:45:29.121501 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3512/6916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:28 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:30.147374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:30.147998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:30.155420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.155974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.156409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.157133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:30.157621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:30.158080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:30.297263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:30.305508 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-95f37cef-753b-49c0-aef7-dea0f06f7c96 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.162050 Oct 04 18:45:30.306090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3405/6917] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:30 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:31.329532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:31.330900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:31.338455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.338901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.339363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.340091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:31.340571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:31.341025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:31.485318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:31.493531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c84381a2-2012-4624-a022-06e4e84b9b6c tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.167901 Oct 04 18:45:31.494150 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3513/6918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:31 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:32.520523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:32.521230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:32.528807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.529306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.529782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.530554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:32.531055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:32.531519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:32.932474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:32.941628 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e30b7a95-2928-4d8d-9142-4ea622e3207d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.426477 Oct 04 18:45:32.942239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3406/6919] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:32 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:33.966141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:33.967018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:33.975280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.975807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.976270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:33.977016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:33.977535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:33.978025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:34.133886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:34.142029 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a40067d0-29c5-4f23-ba4d-27847ec5dd68 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.179799 Oct 04 18:45:34.143524 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3514/6920] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:33 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:35.166990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:35.167548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:35.175009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.175575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.176016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.176712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:35.177166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:35.177593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:35.327254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:35.335765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a76ebb9d-45b1-41e5-9690-aa294cf2e082 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.172765 Oct 04 18:45:35.336325 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3407/6921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:35 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:36.365264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:36.365823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:36.372596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.373098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.373578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.374317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:36.374789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:36.375234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:36.517797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:36.525790 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d7b1f5c-1375-4b7d-8249-b43174f2eed0 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.165049 Oct 04 18:45:36.526386 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3515/6922] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:36 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:37.549220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:37.550072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:37.557113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.557609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.558077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.558782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:37.559239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:37.559669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:37.699804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:37.709048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c6cbcc7-be4c-4825-babb-dcd4fa2a3772 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.164221 Oct 04 18:45:37.709635 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3408/6923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:37 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:38.732731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:38.733461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:38.742145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.742691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.743193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.743988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:38.744497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:38.744972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:38.887889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:38.896299 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc5c7d27-a9fe-4b26-915a-a9a3f132d4d3 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.167855 Oct 04 18:45:38.896871 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3516/6924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:38 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:39.920447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:39.921057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:39.928396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.928885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.929318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:39.930041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:39.930501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:39.930929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:40.071906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:40.079711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e47af100-4984-44bf-be98-97964db3b21e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.163156 Oct 04 18:45:40.080356 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3409/6925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:39 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:41.103347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:41.103989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:41.111510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.112028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.112499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.113234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:41.113714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:41.114200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:41.250263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:41.259680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b850ae0a-a541-45d1-89e2-ef89b391ffc7 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.160367 Oct 04 18:45:41.260266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3517/6926] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:41 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:42.286451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:42.287112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:42.294157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.294663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.295110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.295883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:42.296348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:42.296787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:42.449402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:42.460054 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0be6909-4dfa-46fb-98ed-fe679062e9ce tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.178756 Oct 04 18:45:42.460645 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3410/6927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:42 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:43.484371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:43.485005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:43.494089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.494608 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.495063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.495792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:43.496285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:43.496727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:43.646315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:43.654865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-697f9386-39d1-4adb-888e-fca85852b170 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.174521 Oct 04 18:45:43.655466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3518/6928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:43 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:44.681372 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:44.682305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:44.694313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.695320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.696200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.697688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:44.698642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:44.699466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:44.902495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:44.911760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f05eaf3b-a40d-4c66-8979-8a05c3e18a33 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.234844 Oct 04 18:45:44.912377 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3411/6929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:44 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:45.937149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:45.937709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:45.946703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.947219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.947682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:45.948452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:45.948931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:45.949415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:46.100530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:46.109577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-788887df-6ac9-44be-855b-cc0a9ccfe421 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.176927 Oct 04 18:45:46.110300 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3519/6930] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:45 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:47.133945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:47.134579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:47.144140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.144657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.145114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.145902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:47.146370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:47.146802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:47.298777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:47.308416 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ae8d718-748c-4a23-9cc2-ffd59a773685 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.178576 Oct 04 18:45:47.309007 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3412/6931] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:47 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:45:48.341886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:48.342458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:48.349466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.350022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.350480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.351200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:48.351664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:48.352105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:48.487451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:48.495375 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f2caf9f-b6d4-463d-9a0b-cb2ad70a3075 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.157693 Oct 04 18:45:48.495986 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3520/6932] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:48 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:49.520101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:49.524182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:49.528820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.529318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.529900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.530767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:49.531237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:49.531676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:49.677272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:49.685381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-24157029-8af4-4b52-bbb3-358f25ba8e83 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.169832 Oct 04 18:45:49.686002 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3413/6933] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:49 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:50.711853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:50.712444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:50.720038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.721125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.721674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.722519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:50.723001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:50.723473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:50.726487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=82 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:50.895503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:50.903812 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27cd6acb-b127-4b71-a1c1-3e2f94570a3e tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1515 microversion: 2.1 time: 0.196734 Oct 04 18:45:50.904410 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3521/6934] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:50 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1515 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:51.930192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:51.930866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:51.934194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:51.940736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.941244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.941697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.942466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:51.942917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:51.943347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:51.946465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:52.085068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "name": "network-vif-unplugged", "status": "completed", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:52.090337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=28 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:45:52.096629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:52.097133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:52.097589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:52.113075 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Creating event network-vif-unplugged:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h2-831194-21 Oct 04 18:45:52.118580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:52.119232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:45:52.132248 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54aac517-e955-4ef9-9ec2-e28643b35e49 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1514 microversion: 2.1 time: 0.207569 Oct 04 18:45:52.133213 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3414/6935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:51 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:52.133856 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0e0ef8ae-1fa4-4e50-a545-0b7eaa09b4e7 req-3d723dc1-d8c7-4caf-aad9-d9b8d34ec1f5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149761 Oct 04 18:45:52.136130 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3522/6936] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:45:53.158314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:53.158913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:53.166117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.166619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.167071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.167794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:53.168261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:53.168698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:53.315216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:53.323365 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d958d5b9-97ea-4609-a382-c559c60173f9 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1512 microversion: 2.1 time: 0.169611 Oct 04 18:45:53.323957 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3415/6937] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:53 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:54.157275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:54.166954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.167442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.167887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.179396 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Creating event network-changed:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h2-831194-21 Oct 04 18:45:54.184725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:45:54.196048 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c1548d51-73df-4103-9908-2b3537bd2518 req-f9751d49-144e-432a-9164-39d81273da87 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043879 Oct 04 18:45:54.196644 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3523/6938] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:54.348634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:54.349227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:54.357533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.358054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.358490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.359260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:54.359723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:54.360333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:54.607033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:54.629316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6d65cedd-5044-4fc9-96ea-49a99ecc1c2a tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1512 microversion: 2.1 time: 0.284596 Oct 04 18:45:54.630133 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3416/6939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:54 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1512 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:55.657076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.658369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.665039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.665757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.666391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.667159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.667644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.668186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.807997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:55.816455 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c30d20b4-9e43-471c-992b-080640f7ccee tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1509 microversion: 2.1 time: 0.164609 Oct 04 18:45:55.817007 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3524/6940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:55 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:55.840503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:55.841075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:55.849635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.850165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.850619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.851343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:55.851809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:55.852249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:55.886069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:45:55.941930 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.compute.api [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Found an unconfirmed migration during delete, id: 16, status: finished Oct 04 18:45:57.467103 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7d8489ed-dc6b-4f7e-b6c4-3c52f81cd603 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 204 len: 0 microversion: 2.1 time: 1.630238 Oct 04 18:45:57.467915 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3417/6941] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:55 2022] DELETE /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 0 bytes in 1632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:45:57.477906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:57.478620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:57.485694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.486248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.486805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.487541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:57.488026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:57.488476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:57.625313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:57.634632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6e994d0e-b5aa-4e4c-a9ec-00b6b975f02d tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1501 microversion: 2.1 time: 0.161758 Oct 04 18:45:57.635232 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3525/6942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:57 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:58.630408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "name": "network-vif-plugged", "status": "completed", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:58.653051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.653873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.654335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.659057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:58.660289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:58.667647 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] Creating event network-vif-plugged:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h2-831194-21 Oct 04 18:45:58.667897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.668478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.668910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.669700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:58.670375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:58.670932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:58.674054 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b8cd16a2-c783-45bd-8244-17f82518fe6f req-30c36d9b-6966-4878-80d5-60effb4d44fc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047009 Oct 04 18:45:58.675045 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3418/6943] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:58.830628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d2b4bb51149403a9f0ef40332d446b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ff08960db24faba2a94b7e33113be7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:45:58.838973 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4f325bf-387a-4ece-a49a-2ff67491b809 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 200 len: 1501 microversion: 2.1 time: 0.184326 Oct 04 18:45:58.839458 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3526/6944] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:58 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:45:59.421307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a976ea34-eddb-47ff-a3e9-9d98439c8db5", "name": "network-vif-deleted", "tag": "9269a344-5269-4d20-80df-f635d29d5051"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:45:59.432812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.434229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.434864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.456863 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] Creating event network-vif-deleted:9269a344-5269-4d20-80df-f635d29d5051 for instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 on n-h2-831194-21 Oct 04 18:45:59.465735 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-75f0760c-5938-40bc-b784-eb316b5b6bd5 req-0e2c84b3-b53e-4a6b-ab98-1d4bf56d98e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049071 Oct 04 18:45:59.466800 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3419/6945] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:45:59.869295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.869883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.877399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.877979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.878448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.879183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.879667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.880154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.896345 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] HTTP exception thrown: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Request method failure captured: Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 HTTP/1.1 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH82phcwinTDMypK14XhpvUfdmMRxI3NTJESoIYuaF3xespw-HHzDPkKfkqqCHYlTemeaLtPa6wtqShxhwmTNOcGj52JDDqQ07ur0mWA0B0RTsd75MJJYE06emqMTTVv7AHJNGmF1FwYPULpiZSloKUuTrJ0YzDDo5AnkTUIvJbxkZ8 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ff08960db24faba2a94b7e33113be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3d2b4bb51149403a9f0ef40332d446b4 Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a976ea34-eddb-47ff-a3e9-9d98439c8db5'} Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.898110 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Returning 404 to user: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b194e709-208f-4992-9461-ec2ff47ee589 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 404 len: 111 microversion: 2.1 time: 0.034484 Oct 04 18:45:59.904555 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3527/6946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:59.918572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.919167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.926949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.927453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.928344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.929055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.929811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.930152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.944357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] HTTP exception thrown: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Request method failure captured: Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 HTTP/1.1 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH82phcwinTDMypK14XhpvUfdmMRxI3NTJESoIYuaF3xespw-HHzDPkKfkqqCHYlTemeaLtPa6wtqShxhwmTNOcGj52JDDqQ07ur0mWA0B0RTsd75MJJYE06emqMTTVv7AHJNGmF1FwYPULpiZSloKUuTrJ0YzDDo5AnkTUIvJbxkZ8 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ff08960db24faba2a94b7e33113be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 3d2b4bb51149403a9f0ef40332d446b4 Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a976ea34-eddb-47ff-a3e9-9d98439c8db5'} Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:59.946093 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Returning 404 to user: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de2b15e4-10aa-4297-ba53-2d0c573403f2 tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 404 len: 111 microversion: 2.1 time: 0.034601 Oct 04 18:45:59.951198 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3420/6947] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:45:59 2022] DELETE /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:45:59.957355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:45:59.958026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] [instance: a976ea34-eddb-47ff-a3e9-9d98439c8db5] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:45:59.964310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.964853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.965375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.966309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:45:59.966919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:45:59.967252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:45:59.982915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] HTTP exception thrown: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Request method failure captured: Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 HTTP/1.1 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH82phcwinTDMypK14XhpvUfdmMRxI3NTJESoIYuaF3xespw-HHzDPkKfkqqCHYlTemeaLtPa6wtqShxhwmTNOcGj52JDDqQ07ur0mWA0B0RTsd75MJJYE06emqMTTVv7AHJNGmF1FwYPULpiZSloKUuTrJ0YzDDo5AnkTUIvJbxkZ8 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/29ff08960db24faba2a94b7e33113be7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_29ff08960db24faba2a94b7e33113be7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 29ff08960db24faba2a94b7e33113be7 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-DeleteServersTestJSON-429427665 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 3d2b4bb51149403a9f0ef40332d446b4 Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-DeleteServersTestJSON-429427665-project Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'a976ea34-eddb-47ff-a3e9-9d98439c8db5'} Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:45:59.984490 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] Returning 404 to user: Instance a976ea34-eddb-47ff-a3e9-9d98439c8db5 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa804cb8-e660-498d-9522-6c92426a77db tempest-DeleteServersTestJSON-429427665 tempest-DeleteServersTestJSON-429427665-project] 10.222.0.42 "GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5" status: 404 len: 111 microversion: 2.1 time: 0.033273 Oct 04 18:45:59.989197 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3528/6948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:45:59 2022] GET /compute/v2.1/servers/a976ea34-eddb-47ff-a3e9-9d98439c8db5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:46:09.605053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-273578576", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "a49ae0f2-9ff2-4a94-ac68-e6eefc3f5e1a"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:09.663329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] validate_networks() for [('a49ae0f2-9ff2-4a94-ac68-e6eefc3f5e1a', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:09.935359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:10.070920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:10.071345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:10.071825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:10.072234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:10.072647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:10.082913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.083652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.083822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.084545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:10.084998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:10.085423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:10.103546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for project c059e9bad83c451c8034e45cf2e21e00. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:10.108940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for user 42635a4346b1428381f601756ae0c3a2 and project c059e9bad83c451c8034e45cf2e21e00. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:10.122371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:10.124527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:10.174821 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e216e1be-ab62-4a30-ba7e-faac61bf563d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702317 Oct 04 18:46:10.181409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3421/6949] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:10.186788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c23198b1-7a70-41d4-8665-d1cfdfac76c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:10.187437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c23198b1-7a70-41d4-8665-d1cfdfac76c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:10.192623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=13 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:10.193307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=35 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:10.260979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c23198b1-7a70-41d4-8665-d1cfdfac76c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:10.271652 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c23198b1-7a70-41d4-8665-d1cfdfac76c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1217 microversion: 2.1 time: 0.087268 Oct 04 18:46:10.271652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3529/6950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:10 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:11.295256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:11.295885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:11.303465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.303961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.304405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.305116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:11.305775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:11.306405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:11.404735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:11.416523 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fceff094-e6e6-458c-a70f-1b62d3c1aefe tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1277 microversion: 2.1 time: 0.125988 Oct 04 18:46:11.417725 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3422/6951] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:11 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1277 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:12.446167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:12.447399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:12.456526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.457327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.457984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.459111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:12.459734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:12.460329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:12.623931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:12.632575 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c133dbc-4bf6-4f04-a7a5-9a566c3980b9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.190635 Oct 04 18:46:12.633693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3530/6952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:12 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:13.018368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:13.043075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.043891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.044547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.065940 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] Creating event network-changed:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h1-831194-21 Oct 04 18:46:13.088613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d48840db-aeda-41d8-8362-844cfa22bc0c req-01d04895-45d4-4a4c-8e97-ba32ec0e0342 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072148 Oct 04 18:46:13.089276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3423/6953] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:13.657869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:13.658449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:13.665868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.666382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.666839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.667560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:13.668034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:13.668476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:13.803001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:13.810788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1006c80c-1c24-48d8-ac93-4c4e1cda01a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.157115 Oct 04 18:46:13.811352 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3531/6954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:13 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:14.834424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:14.835253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:14.842619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.843110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.843548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:14.844253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:14.845593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:14.846093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:15.019039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:15.027014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8dded339-a0ba-40b5-a80b-d0526c13e2a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.196966 Oct 04 18:46:15.027608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3424/6955] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:14 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:16.051185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:16.051810 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:16.058701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.059201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.059657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.060357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:16.060826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:16.061268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:16.194636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:16.202366 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-06f1d7e9-2293-4e62-9ceb-6aba8213f2c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.155830 Oct 04 18:46:16.202937 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3532/6956] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:16 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:17.226141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:17.226858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:17.234159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.234664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.235243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.236888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:17.237734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:17.238286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:17.405722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:17.413687 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d3ac3c8-37e9-48a7-9d74-ee98568e8d1f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.192740 Oct 04 18:46:17.414286 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3425/6957] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:17 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.437004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:18.437602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:18.445210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.445734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.446226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.446986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.447485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.447900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.599851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:18.607680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18b9b67a-021c-499d-ac73-861712aa54a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.175010 Oct 04 18:46:18.608357 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3533/6958] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:18 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:18.966688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "name": "network-vif-plugged", "status": "completed", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:18.980066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:18.980582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:18.981025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:18.993746 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] Creating event network-vif-plugged:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h1-831194-21 Oct 04 18:46:18.998843 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-588f96c6-75a0-4ff4-929f-bd62fa5cab26 req-e923dc59-e182-415e-8949-d58bce2833bd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036005 Oct 04 18:46:18.999773 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3426/6959] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:19.630927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:19.631603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:19.638493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.639003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.639466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.640187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:19.640667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:19.641124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:19.775920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:19.784012 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8f9bcb76-8b5c-4c59-b133-af771b7a9a40 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1317 microversion: 2.1 time: 0.157068 Oct 04 18:46:19.784588 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3534/6960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:19 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:20.805796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:20.806909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:20.812632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:20.813888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:20.821578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.822108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.822557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.823272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:20.823737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:20.824175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:20.973602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:20.981742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0f8644f-c9f1-462d-9535-5ad14b6dc09e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1507 microversion: 2.1 time: 0.177941 Oct 04 18:46:20.982359 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3427/6961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.005096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.005744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.007774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:21.014330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.014833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.015294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.016022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.017122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.017817 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.174605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.183152 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-242585bc-750c-43db-946f-7f50ae1e3594 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1507 microversion: 2.1 time: 0.182463 Oct 04 18:46:21.183756 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3535/6962] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:20 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.206591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:21.209083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.215410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.215895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.216354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.217067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.217532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.218005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.287962 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-408515d3-1081-4114-be42-6fc8397fdb00 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "PUT /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1079 microversion: 2.1 time: 0.086000 Oct 04 18:46:21.288605 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3428/6963] 10.222.0.42 () {60 vars in 1256 bytes} [Tue Oct 4 18:46:21 2022] PUT /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1079 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.310636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.311416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.319418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.320023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.320524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.321323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.322027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.322405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.479723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.488205 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c74252b2-f126-4028-b18d-765e63552972 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1505 microversion: 2.1 time: 0.181962 Oct 04 18:46:21.488818 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3536/6964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.511775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.512586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.520622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.521135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.521582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.522334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.522871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.523247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.668856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.676926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cc4afa26-0040-46a3-ba99-709c9e2ba274 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1505 microversion: 2.1 time: 0.169801 Oct 04 18:46:21.677508 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3429/6965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:21.701726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:21.705030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.711192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.711699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.712164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.712894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.713373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.713856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.749467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:21.757653 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:46:21.766082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:21.767273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:21.768055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:21.768599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:21.769100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:21.844611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2bd13426-e095-4cd8-bfff-e02e4e3dc472 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f/action" status: 202 len: 0 microversion: 2.1 time: 0.146425 Oct 04 18:46:21.845703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3537/6966] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:21 2022] POST /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:46:21.857171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:21.857722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:21.865939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.866542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.867044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:21.867823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:21.868231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:21.868693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:22.054455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:22.063872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e3e7889-8037-4160-b415-adf7c89db40e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1516 microversion: 2.1 time: 0.212959 Oct 04 18:46:22.064846 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3430/6967] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:21 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1516 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:23.095364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:23.096028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:23.104483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.105171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.105726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.106564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:23.107099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:23.107980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:23.251159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:23.260277 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e3644598-aad5-4629-a62e-1b0b9d5a79a5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1516 microversion: 2.1 time: 0.170502 Oct 04 18:46:23.260879 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3538/6968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:23 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:24.289269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:24.289933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:24.292608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:24.299424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.299920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.300364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.301068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:24.301531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:24.302000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:24.446036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:24.454077 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f35b4c8b-9daa-4716-af55-3332346aaaf5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.168509 Oct 04 18:46:24.454608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3431/6969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:24 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:25.477390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:25.478053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:25.485090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.485594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.486105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.487276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:25.487276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:25.487719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:25.627628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:25.635475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24940628-e201-40c2-bec6-add67cc916ac tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.162137 Oct 04 18:46:25.636045 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3539/6970] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:25 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:26.659854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:26.660479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:26.667504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.668021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.668499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.669239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:26.669762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:26.670262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:26.807848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:26.816304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46cea6ff-c277-43b3-9d8f-acb1ac90147f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160977 Oct 04 18:46:26.816889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3432/6971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:26 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:27.839793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:27.840438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:27.847643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.848153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.848618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.849339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:27.849875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:27.850333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:27.987194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:27.995158 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-495bc20f-3177-45fe-8b0a-92f97ad98f74 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.159414 Oct 04 18:46:27.995735 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3540/6972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:27 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:29.021092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:29.022352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:29.029337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.029854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.030306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.031019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:29.031483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:29.032823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:29.170294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:29.178830 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3b4791b-d8b1-4e4d-b37d-de653dae9593 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.164498 Oct 04 18:46:29.179403 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3433/6973] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:29 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:30.204084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:30.204893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:30.207827 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:46:30.208008 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:46:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f (ip 10.222.0.42) !!! Oct 04 18:46:30.216339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.216339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.217502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.218055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:30.218512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:30.218955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:30.354328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:30.362166 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83b47bf3-4f96-499c-bce0-d6d2eafc38ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.162736 Oct 04 18:46:30.362737 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3541/6974] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:30 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:31.385186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:31.385801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:31.387862 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:46:31.388004 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:46:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f (ip 10.222.0.42) !!! Oct 04 18:46:31.400523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.401022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.401466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.402222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:31.402690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:31.403133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:31.550510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:31.558298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5b6e695-94b1-43fc-b963-63bc47616506 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.177015 Oct 04 18:46:31.558905 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3434/6975] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:31 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:32.582532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:32.583198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:32.589649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.590177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.590630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.591338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:32.591805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:32.592247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:32.733854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:32.742621 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c4604d7b-aed6-4c54-aab1-e429412b2ce6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.164541 Oct 04 18:46:32.743581 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3542/6976] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:32 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:33.768117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:33.768734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:33.774911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.775392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.775827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.776538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:33.776991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:33.777415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:33.910620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:33.919145 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8f29c050-00bb-48f7-93a8-4f1b5dd3c00e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.156235 Oct 04 18:46:33.919726 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3435/6977] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:33 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:34.941556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:34.942276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:34.949144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.949644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.950123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:34.950828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:34.951302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:34.951739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:35.086144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:35.095203 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-137c28f7-2435-4ebc-8e32-a0de7493b23b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.157563 Oct 04 18:46:35.095795 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3543/6978] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:34 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:36.120046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:36.120671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:36.127810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.128303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.128749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.129475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:36.129959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:36.130397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:36.281689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:36.289589 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-16c95651-c46e-42f3-b333-86ebf3a8f8d8 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.173585 Oct 04 18:46:36.290199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3436/6979] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:36 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:37.312750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:37.314338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:37.321231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.321769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.322257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.322963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:37.323582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:37.323899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:37.461141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:37.469996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6c45ee12-924f-4b26-9fe0-5fa6701a6805 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160275 Oct 04 18:46:37.470179 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3544/6980] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:37 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:38.493501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:38.495732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:38.502797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.503289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.503727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.504510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:38.504966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:38.505394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:38.641597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:38.649788 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8808a9ac-0515-47c2-8e7e-8c5a1a2c93c9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160298 Oct 04 18:46:38.650389 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3437/6981] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:38 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:39.675043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:39.675713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:39.682640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.683150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.683612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.684330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:39.684807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:39.685255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:39.689386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:39.828569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:39.837871 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-730e0d60-38b3-4f76-936c-68eb4e76160b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.167639 Oct 04 18:46:39.838539 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3545/6982] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:39 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:40.865188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:40.865843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:40.872785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.873284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.874062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.874775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:40.876010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:40.876689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:40.879485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:41.014471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:41.023820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-889678ba-1fab-492d-a68c-929f50c8690f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.162871 Oct 04 18:46:41.024397 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3438/6983] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:40 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:42.048155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:42.048791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:42.051628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=41 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:42.057377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.057948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.058416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.059150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:42.059655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:42.060110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:42.207229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:42.215907 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c381151-1894-470e-9b34-f94a6b897a17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.172353 Oct 04 18:46:42.216482 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3546/6984] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:42 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:43.241023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:43.241655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:43.248776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.249269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.249716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.251160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:43.251625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:43.252061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:43.387447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:43.395807 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b71b6f40-0977-4495-b08f-e86024482f7b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.158762 Oct 04 18:46:43.396613 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3439/6985] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:43 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:44.420774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:44.421358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:44.428617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.429124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.429581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.430329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:44.430804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:44.431251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:44.568920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:44.576794 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8b4e133-c2ff-4466-ad88-da0db6c80496 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160061 Oct 04 18:46:44.577371 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3547/6986] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:44 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:45.599973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:45.600617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:45.607579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.608078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.608520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.609238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:45.610042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:45.610649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:45.752272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:45.760259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f0fad62b-8ae1-48e1-87c5-19b41eb2b418 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.164190 Oct 04 18:46:45.760875 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3440/6987] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:45 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:46.784557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:46.785210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:46.792139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.792638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.793091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.793805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:46.794295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:46.794743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:46.932521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:46.940978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5e6c99d1-a6ee-45d1-bc27-d7ddb3dd12a9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160908 Oct 04 18:46:46.941554 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3548/6988] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:46 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:47.964723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:47.965260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:47.972831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.973317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.973758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:47.974476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:47.974934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:47.975358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:48.111614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:48.121466 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-519bac42-df58-477a-a5f2-f8670f01cc79 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.160718 Oct 04 18:46:48.122100 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3441/6989] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:47 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:46:49.150835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:49.151760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:49.161087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.161599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.162097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.162831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:49.163311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:49.163764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:49.303050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:49.310927 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1bba12ba-7e13-480f-ae99-d007bd9e5093 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.169304 Oct 04 18:46:49.311527 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3549/6990] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:49 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:50.334969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:50.335526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:50.342527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.343025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.343991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.345025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:50.345498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:50.345983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:50.485409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:50.494208 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bfc491bb-e414-4116-9e13-718e3bbc370e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1521 microversion: 2.1 time: 0.163558 Oct 04 18:46:50.494812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3442/6991] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:50 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:51.517612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:51.518523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:51.526195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.526702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.527155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.527874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.528341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.528784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.623158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "name": "network-vif-unplugged", "status": "completed", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:51.635619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:51.636267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:51.636720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:51.650052 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Creating event network-vif-unplugged:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h2-831194-21 Oct 04 18:46:51.657730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:46:51.668930 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-568d1101-1d43-4b8c-89a1-f5fa114d100c req-7d04c59b-2d05-448e-a7a0-3c6a0be401c2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049511 Oct 04 18:46:51.669710 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3443/6992] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:46:51.754845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:51.768479 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee3f0eda-df51-40d5-922c-1bd0f4b57531 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1520 microversion: 2.1 time: 0.254544 Oct 04 18:46:51.769475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3550/6993] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:51 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1520 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:52.795854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:52.797083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:52.804002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.804495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.804946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.805688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:52.806203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:52.806641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:52.942689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:52.950517 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a117fe60-be96-484d-a79f-a5932c95ff08 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1518 microversion: 2.1 time: 0.159990 Oct 04 18:46:52.951092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3444/6994] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:52 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:53.697256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:53.708326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.708829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.709277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.722390 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Creating event network-changed:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h2-831194-21 Oct 04 18:46:53.727965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:46:53.738934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-78313ec3-8d46-405a-b5ef-24530be5da6b req-d7efabb2-c160-45e2-a5ed-e9f176b87ba9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045492 Oct 04 18:46:53.739539 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3551/6995] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:53.973899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:53.974521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:53.982785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.983515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.983989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:53.984972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:53.985488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:53.986154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:54.201564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:54.217637 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b7b7ad8b-c417-4a65-878f-910b2271259d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1518 microversion: 2.1 time: 0.247161 Oct 04 18:46:54.230923 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3445/6996] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:53 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1518 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.245822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.246527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.254069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.254581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.255044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.255792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.256315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.256772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.393685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.401545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6e0c0f3-a345-4086-b10d-e894eff20a9b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1515 microversion: 2.1 time: 0.161196 Oct 04 18:46:55.402161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3552/6997] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:55.425226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:55.425769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.428559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=30 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:46:55.433962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.434457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.434900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.435602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.436062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.436494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.494765 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33704d47-e4eb-4e8e-851b-cc6992c2053d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f/action" status: 204 len: 0 microversion: 2.1 time: 0.073850 Oct 04 18:46:55.495689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3446/6998] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:46:55 2022] POST /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f/action => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:55.504749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:55.505318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:55.511840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.512318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.512915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.513764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:55.514375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:55.514837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:55.660861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:55.669278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3070b87c-be99-42dd-8fc1-18cb8fda2171 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1515 microversion: 2.1 time: 0.169190 Oct 04 18:46:55.670021 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3553/6999] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:55 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:56.696343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.697454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.705128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.705746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.706329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.707168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.707744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.708334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.876645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:56.885399 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf7edbf2-a605-4ea1-9e6a-be5e46507150 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1507 microversion: 2.1 time: 0.194996 Oct 04 18:46:56.886015 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3447/7000] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:56.908966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:56.909628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:56.917953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.918467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.918930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:56.919689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:56.920164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:56.920618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:57.054503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:57.062606 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-180d44f8-c173-4c80-ac46-867aed859d8d tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1507 microversion: 2.1 time: 0.158261 Oct 04 18:46:57.063375 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3554/7001] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:56 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:57.088291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9dae5aba-ef80-4fc6-a968-3e1eae6b96d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'create', calling method: .version_select at 0x7fbdbf3bc790>, body: {"keypair": {"name": "tempest-keypair-1660787302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBix4OjkTeOM6qwApk8+Hyf73S9L1CODJohkfKz+KCqfii2C3SxwJo8uFAjMsfj4qmsxX8j7OoLxYKzwLOsfUJ7mrXBaKC2nccYwl4cLCmRhX10siThJ0OBBeYQHUcXc/w=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:57.105146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9dae5aba-ef80-4fc6-a968-3e1eae6b96d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for project c059e9bad83c451c8034e45cf2e21e00. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:57.111289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-9dae5aba-ef80-4fc6-a968-3e1eae6b96d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for user 42635a4346b1428381f601756ae0c3a2 and project c059e9bad83c451c8034e45cf2e21e00. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:57.141942 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9dae5aba-ef80-4fc6-a968-3e1eae6b96d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057581 Oct 04 18:46:57.143070 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3448/7002] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:46:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:58.676755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.677545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.684540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.685055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.685517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.686311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.686821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.687293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.727904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "name": "network-vif-plugged", "status": "completed", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:58.744542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.745077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.745554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.756713 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] Creating event network-vif-plugged:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h2-831194-21 Oct 04 18:46:58.763048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-fd4867e8-9086-4e16-9315-41bc1bf01b40 req-ea267ce4-cdd4-441a-9fd1-818af1a5aa1e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038955 Oct 04 18:46:58.764011 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3449/7003] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:46:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:46:58.837018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:58.845667 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ebc9523e-da0f-48bc-b32a-37d7dcc2f187 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 200 len: 1507 microversion: 2.1 time: 0.172925 Oct 04 18:46:58.846273 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3555/7004] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:58 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:46:58.868698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:58.869919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:58.876794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.877289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.877739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.878473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:58.878940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:58.879392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:58.910070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:46:58.986163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-72aa8bc7-2e05-4b5d-8a42-d4dd12d213bb tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 204 len: 0 microversion: 2.1 time: 0.121553 Oct 04 18:46:58.986768 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3450/7005] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:46:58 2022] DELETE /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:46:59.043685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-757587926", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "a49ae0f2-9ff2-4a94-ac68-e6eefc3f5e1a"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:46:59.102921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] validate_networks() for [('a49ae0f2-9ff2-4a94-ac68-e6eefc3f5e1a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:46:59.475118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:46:59.475565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:46:59.476064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:46:59.476493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:46:59.476926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:46:59.487043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.487549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.488006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.488759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:46:59.489239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:46:59.489681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:46:59.507552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for project c059e9bad83c451c8034e45cf2e21e00. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:46:59.512958 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Getting quotas for user 42635a4346b1428381f601756ae0c3a2 and project c059e9bad83c451c8034e45cf2e21e00. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:46:59.525766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:46:59.528163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:46:59.575032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4827d885-8557-4a58-a401-0706d9fe2f1c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.535225 Oct 04 18:46:59.575754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3556/7006] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:46:59.587456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cc222c2-eaa5-4e79-b798-50fc0f520763 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:46:59.588172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8cc222c2-eaa5-4e79-b798-50fc0f520763 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:46:59.651780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8cc222c2-eaa5-4e79-b798-50fc0f520763 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:46:59.659750 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8cc222c2-eaa5-4e79-b798-50fc0f520763 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1217 microversion: 2.1 time: 0.076535 Oct 04 18:46:59.660459 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3451/7007] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:46:59 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1217 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:00.684379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:00.685028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:00.693927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.694459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.694908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.695631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:00.696107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:00.696558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:00.764289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:00.773607 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f358ac52-cc8e-42b0-a2ba-81914a7f55f4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1269 microversion: 2.1 time: 0.093449 Oct 04 18:47:00.774275 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3557/7008] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:00 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1269 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:01.064447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c11d3654-f8fd-4d73-b130-fa6dacaef30f", "name": "network-vif-deleted", "tag": "0a8b21d4-039c-4e43-a37e-bc8d6a749b1b"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:01.084938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.086519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.087000 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.112430 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] Creating event network-vif-deleted:0a8b21d4-039c-4e43-a37e-bc8d6a749b1b for instance c11d3654-f8fd-4d73-b130-fa6dacaef30f on n-h2-831194-21 Oct 04 18:47:01.118531 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-938f5da4-0f40-4abb-8249-3e7f9cac8077 req-d3e6ad64-50dd-41e5-ae14-0a81310c3d56 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058095 Oct 04 18:47:01.120051 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3452/7009] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:01.797783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:01.799432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:01.806902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.807691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.808240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.808986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:01.809472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:01.809959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:01.965257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:01.974705 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c63884ac-e206-4385-9b91-c5ac7324e82f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.181932 Oct 04 18:47:01.976010 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3558/7010] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:01 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:02.442626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:02.455365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:02.455920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:02.456392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:02.468210 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] Creating event network-changed:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h2-831194-21 Oct 04 18:47:02.473980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a7de2777-d313-4610-aeef-976fd81afc26 req-c8f8b559-4ae5-4238-9b6c-19465d7a1395 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037932 Oct 04 18:47:02.474773 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3453/7011] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:03.001349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:03.002098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:03.008256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.008792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.009276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.010071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:03.010562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:03.011058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:03.150001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:03.157778 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-36292858-9f5a-48c7-a956-0bc94d3bdbec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.162027 Oct 04 18:47:03.158370 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3559/7012] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:02 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:04.181290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:04.182134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:04.190202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.190804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.191965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.192768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:04.193299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:04.193803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:04.353572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:04.361914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9cfd3aea-dbfe-4f35-80f2-bfd630c9db17 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.184902 Oct 04 18:47:04.362482 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3454/7013] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:04 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:05.385349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:05.385915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:05.393934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.394455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.394908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.395626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:05.396100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:05.396546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:05.532690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:05.540410 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c035b7d-110e-4b8c-bb6c-277a69702c14 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.159184 Oct 04 18:47:05.540988 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3560/7014] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:05 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:06.565202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:06.565810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:06.573641 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.574164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.574606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.575321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:06.575837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:06.576263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:06.764320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:06.775288 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c42c240b-9477-405b-b01d-950b8aa7cf32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.215000 Oct 04 18:47:06.776101 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3455/7015] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:06 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:07.803040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:07.803682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:07.810955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.811468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.811934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.812661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:07.813139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:07.813591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:07.961997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:07.972789 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1ac2137b-74ec-41f4-8cba-88d125f70a75 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.173862 Oct 04 18:47:07.973376 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3561/7016] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:07 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:08.737656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "name": "network-vif-plugged", "status": "completed", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:08.752119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:08.752818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:08.753229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:08.757383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:08.766783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] Creating event network-vif-plugged:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h2-831194-21 Oct 04 18:47:08.772338 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b52ffbe3-cadd-401a-8774-04b55320610e req-7dad57a3-58f2-4c2f-9f8e-78d5eaf56103 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Oct 04 18:47:08.773222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3456/7017] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:08.997426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:08.998455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:09.006954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.007792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.008511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.009622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:09.010388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:09.011075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:09.164019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:09.167590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=100 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:09.173630 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b4f21329-50a6-4080-bea1-ace523b93970 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1317 microversion: 2.1 time: 0.180920 Oct 04 18:47:09.174248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3562/7018] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:08 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.193820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:10.199018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.199732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.207916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.208406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.208855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.209557 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.210050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.210483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.347735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.355653 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea621ea9-26fc-48bf-9df1-527d2df4dadf tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1506 microversion: 2.1 time: 0.162822 Oct 04 18:47:10.356222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3457/7019] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:10.379839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.380495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.382365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:10.383226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:10.390298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.390798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.391252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.391964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.392435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.392873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.523887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.531877 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f039423-fa1a-4987-918f-103ab8cb8da5 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1506 microversion: 2.1 time: 0.155930 Oct 04 18:47:10.532451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3563/7020] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:10.554945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:10.557278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.564918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.565417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.565889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.566596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.567061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.567501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.599386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.604835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:47:10.612433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:10.612869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:10.613351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:10.613771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:10.614223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:10.679369 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b58bf17-3ad7-4103-bd0d-dd2f4934eb48 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c/action" status: 202 len: 0 microversion: 2.1 time: 0.128725 Oct 04 18:47:10.679982 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3458/7021] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:10 2022] POST /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:10.689143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:10.689890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:10.696083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.696591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.697046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.697769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:10.698262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:10.698712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:10.840710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:10.850511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-426d8725-6689-4e7c-929f-c08827fa2986 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1513 microversion: 2.1 time: 0.166180 Oct 04 18:47:10.851729 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3564/7022] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:10 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:11.877221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:11.877889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:11.885499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.886029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.886477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:11.887200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:11.887783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:11.888349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:12.074206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:12.084644 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aafbb088-d288-433f-a004-0c36fe8e4a99 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1513 microversion: 2.1 time: 0.212981 Oct 04 18:47:12.085246 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3459/7023] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:11 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:13.108575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:13.109216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:13.112302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:13.117695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.118237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.118699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.119428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:13.119913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:13.120362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:13.261989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:13.271333 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae9fe613-7e44-4200-805d-75b4e3f4734b tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.166897 Oct 04 18:47:13.271913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3565/7024] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:13 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:14.295289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:14.296430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:14.303671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.304165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.304614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.305317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:14.305782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:14.306240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:14.445064 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:14.452936 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8cb67142-fb22-400f-9895-4a97d5e0b086 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.161597 Oct 04 18:47:14.453518 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3460/7025] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:14 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:15.476491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:15.477125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:15.484494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.485003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.485469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.486678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:15.487162 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:15.487614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:15.626063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:15.638095 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10bfd09e-e07a-4d1b-a780-fb8413b6bac1 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.165524 Oct 04 18:47:15.638665 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3566/7026] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:15 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:16.661573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:16.662248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:16.669200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.669681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.670220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.670977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:16.671443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:16.671987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:16.806304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:16.816608 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79e6da0a-b454-459f-982f-4c5cedff70dc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.158844 Oct 04 18:47:16.817218 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3461/7027] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:16 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:17.840821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:17.841466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:17.851938 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.852455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.852923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.853660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:17.854243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:17.854702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:17.993605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:18.002344 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf48a0e3-e3e1-4bdf-989a-d6008bcd6cef tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.165488 Oct 04 18:47:18.002922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3567/7028] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:17 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:19.026819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:19.027446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:19.034962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.035459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.035927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.036614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:19.037077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:19.037512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:19.175619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:19.183420 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-189f7187-6573-4bf2-8ff8-6679ccd4897e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.160581 Oct 04 18:47:19.183994 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3462/7029] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:19 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:20.207082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:20.207750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:20.215245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.215794 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.216262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.217025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:20.217511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:20.218310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:20.363041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:20.370900 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0735d14-d149-49e5-b72d-e42ecf08f315 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.168021 Oct 04 18:47:20.371490 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3568/7030] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:20 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:21.395295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:21.395903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:21.403033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.403529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.403977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.404688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:21.406117 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:21.406679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:21.547970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:21.555910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c9862ab3-36ac-4cae-974f-f307867cf586 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.164926 Oct 04 18:47:21.556507 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3463/7031] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:21 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:22.578940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:22.579553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:22.586919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.587427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.587889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.588613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:22.589088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:22.589537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:22.734862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:22.742776 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0f16173-4f3c-4a00-b7af-dd819baaa954 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.167805 Oct 04 18:47:22.743355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3569/7032] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:22 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:23.768335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:23.768964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:23.775909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.776401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.776846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.777555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:23.778147 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:23.778583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:23.923280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:23.933413 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-04dd0b9f-5ba6-4d8a-99fa-b8e8b8a55c41 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.170363 Oct 04 18:47:23.934908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3464/7033] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:23 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:24.961046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:24.961749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:24.969428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.969886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.970363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:24.971099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:24.971578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:24.972032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:25.226574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:25.235139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e6d8e7d9-1673-41a2-9d9d-f1537008488a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.278149 Oct 04 18:47:25.235727 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3570/7034] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:24 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:26.258751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:26.259373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:26.262229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:26.268928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.269426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.269898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.270634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:26.271100 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:26.271542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:26.470611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:26.478638 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f7bd03d-3689-4b16-8cdf-04755d8cd484 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.223808 Oct 04 18:47:26.479218 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3465/7035] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:26 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:27.504201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:27.504838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:27.511805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.512319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.512784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.513508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:27.514020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:27.515240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:27.666253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:27.675071 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d376c757-6bc7-45b0-a30d-0cc6404ae3a4 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.174882 Oct 04 18:47:27.675675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3571/7036] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:27 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:28.699460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:28.700078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:28.707492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.707993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.708440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.709182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:28.709647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:28.710119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:28.846715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:28.854447 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77360c34-ddbc-4ec8-9e84-3fe03435831f tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.158946 Oct 04 18:47:28.855043 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3466/7037] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:28 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:29.886528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:29.887169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:29.895142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.895654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.896116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:29.896839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:29.897313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:29.897763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:30.045257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:30.054165 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d9b4704d-96b4-4a74-82bf-da55f3cd8ed6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.171605 Oct 04 18:47:30.054746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3572/7038] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:29 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:31.079156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:31.079788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:31.087096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.087872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.088056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.088776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:31.089270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:31.089706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:31.330651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:31.338335 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c1dd9c5e-d877-45da-9437-bd90ca8ffbc2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.264102 Oct 04 18:47:31.338910 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3467/7039] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:31 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:32.362255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:32.362834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:32.369358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.369899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.370374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.371100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:32.371581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:32.372037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:32.600577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:32.608474 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-12058115-64ff-4a81-aa55-db2d64fb63c2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.250329 Oct 04 18:47:32.609057 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3573/7040] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:32 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:33.633107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:33.633742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:33.640270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.640761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.641204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.641959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:33.642421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:33.642852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:33.775839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:33.783855 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-349f617a-0cb0-414d-acb4-238b73f3d697 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.155214 Oct 04 18:47:33.784436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3468/7041] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:33 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:34.807535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:34.808245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:34.815753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.816259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.816712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.817457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:34.817954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:34.818400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:34.952589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:34.960326 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-96aa2111-620d-4d04-95de-05396520ac02 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.156735 Oct 04 18:47:34.960894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3574/7042] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:34 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:35.983439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:35.984115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:35.990886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.991371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.991807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:35.992498 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:35.992950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:35.993381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:36.131419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:36.139444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fd7ba333-6bd9-476f-aa7d-976ffddf49ec tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.160395 Oct 04 18:47:36.140028 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3469/7043] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:35 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:37.162886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:37.163529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:37.171032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.171549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.172023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.172751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:37.173231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:37.173684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:37.310356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:37.319406 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0fb5ef1-436f-4b61-b85b-884ea20b71d9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.160455 Oct 04 18:47:37.319983 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3575/7044] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:37 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:38.343939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:38.344485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:38.351491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.351988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.352435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.353142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:38.353605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:38.354074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:38.492423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:38.500752 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c93d51e6-0db7-4b68-9c6c-90a109529a97 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.161699 Oct 04 18:47:38.501325 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3470/7045] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:38 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:39.524771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:39.525449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:39.533772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.534318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.534784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.535520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:39.535998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:39.536458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:39.540704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=79 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:39.681249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:39.691368 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-03f51cf5-c88b-45c5-8bfa-4c94a2e9cafc tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1518 microversion: 2.1 time: 0.170168 Oct 04 18:47:39.692115 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3576/7046] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:39 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1518 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:40.358429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "name": "network-vif-unplugged", "status": "completed", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:40.368152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.368659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.369110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.372813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:40.383643 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Creating event network-vif-unplugged:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h1-831194-21 Oct 04 18:47:40.391010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:40.403816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8ad1903e-6215-47f7-bf2e-fc16451c45a9 req-4ef148f4-305b-4fe7-82e2-cc8fdb3b573a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106223 Oct 04 18:47:40.405993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3471/7047] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:40.718629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:40.719277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:40.727010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.727520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.727981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.728704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:40.729182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:40.729630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:40.868340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:40.876183 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e584eb78-d5be-4605-af9c-ffbc6a80b0f9 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1517 microversion: 2.1 time: 0.163273 Oct 04 18:47:40.876768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3577/7048] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:40 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:41.901437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:41.902164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:41.909137 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.909630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.910118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:41.910906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:41.911365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:41.911789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.047091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:42.054932 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a7ff6619-abbf-460a-a013-67d7297a947a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1515 microversion: 2.1 time: 0.158661 Oct 04 18:47:42.055504 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3472/7049] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:41 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:42.432694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:42.443025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:42.443534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:42.443993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:42.459432 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Creating event network-changed:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h1-831194-21 Oct 04 18:47:42.464802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:47:42.475888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-664d9cd5-2fc4-432e-93f9-ac3e092010d4 req-24bd37a7-ce54-4e21-8288-74264b1c1dcf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048501 Oct 04 18:47:42.476496 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3578/7050] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:43.078334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.079102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.085893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.086389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.086829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.087533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.088010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.088418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.754130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:43.761005 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-534ea11a-f29f-43d6-ac25-ac2b456bbef7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1512 microversion: 2.1 time: 0.686823 Oct 04 18:47:43.762277 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3473/7051] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1512 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:43.787427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:43.787979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.796402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=28 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:43.799303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.800029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.800498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.801241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.801721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.802610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.867359 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4af5ab88-8d18-405a-bd70-ecdfa8bc52d7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "POST /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c/action" status: 204 len: 0 microversion: 2.1 time: 0.084297 Oct 04 18:47:43.868014 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3579/7052] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:47:43 2022] POST /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:43.876389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:43.877051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:43.883688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.884391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.885027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:43.885911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:43.886441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:43.886956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:44.111733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:44.119594 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ac40978-4b62-47ad-98f6-7ae075f681b2 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1512 microversion: 2.1 time: 0.247156 Oct 04 18:47:44.120175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3474/7053] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:43 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1512 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.147144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.147872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.157364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.158271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.159085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.160238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.160987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.161734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.322359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.334328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1a4068b-7aa9-4244-847f-9f03861c62c7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1504 microversion: 2.1 time: 0.191409 Oct 04 18:47:45.335602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3580/7054] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.367495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.368335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.379318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.380049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.380747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.381773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.382529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.383093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.535528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:45.543337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fafcd262-0f13-4a73-a81b-ab7670cb590e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1504 microversion: 2.1 time: 0.181379 Oct 04 18:47:45.543908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3475/7055] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:45.565854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:45.566487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:45.572598 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.573105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.573563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:45.574320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:45.574824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:45.575246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.017811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.025915 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0694cfe0-1373-481f-9209-5fabe25ab79e tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1504 microversion: 2.1 time: 0.463958 Oct 04 18:47:46.026479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3581/7056] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:45 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:47:46.048476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.048980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.055005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.055496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.055938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.056627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.057087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.057552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.082911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:46.162960 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-299d2190-4f6a-481c-82b5-feb8f6009c32 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 204 len: 0 microversion: 2.1 time: 0.118371 Oct 04 18:47:46.163561 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3476/7057] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:46 2022] DELETE /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:47:46.185552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.186194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.193311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.193835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.194321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.195046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.195524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.195976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.222424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:47:46.267104 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Instance is already in deleting state, ignoring this request Oct 04 18:47:46.267955 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2ab93f7d-7f2b-4cfb-8503-5fa3702ae89c tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 204 len: 0 microversion: 2.1 time: 0.087755 Oct 04 18:47:46.268785 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3582/7058] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:46 2022] DELETE /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:47:46.277428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:46.278194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:46.285882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.286378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.286821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.287527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:46.287984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:46.288412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:46.430103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:46.438168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d0250b17-9132-472a-9473-82f9b6b4287a tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1510 microversion: 2.1 time: 0.164952 Oct 04 18:47:46.438744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3477/7059] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:46 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:47.345791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "name": "network-vif-plugged", "status": "completed", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:47.358850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.359367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.359824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.371433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] Creating event network-vif-plugged:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h1-831194-21 Oct 04 18:47:47.377373 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-82ca49c6-c5af-4f1e-997d-778b2a211286 req-a5c731cf-5e85-4d16-bf20-1c8bc44577b4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035737 Oct 04 18:47:47.377999 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3583/7060] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:47.461597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:47.462272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:47.470025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.470534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.470980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.471682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:47.472135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:47.472587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:47.600216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42635a4346b1428381f601756ae0c3a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c059e9bad83c451c8034e45cf2e21e00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:47:47.608252 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c4ac6f1-1ef5-4c75-95d4-bd151a712fb7 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 200 len: 1510 microversion: 2.1 time: 0.150339 Oct 04 18:47:47.608833 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3478/7061] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:47 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:47:48.307062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c", "name": "network-vif-deleted", "tag": "4a16ea67-44d0-4039-bc97-859da87267ca"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:48.318481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.319356 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.319978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.334735 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] Creating event network-vif-deleted:4a16ea67-44d0-4039-bc97-859da87267ca for instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c on n-h1-831194-21 Oct 04 18:47:48.340117 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b94e0ecc-8ddd-4ba7-b273-b44f4b47c207 req-73d346da-78fc-4f6b-b5a3-efa088bc5271 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037095 Oct 04 18:47:48.340726 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3584/7062] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:48.633172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.633683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:48.641296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.641784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.642254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.642941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:48.643651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:48.644078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:48.658106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] HTTP exception thrown: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Request method failure captured: Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c HTTP/1.1 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH9xtXBG3qg_ZlGM7uSlrfkHljlT0QAMBJ9Y8LeW0AkPK8bvpZw636JxD5bZPnRGReYk56ZAVguVGTEfL-X1fWOTwGzwB0tZ9VSBcy7dNu5qNiSbhVJUOa0nSjMgLKC6-AqdsjLvbrGlvZ8t3bTuV26VMF3lNWKgP4OU2PeDwUE4Doo Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 42635a4346b1428381f601756ae0c3a2 Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c'} Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:48.659814 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Returning 404 to user: Instance 2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28f27966-7d0b-4443-ba92-db44c14ef0f3 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c" status: 404 len: 111 microversion: 2.1 time: 0.032043 Oct 04 18:47:48.664562 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3479/7063] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:48 2022] GET /compute/v2.1/servers/2b2cf1c2-96a6-4d9d-a561-45d2a7c1131c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:48.672201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-47655821-1e1f-4b0f-862c-f46d9752bec6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '.version_select at 0x7fbdbd2591f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:48.695180 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-47655821-1e1f-4b0f-862c-f46d9752bec6 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660787302" status: 202 len: 0 microversion: 2.1 time: 0.028342 Oct 04 18:47:48.695761 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3585/7064] 10.222.0.42 () {58 vars in 1221 bytes} [Tue Oct 4 18:47:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660787302 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:47:49.332911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.333412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.339429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.339913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.340357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.341043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.341495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.342127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.355457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] HTTP exception thrown: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Request method failure captured: Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f HTTP/1.1 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH9xtXBG3qg_ZlGM7uSlrfkHljlT0QAMBJ9Y8LeW0AkPK8bvpZw636JxD5bZPnRGReYk56ZAVguVGTEfL-X1fWOTwGzwB0tZ9VSBcy7dNu5qNiSbhVJUOa0nSjMgLKC6-AqdsjLvbrGlvZ8t3bTuV26VMF3lNWKgP4OU2PeDwUE4Doo Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 42635a4346b1428381f601756ae0c3a2 Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'c11d3654-f8fd-4d73-b130-fa6dacaef30f'} Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:49.356990 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Returning 404 to user: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-864d8ff9-e86b-4738-b732-6cf1cb4a2a20 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 404 len: 111 microversion: 2.1 time: 0.029967 Oct 04 18:47:49.362603 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3480/7065] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:47:49 2022] DELETE /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:49.367639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:47:49.368395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] [instance: c11d3654-f8fd-4d73-b130-fa6dacaef30f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:47:49.375823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.376328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.376781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.377492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:49.377999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:49.378441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:49.394833 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] HTTP exception thrown: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Request method failure captured: Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f HTTP/1.1 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH9xtXBG3qg_ZlGM7uSlrfkHljlT0QAMBJ9Y8LeW0AkPK8bvpZw636JxD5bZPnRGReYk56ZAVguVGTEfL-X1fWOTwGzwB0tZ9VSBcy7dNu5qNiSbhVJUOa0nSjMgLKC6-AqdsjLvbrGlvZ8t3bTuV26VMF3lNWKgP4OU2PeDwUE4Doo Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_c059e9bad83c451c8034e45cf2e21e00"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: c059e9bad83c451c8034e45cf2e21e00 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1057464493 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 42635a4346b1428381f601756ae0c3a2 Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerDiskConfigTestJSON-1057464493-project Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'c11d3654-f8fd-4d73-b130-fa6dacaef30f'} Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:47:49.396522 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] Returning 404 to user: Instance c11d3654-f8fd-4d73-b130-fa6dacaef30f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee2f424b-a6c1-44dd-a1ff-6e5b8fea6543 tempest-ServerDiskConfigTestJSON-1057464493 tempest-ServerDiskConfigTestJSON-1057464493-project] 10.222.0.42 "GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f" status: 404 len: 111 microversion: 2.1 time: 0.034349 Oct 04 18:47:49.401146 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3586/7066] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:47:49 2022] GET /compute/v2.1/servers/c11d3654-f8fd-4d73-b130-fa6dacaef30f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:47:57.993476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d31a248-6ca1-406e-9613-34d735235894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: .version_select at 0x7fbdbc8d2ee0>, body: {"keypair": {"name": "tempest-keypair-653552464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgBqVIOaOCU/7DVarlEuueu1GF2IsYp2InuOIyZvlyNqTt3L1jFn3bP90UXF9Yd3hjNQ+8VOiaUkt6txVnQzqX4S7/efqWv1TyU1EyXanZo7KLcscz5sdzDQXdth37YCA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:57.999128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:58.011776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2d31a248-6ca1-406e-9613-34d735235894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:58.019735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-2d31a248-6ca1-406e-9613-34d735235894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:58.049090 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d31a248-6ca1-406e-9613-34d735235894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181542 Oct 04 18:47:58.049696 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3481/7067] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:47:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:47:59.445169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-529025361", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dc051c7d-0a66-4fd5-8c6f-3895d63506f2"}], "security_groups": [{"name": "tempest-securitygroup--1657142062"}], "key_name": "tempest-keypair-653552464", "user_data": "}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:47:59.455934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:59.456612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:47:59.559117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] validate_networks() for [('dc051c7d-0a66-4fd5-8c6f-3895d63506f2', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:47:59.944553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:47:59.945006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:47:59.945507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:47:59.945995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:47:59.946459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:47:59.956360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.956868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.957330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.958166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:47:59.958647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:47:59.959264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:47:59.977986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:47:59.984661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:47:59.997552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:48:00.001222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:48:00.053648 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0290605-8eda-48e1-ade6-254ac7cd1745 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.612789 Oct 04 18:48:00.054345 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3587/7068] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:47:59 2022] POST /compute/v2.1/servers => generated 409 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:48:00.065767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42dc474e-c546-40f4-9eeb-172d4d207f13 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:00.066423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42dc474e-c546-40f4-9eeb-172d4d207f13 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:00.069374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:00.150843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42dc474e-c546-40f4-9eeb-172d4d207f13 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:00.158676 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42dc474e-c546-40f4-9eeb-172d4d207f13 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1237 microversion: 2.1 time: 0.096648 Oct 04 18:48:00.159624 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3482/7069] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:00 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1237 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:01.187771 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:01.188630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:01.195875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.196620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.197275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.198022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:01.198640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:01.199239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:01.262545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:01.271491 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6d54ce3e-53f8-4aac-a2b9-54da98c12200 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1233 microversion: 2.1 time: 0.089221 Oct 04 18:48:01.272066 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3588/7070] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:01 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:02.302399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:02.303835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:02.315737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.316653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.317346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.318688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:02.319386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:02.320184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:02.426024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:02.434374 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a1b88dde-0644-48de-8dd2-acb7d9bc23ac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1295 microversion: 2.1 time: 0.142992 Oct 04 18:48:02.434987 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3483/7071] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:02 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1295 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:03.460575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:03.461221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:03.463873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:03.469724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.470307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.470778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.471539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.472318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.472660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.480441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:03.481158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:03.481787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:03.498541 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] Creating event network-changed:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h1-831194-21 Oct 04 18:48:03.504914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bd20e0e9-62d4-4651-9014-b1f4a58b91f4 req-810834af-fd2b-4915-9ea8-f6826eaa1c3a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044975 Oct 04 18:48:03.506130 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3484/7072] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:03.616993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:03.625591 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-79ab6a5b-48e9-4aa2-b86f-59d235e3b082 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.169540 Oct 04 18:48:03.626134 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3589/7073] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:03 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:04.649846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:04.650558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:04.657178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.657669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.658134 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.658844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:04.659299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:04.659725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:04.808222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:04.816243 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9bc9b4c-254f-4c6c-b98b-98b5a29dc532 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.171504 Oct 04 18:48:04.816817 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3485/7074] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:04 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:05.840835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:05.842533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:05.849461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.850002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.850454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.851169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:05.851641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:05.852087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:05.992050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:06.000332 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5a83c8c-70db-495a-90fd-ab651fb5a509 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.163558 Oct 04 18:48:06.000908 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3590/7075] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:05 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:07.025920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:07.026554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:07.034110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.034621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.035075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.035796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:07.036505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:07.036952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:07.186342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:07.197464 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b092649-27fd-4f7d-864c-698e112c568e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.177871 Oct 04 18:48:07.203628 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3486/7076] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:07 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:08.223861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:08.224443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:08.231420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.231969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.232569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.233288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:08.233757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:08.234223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:08.367291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:08.376128 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97aabcf8-abb0-46a1-a41b-4b28c9eb57fa tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.156313 Oct 04 18:48:08.376709 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3591/7077] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:08 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.400600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:09.401392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:09.410881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.411377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.411851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.412561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.413016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.413437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.554141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:09.562565 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9290ff37-34c6-438e-99aa-2bb25168c041 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.166392 Oct 04 18:48:09.563151 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3487/7078] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:09 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:09.576134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "name": "network-vif-plugged", "status": "completed", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:09.585901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:09.586397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:09.586848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:09.598454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] Creating event network-vif-plugged:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h1-831194-21 Oct 04 18:48:09.603739 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-5ca8c633-2690-4b19-9fb5-372254450b25 req-26d59217-b266-409c-a32f-066851aede96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096657 Oct 04 18:48:09.604343 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3592/7079] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:48:10.587081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:10.587709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:10.589736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:10.596280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.596775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.597220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.597939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:10.598399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:10.598829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:10.731343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:10.739720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ed683133-3c7a-4bb1-a4cd-cffb5f2bbecd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1363 microversion: 2.1 time: 0.156493 Oct 04 18:48:10.740231 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3488/7080] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:10 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:11.760472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:11.761270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:11.773310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.774081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.783425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.783931 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.784388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.785100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.785572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.786046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.930662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:11.939023 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-baaf46e3-75bf-4f56-9968-ff01fd562e50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1550 microversion: 2.1 time: 0.179538 Oct 04 18:48:11.939590 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3593/7081] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1550 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:11.962441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:11.962956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:11.970597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.971093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.971544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:11.972256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:11.972721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:11.973169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:12.055372 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b94f5c9a-b447-4d02-ad7e-bf00efa88b29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096838 Oct 04 18:48:12.055980 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3489/7082] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:48:11 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:13.330982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:13.342016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:13.342519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:13.342973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:13.358003 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] Creating event network-changed:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h1-831194-21 Oct 04 18:48:13.363481 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-77f6ffc8-5ba8-42b6-8665-9804703568e4 req-e82e315d-baf8-49c3-a58e-7f0a9c8dc0bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036240 Oct 04 18:48:13.364119 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3594/7083] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:48:49.279088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.279872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=36 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.284259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.284871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.295823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.296313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.296754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.297448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.297930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.298366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.439453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.447732 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-291a3849-787b-4d11-ab6a-9ef9e3c0d9e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.170705 Oct 04 18:48:49.448315 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3490/7084] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.476612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.477348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.479914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.480604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:48:49.489583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.490129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.490594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.491332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.491811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.492251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.649621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.657702 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4764c263-6136-497c-ab82-ce659fce6689 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.187644 Oct 04 18:48:49.658312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3595/7085] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.680234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.680881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.687451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.687935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.688380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.689068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.689520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.689989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.829265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.837087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1a11d2b-6065-4805-933d-a4b7a12f77f0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.160742 Oct 04 18:48:49.837677 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3491/7086] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:49.865684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:48:49.867946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:49.874985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.875486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.875956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.876668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:49.877132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:49.877565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:49.907499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:49.913227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:48:49.920101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:48:49.920538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:48:49.921042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:48:49.921454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:48:49.921900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:48:49.987917 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-512b11f7-9b90-409c-a280-df565ea40e1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/action" status: 202 len: 0 microversion: 2.1 time: 0.126262 Oct 04 18:48:49.989241 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3596/7087] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:48:49 2022] POST /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:48:49.996590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:49.997728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:50.003793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.004291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.004733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.005440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:50.005924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:50.006355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:50.170901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:50.179248 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bf20767e-3fdd-4bee-ad80-ade5405c7263 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1678 microversion: 2.1 time: 0.186507 Oct 04 18:48:50.180355 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3492/7088] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:49 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:51.205448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:51.206200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:51.216402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.217178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.217640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.218997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:51.219477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:51.219920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:51.362077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:51.370019 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e060db54-ec8a-491d-9fcb-76dc7946131c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1678 microversion: 2.1 time: 0.169844 Oct 04 18:48:51.370599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3597/7089] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:51 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:52.394997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:52.395577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:52.402816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.403317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.403757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.404469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:52.404927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:52.405361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:52.544108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:52.553221 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1252d35f-7599-4ec5-af24-1a4288f54936 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.162503 Oct 04 18:48:52.553821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3493/7090] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:52 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:53.578882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:53.579515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:53.586670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.587175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.587832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.588354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:53.588827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:53.589277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:53.735797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:53.743695 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75c17e70-9670-413c-8246-0b5c66bb1b71 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.169952 Oct 04 18:48:53.744416 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3598/7091] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:53 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:54.769053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:54.769662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:54.776503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.776985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.777425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.778275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:54.778729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:54.779157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:54.917039 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:54.926108 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-393c84e6-181b-4dae-9993-4b1363da1e39 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.161416 Oct 04 18:48:54.926699 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3494/7092] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:54 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:55.951352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:55.952045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:55.959069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.959582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.960040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:55.960754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:55.961227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:55.961674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:56.097629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:56.105888 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e424a63f-43c3-4acc-a17d-f7afbbcd34e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.158676 Oct 04 18:48:56.106473 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3599/7093] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:55 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:57.129550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:57.130390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:57.137025 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.137523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.138072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.138773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:57.139234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:57.139670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:57.272586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:57.281056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad845b37-3ede-421a-a159-3abadfee043d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.155489 Oct 04 18:48:57.281617 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3495/7094] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:57 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:48:58.307459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:58.308209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:58.316212 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.316724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.317184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.317928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:58.318407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:58.318855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:58.458586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:58.467886 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-888c9eb1-d79d-4d65-8c12-dedaaa347d78 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.165699 Oct 04 18:48:58.468474 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3600/7095] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:58 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:48:59.491266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:48:59.491887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:48:59.499730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.500275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.500674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.501382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:48:59.501861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:48:59.502351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:48:59.641397 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:48:59.649703 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6da6aaf8-5ed2-470e-9427-492bb15dcd9f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.162356 Oct 04 18:48:59.650365 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3496/7096] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:48:59 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:00.674586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:00.675210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:00.685770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.686593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.687059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.687800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:00.688277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:00.688725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:00.821106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:00.829434 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-543af800-1b39-4226-a8e3-ffe235033398 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.158841 Oct 04 18:49:00.830060 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3601/7097] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:00 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:01.852720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:01.853385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:01.860768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.861263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.861712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.862460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:01.862926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:01.863364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:01.996113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:02.004613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8257e27e-054d-4fbc-bbb0-6f3914299673 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.155788 Oct 04 18:49:02.005188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3497/7098] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:01 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:03.029101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:03.029970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:03.036395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.036897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.037355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.038091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:03.038562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:03.039001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:03.181309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:03.190114 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e10bf571-909c-4b6b-9b7e-40e9bf98080f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.165323 Oct 04 18:49:03.190699 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3602/7099] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:03 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:04.215659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:04.216283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:04.222493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.222988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.223433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.224243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:04.224596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:04.225030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:04.364850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:04.374719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c3f75eb-8ec6-49cd-8065-ae414538cf66 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.162642 Oct 04 18:49:04.374719 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3498/7100] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:04 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:05.401728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:05.402478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:05.409695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.410234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.410693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.411416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:05.411889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:05.412336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:05.547601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:05.555455 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-68e4b99c-5330-4f0f-8c21-3eeeb4becfa1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.157837 Oct 04 18:49:05.556031 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3603/7101] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:05 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:06.580261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:06.580889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:06.588077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.588573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.589022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.589727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:06.590328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:06.590900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:06.747769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:06.756086 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df6c9e76-9e17-4756-a8bb-120a406add50 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.180506 Oct 04 18:49:06.756666 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3499/7102] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:06 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:07.780519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:07.781325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:07.788087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.788592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.789064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.789773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:07.790264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:07.790705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:07.926416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:07.934801 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4fc2bd56-c276-4b42-9436-a98433fafc12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.158339 Oct 04 18:49:07.935392 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3604/7103] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:07 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:08.958565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:08.959185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:08.968529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.969317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.970097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:08.971269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:08.973242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:08.973242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.145576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:09.154469 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-53a322aa-ab29-443d-8afc-d56da71917ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1683 microversion: 2.1 time: 0.199955 Oct 04 18:49:09.155067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3500/7104] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:08 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1683 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:09.552936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "name": "network-vif-unplugged", "status": "completed", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:09.564566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:09.565051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:09.565577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:09.580490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Creating event network-vif-unplugged:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h2-831194-21 Oct 04 18:49:09.587116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:49:09.599147 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-b9b2b5c4-40a3-42f2-ae40-45db09ff1e46 req-0d0b0fef-cb96-4ceb-9472-63fbac1ec09b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049914 Oct 04 18:49:09.599775 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3605/7105] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:10.178408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:10.179059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:10.186780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.187282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.187724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.188432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:10.188895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:10.189365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:10.393226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:10.401528 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-51b3a944-d48c-4f7d-9f61-395fe2fd9e36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1682 microversion: 2.1 time: 0.226999 Oct 04 18:49:10.402125 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3501/7106] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:10 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1682 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.427923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:11.428645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:11.436524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.437032 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.437505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.438234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.438708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.439155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.580249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:11.588156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-aa9bc164-aa43-4c04-9b87-6a666dc9de7c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1680 microversion: 2.1 time: 0.166117 Oct 04 18:49:11.588733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3606/7107] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:11 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:11.635816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:11.647543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:11.648241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:11.648985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:11.662526 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Creating event network-changed:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h2-831194-21 Oct 04 18:49:11.668929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:49:11.680113 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c1d450e0-58fc-418c-81c1-262a117a0a5a req-9bc9313f-7339-45ef-a43a-0463200c2b90 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049192 Oct 04 18:49:11.680674 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3502/7108] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:12.613627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.614299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.621979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.622501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.622965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.623697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.624175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.624626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.766311 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:12.774687 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60d6471d-ec01-4739-871c-9534ded4b998 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1677 microversion: 2.1 time: 0.164973 Oct 04 18:49:12.775383 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3607/7109] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1677 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:12.800305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:12.800845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.807418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.807988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.808543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.809800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.810458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.810909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.873241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ae4b197d-14a0-4864-8e42-c5dfcda7b07b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/action" status: 204 len: 0 microversion: 2.1 time: 0.077829 Oct 04 18:49:12.874063 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3503/7110] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:49:12 2022] POST /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:12.888618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:12.889341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:12.895997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.896647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.896990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:12.898571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:12.899292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:12.899742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:13.062208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:13.070317 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0737cdb5-41e3-4117-a323-ace18bd8cc36 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1677 microversion: 2.1 time: 0.191821 Oct 04 18:49:13.070903 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3608/7111] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:12 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:14.095592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:14.096313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:14.102626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.103145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.103586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.104302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:14.104787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:14.105226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:14.336711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:14.346136 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5b15c471-b041-4b1d-a244-c9781f110e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1677 microversion: 2.1 time: 0.255944 Oct 04 18:49:14.347429 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3504/7112] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:14 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:15.318995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "name": "network-vif-plugged", "status": "completed", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:15.331000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.331634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.332084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.345278 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] Creating event network-vif-plugged:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h2-831194-21 Oct 04 18:49:15.350467 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0645f8b2-dc53-4410-8c43-26176fbf8098 req-8331c019-5afd-4c12-a12b-20aa16bb7f81 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035289 Oct 04 18:49:15.351079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3609/7113] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:15.376481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.377936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.391492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.392842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.393411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.394527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.395133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.395779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.534831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.537203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.544300 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-95c5b9aa-0287-492b-8fcb-9836de8c99dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.175920 Oct 04 18:49:15.544962 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3505/7114] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.574176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.575536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.582242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.582751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.583208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.583926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.584400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.584844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.726222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.734948 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9a4138e4-a4e4-446c-8b5f-ddfe027fb937 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.165103 Oct 04 18:49:15.735529 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3610/7115] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.759150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.759767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.767187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.767667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.768108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.769072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.769529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.769988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.909271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:15.917206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f43bcc9a-4934-4a59-ba49-90f95311d5dd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1669 microversion: 2.1 time: 0.161941 Oct 04 18:49:15.918564 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3506/7116] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:15 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1669 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:15.940951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:15.941378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:15.947588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.948085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.948533 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.949271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:15.949739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:15.950209 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:15.954510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:15.978328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:49:16.061313 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2cc972f7-207e-4efa-974d-173e03fb80a3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 204 len: 0 microversion: 2.1 time: 0.123869 Oct 04 18:49:16.063102 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3611/7117] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:49:15 2022] DELETE /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:49:16.071461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:16.072084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:16.078984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.079484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.079929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.080637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:16.081186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:16.081612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:16.219633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:16.227580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5ed98049-7cdf-45d1-84aa-f0578b23f5fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1675 microversion: 2.1 time: 0.160032 Oct 04 18:49:16.228160 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3507/7118] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:16 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:17.252077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:17.252819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:17.259760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.260265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.260731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.261448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:17.262447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:17.262900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:17.408736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:17.417014 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4e4c26d5-c485-49eb-bd42-aedff31a9ac7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1675 microversion: 2.1 time: 0.169297 Oct 04 18:49:17.417598 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3612/7119] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:17 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:18.392112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "487fc61a-a11f-45bb-b9e9-3e1bab97fa22", "name": "network-vif-deleted", "tag": "053f657d-9492-4e18-baf5-28687bd28567"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:18.404682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.405261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.405701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.418680 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] Creating event network-vif-deleted:053f657d-9492-4e18-baf5-28687bd28567 for instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 on n-h2-831194-21 Oct 04 18:49:18.427884 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c55de8a7-ae51-4d7a-ab2f-cc6bb343fe02 req-071d00e8-cdbf-4bde-8583-aff049388b49 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039488 Oct 04 18:49:18.429334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3508/7120] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:18.443030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:18.443030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:18.456262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.456962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.457588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.458516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:18.466568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:18.473677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:18.546125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:18.554630 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9b77a826-501f-43b4-b521-79f77418b0f2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 200 len: 1322 microversion: 2.1 time: 0.118096 Oct 04 18:49:18.555750 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3613/7121] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:18 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 1322 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:19.584894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.585609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.587751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=39 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:19.594968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.595615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.596173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.596912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.597374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.597812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.619563 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 HTTP/1.1 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '487fc61a-a11f-45bb-b9e9-3e1bab97fa22'} Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:19.622680 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d19f59e-dd14-476c-b0de-64ccebe2a7de tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 404 len: 111 microversion: 2.1 time: 0.045280 Oct 04 18:49:19.627675 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3509/7122] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:19.649352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:19.650106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:19.655038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:19.659434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.659955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.660415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.661153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:19.661626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:19.662103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:19.678746 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 HTTP/1.1 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '487fc61a-a11f-45bb-b9e9-3e1bab97fa22'} Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:49:19.680486 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44516c60-205a-4ea9-84ae-36180a4d75c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 404 len: 111 microversion: 2.1 time: 0.042487 Oct 04 18:49:19.684947 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3614/7123] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:19 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:49:19.734639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-258202543", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "dc051c7d-0a66-4fd5-8c6f-3895d63506f2"}], "security_groups": [{"name": "tempest-securitygroup--1657142062"}], "key_name": "tempest-keypair-653552464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:19.869331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] validate_networks() for [('dc051c7d-0a66-4fd5-8c6f-3895d63506f2', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:49:20.344798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:49:20.345228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:49:20.345739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:49:20.346187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:49:20.346630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:49:20.359225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.359716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.360158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.360896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:20.361355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:20.361785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:20.380955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:49:20.386773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:49:20.400001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:49:20.403160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:49:20.450548 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92404909-0c17-4d7c-81c2-8777d63bab0e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720682 Oct 04 18:49:20.451169 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3510/7124] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:49:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:49:20.462881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a1c76998-46bb-4b33-8924-17743750b91e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:20.463950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a1c76998-46bb-4b33-8924-17743750b91e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:20.519272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a1c76998-46bb-4b33-8924-17743750b91e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:20.529611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a1c76998-46bb-4b33-8924-17743750b91e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1237 microversion: 2.1 time: 0.070757 Oct 04 18:49:20.530219 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3615/7125] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:20 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:21.553405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:21.554188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:21.561242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.561744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.562213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.562921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:21.563379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:21.563812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:21.626961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:21.634847 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d165f83-0178-4847-bb99-3ea489857553 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1233 microversion: 2.1 time: 0.086198 Oct 04 18:49:21.635428 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3511/7126] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:21 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:22.660056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:22.660708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:22.669554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.670100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.670573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.671303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:22.671785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:22.672236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:22.737593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:22.746349 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d690726-c839-453c-9f03-f17c27e1e04a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1295 microversion: 2.1 time: 0.090209 Oct 04 18:49:22.746970 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3616/7127] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:22 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:23.772285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:23.772903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:23.780599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.781116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.781562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.782306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.782769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.783198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.941203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:23.953005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:23.953784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:23.954398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:23.967543 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] Creating event network-changed:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h2-831194-21 Oct 04 18:49:23.972960 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a1e77d75-e51d-4164-8bf3-0da7efd417ea req-a8814cc8-5303-4b0b-8bef-c2c06a5bc608 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035635 Oct 04 18:49:23.973567 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3617/7128] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:24.004488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:24.013891 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b755e491-e7e3-4e89-8e72-c66c50507e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.245681 Oct 04 18:49:24.020525 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3512/7129] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:23 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:25.039176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:25.039894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:25.046558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.047061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.047515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.048225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:25.048698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:25.049140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:25.186045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:25.194156 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ee35a77-6402-46f1-a83f-31b0aa04dff0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.160073 Oct 04 18:49:25.194734 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3618/7130] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:25 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:26.218120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:26.218740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:26.225899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.226390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.226832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.227526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:26.227980 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:26.228407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:26.370127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:26.378995 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-379cb006-083f-44e7-88e0-eb69b5a5321f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.164888 Oct 04 18:49:26.379580 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3513/7131] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:26 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:49:27.405079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:27.405852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:27.414171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.414775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.415241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.416105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:27.416639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:27.417161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:27.574556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:27.582736 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2d25f90-e74e-4425-98fe-e113affaba2c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.182817 Oct 04 18:49:27.583316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3619/7132] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:27 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:28.609300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:28.609951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:28.617042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.617533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.618015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.618719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:28.619202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:28.619605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:28.768517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:28.781062 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d5bcf454-8480-437a-a21d-961d42ffff22 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.176336 Oct 04 18:49:28.782076 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3514/7133] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:28 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:29.401678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "name": "network-vif-plugged", "status": "completed", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:29.415011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.415508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.415962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.427509 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] Creating event network-vif-plugged:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h2-831194-21 Oct 04 18:49:29.432992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8e12e0e7-8c78-4516-aa8e-34b9f89fdd88 req-2528b777-435b-4528-b389-ac780d600cc6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Oct 04 18:49:29.434328 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3620/7134] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:49:29.809202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:29.809887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:29.816780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.817274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.817722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.818455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:29.818921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:29.819356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:29.976881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:29.985688 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4f6566a9-14cf-4e90-92d1-7f2892ced923 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1363 microversion: 2.1 time: 0.180997 Oct 04 18:49:29.986313 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3515/7135] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:29 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.010495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.011292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.014394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:31.020403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.020909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.021359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.022096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.022560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.022998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.164620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:49:31.173065 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-272e940a-8bd0-41e0-a953-b7d9a70d38c9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1550 microversion: 2.1 time: 0.166917 Oct 04 18:49:31.173633 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3621/7136] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1550 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:49:31.196248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:49:31.196817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:49:31.199746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:31.200546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:49:31.210711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.211220 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.211664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.212410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:31.212874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:31.213336 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:31.295444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b97249a-aad6-4068-b30f-175b8bb1d86b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103415 Oct 04 18:49:31.296049 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3516/7137] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:49:31 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:49:32.575884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:49:32.585474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:49:32.585997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:49:32.586446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:49:32.601452 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] Creating event network-changed:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h2-831194-21 Oct 04 18:49:32.607086 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e32c0f67-e23c-4b96-a930-600b9fd4a37b req-b024a377-e7d8-4609-b4ed-22147b8bfd8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035389 Oct 04 18:49:32.607706 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3622/7138] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:05.556361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:05.558310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=53 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:05.566344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:05.582759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.583304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.583762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.612024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Going to try to stop instance {{(pid=128850) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 18:50:05.657024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12a9e443-8849-4c48-8e1c-3dcc1515a4e7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action" status: 202 len: 0 microversion: 2.1 time: 0.102540 Oct 04 18:50:05.657662 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3517/7139] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:05 2022] POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:05.667866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:05.668736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:05.671052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=19 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:05.671782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:05.686072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.686571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.687236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.688022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:05.688673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:05.689237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:05.838236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:05.847679 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a84a794-bd54-4805-84df-9990509fe074 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.185016 Oct 04 18:50:05.848274 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3623/7140] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:05 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:06.873758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:06.874521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:06.880781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.881283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.881730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:06.882468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:06.882936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:06.883368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:07.047197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:07.056073 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7597029d-7d86-4d46-ac06-3b077e724894 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.188310 Oct 04 18:50:07.056663 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3518/7141] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:06 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:08.079523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:08.080159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:08.087494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.088000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.088844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.089265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:08.089738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:08.090207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:08.233766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:08.241613 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5087f59-98f4-4feb-957b-aa78f273b6da tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.166073 Oct 04 18:50:08.242498 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3624/7142] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:08 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:09.267013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:09.267629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:09.278501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.279009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.279461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.280189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:09.280658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:09.281097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:09.458552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:09.469034 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cb9977e2-8c2d-4346-9436-1ecf82b3b371 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.206127 Oct 04 18:50:09.469677 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3519/7143] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:09 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:10.496291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:10.497322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:10.508956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.509474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.510681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.511446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:10.511951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:10.512424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:10.665416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:10.674446 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c66e2680-da44-4c3e-b818-d2006ba1ed35 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.183225 Oct 04 18:50:10.675289 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3625/7144] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:10 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:11.699693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:11.700496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:11.707178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:11.707666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:11.708101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.708834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:11.709283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:11.709728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:11.856492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:11.864316 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-647a69c8-d20b-4afb-9fee-2ff91ae72a29 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.169135 Oct 04 18:50:11.865303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3520/7145] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:11 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:12.892074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:12.892689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:12.903750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.904267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.904768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:12.905526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:12.906054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:12.906506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:13.052536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:13.061279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2cee120-4b4e-4247-a6ac-51aeb2af6dd0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.173344 Oct 04 18:50:13.061880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3626/7146] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:12 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:14.087697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:14.088771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:14.096252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.096765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.097222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.097990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:14.098467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:14.098909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:14.346174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:14.354742 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-afa07c57-d4d0-4732-ac1a-f553427b4fa2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.272357 Oct 04 18:50:14.355399 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3521/7147] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:14 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:15.378551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:15.379139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:15.389328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.389859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.390321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.391054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:15.391526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:15.391983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:15.539787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:15.548049 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ea93eab-cb40-45f3-9ac0-77334f704732 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.173619 Oct 04 18:50:15.548652 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3627/7148] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:15 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:16.572210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:16.573353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:16.580806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.581304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.581750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.582569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:16.583034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:16.583550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:16.751574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:16.759760 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-858b8559-188d-459b-a6f2-878862d8ccb7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.191981 Oct 04 18:50:16.760490 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3522/7149] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:16 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:17.783504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:17.784682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:17.793429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.793970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.794453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.795190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:17.795664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:17.796178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:17.936098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:17.944038 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d147715f-39ac-4b4c-a48c-0bb4311be8f4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.164500 Oct 04 18:50:17.944618 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3628/7150] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:17 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:18.972162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:18.972796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:18.980446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.980942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.981408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:18.982135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:18.982608 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:18.983042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:19.118242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:19.127060 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92132abd-8abb-4a54-ae4f-a070ea5ff940 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.158828 Oct 04 18:50:19.127640 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3523/7151] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:18 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:20.151203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:20.152135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:20.159550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.160097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.160563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.161350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:20.161884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:20.162374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:20.303976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:20.313042 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ee2e9df-190d-4c89-b90b-fc9abd6cc554 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.166005 Oct 04 18:50:20.313772 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3629/7152] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:20 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.338271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.339164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.346357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.346861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.347306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.348020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.348476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.348903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.493020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.501767 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49caaf98-2146-467c-aba6-a9870666f7b1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1656 microversion: 2.1 time: 0.167706 Oct 04 18:50:21.502562 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3524/7153] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1656 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:21.526097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:21.528445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.535337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.535839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.536290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.537003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.537480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.537950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.567950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.573792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:50:21.580525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:21.580970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:21.581465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:21.581935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:21.582370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:21.663300 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88b20c01-df1d-4a21-be85-1ed3b42fa48b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action" status: 202 len: 0 microversion: 2.1 time: 0.141230 Oct 04 18:50:21.664059 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3630/7154] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:21 2022] POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:21.672941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:21.673769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:21.680449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.681006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.681460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.682308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:21.682799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:21.683399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:21.867910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:21.887361 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d48b2c43-99bf-461b-b078-2b65ee291535 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.217830 Oct 04 18:50:21.888665 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3525/7155] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:21 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:22.913374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:22.913994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:22.922859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.923441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.923905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:22.924666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:22.925176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:22.925599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:23.074562 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:23.083080 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-386d3dd8-693e-4c3d-89cb-145b393ecada tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1679 microversion: 2.1 time: 0.174476 Oct 04 18:50:23.083664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3631/7156] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:22 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:24.107667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:24.108365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:24.115276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.115774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.116221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.116975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:24.117440 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:24.117902 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:24.263649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:24.272315 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d093aac1-bdbc-4d17-a347-b4b358bd7964 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1684 microversion: 2.1 time: 0.168958 Oct 04 18:50:24.272895 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3526/7157] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:24 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:25.296466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:25.297281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:25.304362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.304879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.305341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.306102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:25.306583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:25.307042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:25.442791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:25.451524 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6c8f14c-9e15-49c3-b7ae-b802c7026649 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1684 microversion: 2.1 time: 0.159323 Oct 04 18:50:25.452107 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3632/7158] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:25 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:26.284080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "name": "network-vif-unplugged", "status": "completed", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:26.296556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.297088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.297739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.316862 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Creating event network-vif-unplugged:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h1-831194-21 Oct 04 18:50:26.323418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:26.346347 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ea842d48-f00d-4cb9-9168-f602210e6dfa req-319ca0c4-aa0d-42fc-a03a-8fcb8acdaf1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065849 Oct 04 18:50:26.346993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3527/7159] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:26.479612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:26.480301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:26.487378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.487803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.488254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.488972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:26.489440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:26.489911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:26.632018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:26.640749 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecedf2b6-76aa-464f-bda2-9ec6868de1b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1683 microversion: 2.1 time: 0.165058 Oct 04 18:50:26.641335 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3633/7160] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:26 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:27.666268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:27.666898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:27.673694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.674238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.674710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.675657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:27.676204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:27.676778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:27.814924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:27.822751 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6a999145-834f-4487-bf82-18ee2917493c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1681 microversion: 2.1 time: 0.161887 Oct 04 18:50:27.823368 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3528/7161] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:27 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:28.376258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:28.386800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.387291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.387736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.399807 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Creating event network-changed:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h1-831194-21 Oct 04 18:50:28.405321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:50:28.416622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c8e72abd-4065-4424-9629-137c83d38ab2 req-0a00cb3f-29a9-4b6e-aac9-f696fdf7cf1d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045430 Oct 04 18:50:28.417257 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3634/7162] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:28.848655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:28.849289 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:28.856586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.857085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.857538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:28.859280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:28.859794 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:28.860243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.258417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.267448 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-672d8962-21e8-41ae-a5e9-183033cd4530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1677 microversion: 2.1 time: 0.422868 Oct 04 18:50:29.268444 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3529/7163] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:28 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1677 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:29.292789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:29.293451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.301140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.301655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.302175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.303052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.303531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.303987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.384322 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8c107f9b-0156-4312-8b35-440ddb796f34 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action" status: 204 len: 0 microversion: 2.1 time: 0.095930 Oct 04 18:50:29.385161 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3635/7164] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:29 2022] POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:29.398359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:29.398727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:29.407168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.407950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.408399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.409122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:29.409590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:29.410326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:29.740569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:29.753797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-317d244d-8a33-4d0b-894b-8f64463de36f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1677 microversion: 2.1 time: 0.362992 Oct 04 18:50:29.754560 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3530/7165] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:29 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1677 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:30.782606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:30.783344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:30.789734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.790288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.790742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.791524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:30.791999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:30.792447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:30.942492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:30.947728 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0236f9b-27a6-49ea-87c8-09a901e316c5 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1677 microversion: 2.1 time: 0.171019 Oct 04 18:50:30.948299 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3636/7166] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:30 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:31.972136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:31.972758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:31.979824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.980316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.980763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:31.981465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:31.981953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:31.982386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.138703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.147389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6db163e7-b5a9-414f-9396-cb9db4c0f3ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1656 microversion: 2.1 time: 0.179241 Oct 04 18:50:32.148069 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3531/7167] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:31 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1656 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.171686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.172327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.178735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.179246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.179704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.180431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.180909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.181352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.197349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:32.219841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "name": "network-vif-plugged", "status": "completed", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:32.231371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.232309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.233359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.245489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] Creating event network-vif-plugged:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h1-831194-21 Oct 04 18:50:32.252134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5ceb0b62-779b-4f95-bc9d-5cdc93c04757 req-8347b9a1-24f0-47f8-bc9d-28fe32074f24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037239 Oct 04 18:50:32.252751 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3532/7168] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:32.331373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.339383 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-64bb0bf5-99f5-4288-b489-7e8c35b2fb72 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1656 microversion: 2.1 time: 0.172595 Oct 04 18:50:32.339963 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3637/7169] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1656 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:32.365346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:32.375728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.376261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.376715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.401191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:32.408699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 18:50:32.454322 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1fc2a8d-40d5-4a6c-afd4-ce4ff037241f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action" status: 202 len: 0 microversion: 2.1 time: 0.093459 Oct 04 18:50:32.455144 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3533/7170] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:50:32 2022] POST /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:50:32.463331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:32.464236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:32.471910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.472586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.473160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.474092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:32.474579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:32.475041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:32.630729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:32.639840 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-85ed91b3-dae3-4de2-8af2-da6fd421b38e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1665 microversion: 2.1 time: 0.179819 Oct 04 18:50:32.640700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3638/7171] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:32 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:50:33.666805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.667515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.674663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.675160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.675594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.676299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.676765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.677223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.821854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:33.830125 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a038829c-fcb6-4c4c-8d45-cc114d8e564d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1669 microversion: 2.1 time: 0.168643 Oct 04 18:50:33.830722 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3534/7172] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:33.855498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.856297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.864848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.865364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.865846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.866586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.867066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.867516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:33.897483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:50:33.981301 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04c8f2b6-e6f8-4aea-93b9-9b53960c55a9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 204 len: 0 microversion: 2.1 time: 0.129631 Oct 04 18:50:33.981956 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3639/7173] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:50:33 2022] DELETE /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:50:33.991310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:33.992054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:33.998726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:33.999367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:33.999811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.000521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:34.000986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:34.001418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:34.142598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:34.150847 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-609ef916-04fb-433f-bb6a-ab9ab2ef8678 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1675 microversion: 2.1 time: 0.163894 Oct 04 18:50:34.151425 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3535/7174] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:33 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:35.176365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:35.177155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:35.184277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.184791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.185284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.186090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:35.186575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:35.187024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:35.321246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:35.329865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d2f051a4-8d95-466d-9469-ca2a598bc625 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1675 microversion: 2.1 time: 0.157714 Oct 04 18:50:35.330447 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3640/7175] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:35 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.355858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:36.356492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:36.363567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=39 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:36.365547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.366122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.366569 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.367293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.367750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.368209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.449781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:36.459093 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e0a19850-e3b4-4e6a-a96d-4f33fdc5633c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 200 len: 1607 microversion: 2.1 time: 0.107575 Oct 04 18:50:36.459787 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3536/7176] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:36 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 1607 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:36.691581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69f13168-ae38-4e91-83f7-cfeb17d003e3", "name": "network-vif-deleted", "tag": "c14434b1-6514-40e5-a4d3-b3f14f2caeab"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:36.699083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:36.715745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:36.716497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:36.718066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:36.733461 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] Creating event network-vif-deleted:c14434b1-6514-40e5-a4d3-b3f14f2caeab for instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 on n-h1-831194-21 Oct 04 18:50:36.738788 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-56d79d01-fb71-492a-88c8-668cc472e005 req-e2b0e67f-aca7-46c1-85ed-f6a6b56f632a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051609 Oct 04 18:50:36.739525 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3641/7177] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:37.483364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.484159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.494780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.495283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.495753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.496503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.496989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.497454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.513068 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 HTTP/1.1 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '69f13168-ae38-4e91-83f7-cfeb17d003e3'} Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:37.515490 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-98cc6c26-080c-426d-9c2e-8b417674b9a4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 404 len: 111 microversion: 2.1 time: 0.038122 Oct 04 18:50:37.521574 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3537/7178] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:37.536559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:37.537298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:37.550543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.551068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.551536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.552304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:37.552789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:37.553421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:37.570334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 HTTP/1.1 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '69f13168-ae38-4e91-83f7-cfeb17d003e3'} Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:50:37.571802 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-72a26dcd-5a7b-44f7-8464-735495a33c40 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 404 len: 111 microversion: 2.1 time: 0.041527 Oct 04 18:50:37.575715 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3642/7179] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:37 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:50:37.639601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-237520205", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "dc051c7d-0a66-4fd5-8c6f-3895d63506f2"}], "security_groups": [{"name": "tempest-securitygroup--1657142062"}], "key_name": "tempest-keypair-653552464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:37.766522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] validate_networks() for [('dc051c7d-0a66-4fd5-8c6f-3895d63506f2', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:50:38.199918 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:50:38.200347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:50:38.200820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:50:38.202222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:50:38.202855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:50:38.213895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.214395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.214835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.215564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:38.216014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:38.216442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:38.235715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:50:38.242232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:50:38.258922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:50:38.261927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:50:38.335968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4a09ad1c-9d0e-4a69-b94d-c6f453a4d070 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.702027 Oct 04 18:50:38.336648 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3538/7180] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:50:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:50:38.348447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eec938a1-11e8-469a-b431-8e0178b79bf6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:38.349217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eec938a1-11e8-469a-b431-8e0178b79bf6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:38.414138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eec938a1-11e8-469a-b431-8e0178b79bf6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:38.432990 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eec938a1-11e8-469a-b431-8e0178b79bf6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1237 microversion: 2.1 time: 0.087937 Oct 04 18:50:38.445866 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3643/7181] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:38 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:39.462974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:39.463602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:39.473447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.473966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.474416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.475126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:39.475690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:39.476112 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:39.564571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:39.574691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a343da45-efec-4d0d-99f0-b9ad5ec33cea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1297 microversion: 2.1 time: 0.115590 Oct 04 18:50:39.584816 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3539/7182] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:39 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1297 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:40.601740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:40.603030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:40.610371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.611127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.611757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.612651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:40.613274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:40.613888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:40.762020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:40.771632 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc6af61e-102d-47c3-9355-db99479b5fea tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.173825 Oct 04 18:50:40.772412 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3644/7183] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:40 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:41.064313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:41.077905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.078408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.078845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.095946 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] Creating event network-changed:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h2-831194-21 Oct 04 18:50:41.101163 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5e0ed445-0918-4383-a8ac-41873b35fccc req-cc944620-32e6-43b3-86ff-b3d941c715a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041997 Oct 04 18:50:41.102141 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3540/7184] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:50:41.796803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:41.797413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:41.804446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.804955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.805415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.806159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:41.806836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:41.807293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:41.940595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:41.948623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27f9efdc-88bf-4df3-8054-f85b3917c685 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.156694 Oct 04 18:50:41.949205 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3645/7185] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:41 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:42.975129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:42.976455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:42.983251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.983746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.984193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:42.984905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:42.985370 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:42.985805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:43.228028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:43.237229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0ff6ab84-01eb-49f0-aa57-03cb46d38e86 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.267562 Oct 04 18:50:43.237808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3541/7186] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:42 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:44.261686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:44.262343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:44.270242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.270741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.271190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.271889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:44.272357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:44.272795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:44.426878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:44.436009 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b8d5c66d-265d-4967-9e2f-c50e3648a832 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.177500 Oct 04 18:50:44.437597 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3646/7187] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:44 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:45.461006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:45.461626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:45.468767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.469251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.469688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.470404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.470858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.471282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.603601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:45.612181 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c215614-49b8-4e8a-810a-6904d6627bb4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.155097 Oct 04 18:50:45.612758 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3542/7188] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:45 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:45.765433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "name": "network-vif-plugged", "status": "completed", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:45.775954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:45.776457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:45.776906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:45.789150 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] Creating event network-vif-plugged:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h2-831194-21 Oct 04 18:50:45.794127 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6f7dcc0e-a77b-421c-8be3-8361f8a6bcbe req-3e179944-1147-4a78-ac4d-e6dc1d1e9465 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032689 Oct 04 18:50:45.795312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3647/7189] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:46.636948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:46.637568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:46.646672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.647181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.647634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.648342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:46.648802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:46.649233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:46.797078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:46.805058 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d60af39f-9f0f-46bb-a46b-fbfb65d88f8e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1363 microversion: 2.1 time: 0.172073 Oct 04 18:50:46.805634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3543/7190] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:46 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:47.830022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:47.830784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:47.840121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.840633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.841093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.842003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:47.842672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:47.843127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:47.976318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:50:47.984782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b0693f99-e9f2-45e7-822d-67c5ba38ec51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1551 microversion: 2.1 time: 0.159910 Oct 04 18:50:47.985371 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3648/7191] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:50:47 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:50:48.014765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:50:48.015299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:50:48.022432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.022927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.023376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.024081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:48.024651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:48.025082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:48.106334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c6788ed7-3d57-453e-b9af-9c5851abf85b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096637 Oct 04 18:50:48.106946 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3544/7192] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:50:48 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:50:49.159795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:50:49.165464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:50:49.172908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:50:49.173439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:50:49.173954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:50:49.187929 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] Creating event network-changed:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h2-831194-21 Oct 04 18:50:49.193171 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-47f602e2-acd1-4612-85a2-98ac42f3f4f4 req-98305bec-af7d-4cb0-a2f1-79e89fc74022 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040494 Oct 04 18:50:49.193797 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3649/7193] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:22.095465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.096266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.098351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.099035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.103358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:22.105691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.115143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.115732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.116196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.116910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.117375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.117808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.150335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.156923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Old instance type m1.heat2, new instance type m1.heat {{(pid=128850) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:51:22.163560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:22.163998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:22.164481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:22.164898 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:22.165317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:22.230966 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1e6db7c6-cbca-403f-bec4-08c1247420bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/action" status: 202 len: 0 microversion: 2.1 time: 0.136194 Oct 04 18:51:22.231591 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3545/7194] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:22 2022] POST /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:22.238766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=19 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.244414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:22.251305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:22.252045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:22.259987 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.260501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.260968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.261697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:22.262301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:22.262871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:22.417574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:22.426800 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6fc521e3-39d4-4735-bf77-61a62f903176 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1679 microversion: 2.1 time: 0.190475 Oct 04 18:51:22.427369 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3650/7195] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:22 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:23.452513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:23.453142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:23.460272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.460814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.461263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.462007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:23.462458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:23.462892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:23.605042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:23.614234 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97acc5d7-8d36-4633-aef5-7b2dd0cec449 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1679 microversion: 2.1 time: 0.167346 Oct 04 18:51:23.614832 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3546/7196] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:23 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1679 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:24.638997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:24.639743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:24.647058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.647560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.648011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.648716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:24.649186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:24.649625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:24.785064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:24.792898 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0c9dce2b-4c02-48c1-9319-c8ebd2cd72b0 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.158140 Oct 04 18:51:24.793477 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3651/7197] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:24 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:25.817810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:25.818459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:25.825364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.825956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.826412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.827120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:25.827576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:25.828009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:25.968197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:25.975836 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d1c58d03-6f8f-438d-9db0-f549a5284651 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.161988 Oct 04 18:51:25.976409 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3547/7198] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:25 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:27.000646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:27.001276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:27.008164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.008665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.009114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.009866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:27.010339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:27.010779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:27.150524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:27.159292 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e122c984-4b5d-454a-a017-e195e505276f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.163107 Oct 04 18:51:27.159884 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3652/7199] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:26 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:28.182699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:28.183320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:28.190532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.191028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.191475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.192173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:28.192636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:28.193668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:28.329975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:28.337806 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7af5a913-6ef0-4f20-b130-91256fac63c8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.158974 Oct 04 18:51:28.338359 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3548/7200] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:28 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:29.361743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:29.362330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:29.369481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.370048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.370513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.371234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:29.371742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:29.372190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:29.511410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:29.519745 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-62f13cc2-bd17-4f7d-bce9-28dbd17f852a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.162414 Oct 04 18:51:29.520346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3653/7201] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:29 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:30.542866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:30.543485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:30.550635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.551121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.551695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.552267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:30.552724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:30.553149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:30.681435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:30.689801 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8dccb73b-24d7-4dca-8355-8dd59fa4df89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.150909 Oct 04 18:51:30.690396 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3549/7202] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:30 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:31.713506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:31.714187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:31.720600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.721034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.721479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.722215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:31.722761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:31.723226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:31.865007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:31.873773 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-56c344ec-8d9b-467b-8df0-adcd63901af3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.163476 Oct 04 18:51:31.874393 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3654/7203] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:31 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:32.897553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:32.898194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:32.904709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.905199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.905636 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:32.906368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:32.906824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:32.907248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:33.048587 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:33.056632 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58cb1459-71ab-4445-84f9-1e7a7d037a6b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.163663 Oct 04 18:51:33.057204 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3550/7204] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:32 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:34.081450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:34.082105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:34.089095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.089565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.090040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.090741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:34.091207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:34.091714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:34.531454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:34.539317 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dc65cfc7-88d7-4a86-adf3-81372442252a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.461912 Oct 04 18:51:34.539889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3655/7205] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:34 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:35.563382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:35.564021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:35.570891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.571377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.571815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.572504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:35.572956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:35.573379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:35.705464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:35.713289 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-00f44a84-a561-4882-b8e4-76340e52ba92 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.154113 Oct 04 18:51:35.714142 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3551/7206] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:35 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:36.738636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:36.739289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:36.746888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.748255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.748255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.749050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:36.749050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:36.749482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:36.896875 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:36.905988 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a4a78e5-8021-4d9a-a21b-2a6dec2f7ec6 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.171222 Oct 04 18:51:36.906569 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3656/7207] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:36 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:37.929502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:37.930173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:37.938050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.938555 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.939011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:37.939727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:37.940188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:37.940620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:38.075253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:38.083451 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b6f6eeb1-035a-4414-b39f-4199c1b7b8a8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.157816 Oct 04 18:51:38.084035 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3552/7208] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:37 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:39.107488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:39.108127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:39.115991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.116491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.116942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.117647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:39.118141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:39.118582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:39.254618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:39.262610 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-28cdcbce-536e-4d19-b9e3-055e8b32e311 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.159081 Oct 04 18:51:39.263355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3657/7209] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:39 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:40.285817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:40.286507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:40.293550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.294091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.294658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.295273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:40.295710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:40.296145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:40.446040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:40.457354 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-80f200c7-aaec-4b16-b6c9-55950923df60 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1684 microversion: 2.1 time: 0.175255 Oct 04 18:51:40.458048 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3553/7210] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:40 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1684 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:41.480887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:41.481544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:41.490023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.490546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.491010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.491738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.492215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.492694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.629407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:41.637174 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91a6bcb0-72cf-476e-8a2c-0b0c46b0bf6c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1683 microversion: 2.1 time: 0.160447 Oct 04 18:51:41.637765 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3658/7211] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:41 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:41.862871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "name": "network-vif-unplugged", "status": "completed", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:41.874580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:41.875008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:41.875452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:41.887799 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Creating event network-vif-unplugged:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h1-831194-21 Oct 04 18:51:41.900489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:41.914350 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c496975f-3ceb-4030-a35d-2ff33a4e2418 req-97ef7b92-c3aa-4824-8735-79690b312f9d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055530 Oct 04 18:51:41.915321 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3554/7212] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:42.663236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:42.663908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:42.672238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.672766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.673222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.674003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:42.674487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:42.674936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:42.835828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:42.845703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ced532d4-551b-4bf7-884e-699597b84e63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1683 microversion: 2.1 time: 0.186346 Oct 04 18:51:42.846418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3659/7213] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:42 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:43.871893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:43.873779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:43.880044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.880538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.880984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.881687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.882173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.882612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.961560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:43.971755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:43.972252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:43.972824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:43.985329 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Creating event network-changed:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h1-831194-21 Oct 04 18:51:43.990901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:44.003176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7317ff7b-5e4a-4316-9538-b675a76c2837 req-0906e927-c3b3-4369-8fc7-fe01a96d7f74 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045287 Oct 04 18:51:44.004138 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3660/7214] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:51:44.030307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:44.039161 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-502636a9-fadc-4e04-9b0e-eff1274482b8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1681 microversion: 2.1 time: 0.171758 Oct 04 18:51:44.039161 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3555/7215] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:43 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:45.065898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:45.066749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.073055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.073565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.074050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.074792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.075320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.076460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.231086 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:45.239581 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3d23b1b-3d30-4f10-84b6-3d064e74f636 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1678 microversion: 2.1 time: 0.179960 Oct 04 18:51:45.240174 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3661/7216] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:45 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:45.263950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:45.264493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.271854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.272475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.273052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.273815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.274306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.274728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.316280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.316669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.317108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.317853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.318301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.318723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.339320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:45.344943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:45.458075 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a3610480-c0d9-4652-93db-ea0d56dd9db8 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/action" status: 202 len: 0 microversion: 2.1 time: 0.197965 Oct 04 18:51:45.458792 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3556/7217] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:51:45 2022] POST /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:51:45.467318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:45.467994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:45.474711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.475244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.475706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.476442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:45.476918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:45.477362 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:45.615392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:45.623820 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-17049631-2439-48b1-b83a-08d4d9fb25b2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.160732 Oct 04 18:51:45.624403 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3662/7218] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:45 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:46.648319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:46.649028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:46.658668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.659160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.659607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.660348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:46.660907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:46.661338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:46.681428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:46.809481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:46.818470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eb697362-0d78-454f-9ca4-01c5adb0bfda tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.174718 Oct 04 18:51:46.819147 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3557/7219] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:46 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:47.847156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:47.847890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:47.857158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.857668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.858273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:47.859145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:47.859632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:47.860084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:48.008200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:48.016951 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-59ecaf80-4ffb-4dfb-9f8c-6002c984e79c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.174019 Oct 04 18:51:48.017544 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3663/7220] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:47 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:49.040358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:49.040987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:49.052419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.053337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.054189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.055385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.056398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.057606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.295966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:49.314191 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0c6885dd-93fa-46f9-99f4-33abba758fbc tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.277539 Oct 04 18:51:49.329854 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3558/7221] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:49 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:49.542432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:49.563247 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:49.563764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:49.564219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:49.579197 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Creating event network-changed:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h2-831194-21 Oct 04 18:51:49.585559 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:51:49.598101 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3b54997c-4da5-4581-ae70-b820f9cf4849 req-f6aff1c9-a7bd-4119-ab9b-049666086a3e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060669 Oct 04 18:51:49.599182 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3664/7222] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:50.340098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:50.340756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:50.348057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.348566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.349068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.349729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:50.350392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:50.350831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:50.570159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:50.578560 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2991e445-c29f-46d6-880c-86756c439aef tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.242512 Oct 04 18:51:50.579148 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3559/7223] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:50 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:51.603168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:51.604049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:51.610868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.611364 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.611826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.612556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:51.613024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:51.613466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:51.759404 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:51.768109 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00bd7578-c8d1-4efb-9103-8350472f4388 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1677 microversion: 2.1 time: 0.170133 Oct 04 18:51:51.769055 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3665/7224] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:51 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:52.792239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:52.792759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.796242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:52.802515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.803150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.803581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.804290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.804754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.805188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.946122 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:52.954375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-66444477-fc9a-4fdd-b4a3-b764b25fc43e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1670 microversion: 2.1 time: 0.166195 Oct 04 18:51:52.954957 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3560/7225] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:52 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:52.976624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:52.977265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:52.981791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=33 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:52.986197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.986713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.987170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.987896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:52.988382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:52.988829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:52.993009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=93 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:53.126347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:53.134369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca45da77-7ca8-4e29-8d2e-e865721b9cbd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1670 microversion: 2.1 time: 0.161579 Oct 04 18:51:53.134938 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3666/7226] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:52 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:53.157848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.158481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.164730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.165224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.165675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.166412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.166874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.167307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.298670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:53.307627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-63df5527-834f-4fb0-919e-7f564127e4a1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1670 microversion: 2.1 time: 0.154469 Oct 04 18:51:53.308233 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3561/7227] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:53 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:53.330270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.330718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.336722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.337250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.337705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.338465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.338933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.339376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.365970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:51:53.443219 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8216a50e-228a-4097-a068-19b89007da1e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 204 len: 0 microversion: 2.1 time: 0.116728 Oct 04 18:51:53.443812 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3667/7228] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:51:53 2022] DELETE /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:51:53.455749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:53.456403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:53.462710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.463205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.463645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.464343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:53.464799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:53.465226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:53.599251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:53.607627 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aaf9b229-c9b3-4d90-9da5-0698085d8397 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1676 microversion: 2.1 time: 0.158882 Oct 04 18:51:53.608378 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3562/7229] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:53 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:54.632191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:54.632917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:54.640072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.640581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.641040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.641755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:54.642260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:54.642708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:54.772486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:54.781006 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-93b11708-47e0-47a0-a130-3d6bb8ce2e12 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1676 microversion: 2.1 time: 0.153150 Oct 04 18:51:54.781574 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3668/7230] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:54 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:55.805290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:55.805969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:55.808805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:51:55.815517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.816019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.816467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.817185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:55.817648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:55.818110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:55.905101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:55.915200 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a6618a8-6a6e-4764-adf4-c56e4f600a57 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 200 len: 1608 microversion: 2.1 time: 0.114026 Oct 04 18:51:55.915789 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3563/7231] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:55 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 1608 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:56.099382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f754cb5-c872-49cb-b0b7-603cd0e5fbaa", "name": "network-vif-deleted", "tag": "e679a0b3-45dc-46aa-810f-0793eb7ba694"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:56.113797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.114449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.114904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.131388 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] Creating event network-vif-deleted:e679a0b3-45dc-46aa-810f-0793eb7ba694 for instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa on n-h2-831194-21 Oct 04 18:51:56.136307 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1123606a-4220-49b5-9e84-7e0a39466e5a req-ea25ce36-4885-49da-9713-78fdb578c2e6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041582 Oct 04 18:51:56.136927 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3669/7232] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:51:56.940045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.940665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.947646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.948154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.948610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.949330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.949797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.950848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.965297 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa HTTP/1.1 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7f754cb5-c872-49cb-b0b7-603cd0e5fbaa'} Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:56.967152 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d13f5d58-1550-4513-9608-7d7b1bb05d43 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 404 len: 111 microversion: 2.1 time: 0.032743 Oct 04 18:51:56.971691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3564/7233] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:56.986696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:56.987521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:56.994276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.994795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.995318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:56.996141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:56.996613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:56.997613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.013925 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa HTTP/1.1 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '7f754cb5-c872-49cb-b0b7-603cd0e5fbaa'} Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:51:57.015629 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3d95c877-5caf-40a2-8434-dd7d05d281df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 404 len: 111 microversion: 2.1 time: 0.036023 Oct 04 18:51:57.020136 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3670/7234] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:56 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:51:57.067352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2016676490", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "dc051c7d-0a66-4fd5-8c6f-3895d63506f2"}], "security_groups": [{"name": "tempest-securitygroup--1657142062"}], "key_name": "tempest-keypair-653552464", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:51:57.190876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] validate_networks() for [('dc051c7d-0a66-4fd5-8c6f-3895d63506f2', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:51:57.585055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:51:57.585483 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:51:57.586015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:51:57.586424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:51:57.586837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:51:57.597304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.597799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.598276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.599018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:57.599485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:57.599924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:57.617283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:51:57.623226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Getting quotas for user d6f30742a5e74155970fbbedc6e60b69 and project d0af6eef94c54aec86b00290acde7bfc. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:51:57.636204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:51:57.639450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:51:57.687393 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-13ab393b-d5ea-461b-b29d-e10756e3a6ad tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.623942 Oct 04 18:51:57.688050 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3565/7235] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:51:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:51:57.702195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30639727-a78a-4ded-9dc1-5048b8a77457 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:57.702996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-30639727-a78a-4ded-9dc1-5048b8a77457 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:57.771795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-30639727-a78a-4ded-9dc1-5048b8a77457 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:57.780471 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30639727-a78a-4ded-9dc1-5048b8a77457 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1238 microversion: 2.1 time: 0.084341 Oct 04 18:51:57.782429 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3671/7236] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:57 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:51:58.805749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:58.807055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:58.815185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.815919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.816548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.817692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:58.818338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:58.818772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:58.907188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:51:58.918173 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c2c6f3cf-b34a-4939-8eb7-844f20b9f26c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1298 microversion: 2.1 time: 0.117193 Oct 04 18:51:58.919574 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3566/7237] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:58 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1298 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:51:59.944549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:51:59.945266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:51:59.952830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.953354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.953819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:51:59.954582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:51:59.955068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:51:59.955687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.102054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:00.111537 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d993de7d-e703-413b-b802-7483d270552b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.171960 Oct 04 18:52:00.112163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3672/7238] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:51:59 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:00.289461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:00.302442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:00.302952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:00.303919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:00.318714 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] Creating event network-changed:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h1-831194-21 Oct 04 18:52:00.326404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-35ef8bed-9635-4fc0-8196-cfb81fc992ba req-490a3b67-f18b-49ed-a3d1-897f3fab21fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039981 Oct 04 18:52:00.327499 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3567/7239] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:01.143449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:01.144634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:01.155754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.156369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.156893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.157746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:01.158330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:01.158816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:01.352094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:01.362225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f3f1aa9-0b7f-440d-b281-a4c5ee041300 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.229441 Oct 04 18:52:01.363052 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3673/7240] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:01 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:02.389537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:02.390274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:02.398118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.398616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.399196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.399774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:02.400230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:02.400769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:02.537688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:02.545412 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4934d50a-07e7-4370-81f5-e96e02c9cde4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.161741 Oct 04 18:52:02.546012 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3568/7241] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:02 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:03.568911 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:03.569544 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:03.575979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.576483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.576941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.577649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:03.578151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:03.578597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:03.715832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:03.723851 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0696538-b274-4a1c-973c-cb698eb09f20 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.159189 Oct 04 18:52:03.724426 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3674/7242] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:03 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:04.749858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:04.750790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:04.761551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.762814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.763350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.765105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:04.765105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:04.765105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:04.909502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:04.918836 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-34d8c227-9ee5-4c64-9f27-107d19426609 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.174595 Oct 04 18:52:04.923582 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3569/7243] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:04 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:05.944401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:05.945041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:05.952973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.953480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.953963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:05.954679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:05.955155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:05.955605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:06.092215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:06.100129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f2aeda4a-d76a-4f96-991c-58ba182ec439 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.159725 Oct 04 18:52:06.100917 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3675/7244] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:05 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:06.705439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "name": "network-vif-plugged", "status": "completed", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:06.717281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:06.717776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:06.718246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:06.730404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] Creating event network-vif-plugged:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h1-831194-21 Oct 04 18:52:06.736980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6e9eb1f0-1016-47b6-8d6a-ef67f030b199 req-325ff8c5-617c-43af-919a-8b619cc5d486 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035591 Oct 04 18:52:06.737537 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3570/7245] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:07.124098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:07.124745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:07.131764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.132276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.132742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.133483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:07.134118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:07.134625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:07.273137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:07.281485 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e70156a3-8bda-463e-b59b-e7e6d120728c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1364 microversion: 2.1 time: 0.161943 Oct 04 18:52:07.282084 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3676/7246] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:07 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:52:08.304186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:08.305224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:08.310964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:08.311671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:08.318653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.319142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.319584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.320278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.320740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.321168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.454142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:08.461995 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a74eaefc-5130-48c9-aa7d-57042fbbdb01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1551 microversion: 2.1 time: 0.158889 Oct 04 18:52:08.462573 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3571/7247] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:08 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1551 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:08.486199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:08.487013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:08.489027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:08.495845 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.496853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.497418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.498178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:08.498657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:08.499106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:08.585237 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01211963-4f09-454d-9619-394e40869062 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103232 Oct 04 18:52:08.585855 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3677/7248] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:52:08 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:09.664383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:09.674466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:09.674952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:09.675418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:09.687958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] Creating event network-changed:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h1-831194-21 Oct 04 18:52:09.693334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-652a089d-3cf4-4d2d-a9d0-bb38ae7684e5 req-ff685eac-5ab5-4cec-9c70-76b630f8c06d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088442 Oct 04 18:52:09.694031 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3572/7249] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:52:46.195724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:46.196547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:46.202029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:46.202701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.210348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.210861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.211322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.212042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.212521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.212970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.406186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:46.414068 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1fc7884e-f081-40fd-8f5f-e888d1e30a89 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1670 microversion: 2.1 time: 0.220369 Oct 04 18:52:46.414641 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3678/7250] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:46 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1670 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:52:46.436954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:46.437695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=72 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:46.442071 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64a56139-9c02-447c-9bdc-b2b45f12d670"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:46.444497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:46.451932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.452422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.452869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.453568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:46.454056 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:46.454487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:46.839483 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac1f88cd-7b11-4cce-95cb-ef493cd542bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.405241 Oct 04 18:52:46.840600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3573/7251] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:52:46 2022] POST /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:52:58.649231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:52:58.651629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.655114 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:58.655936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:58.661452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.661982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.662438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.663151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.663615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.664054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.693238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:58.698710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 18:52:58.706367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:52:58.706801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:52:58.707288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:52:58.707999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:52:58.708467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:52:58.776331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf461d90-a707-4ca9-ab5e-de78c81d0c2d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "POST /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/action" status: 202 len: 0 microversion: 2.1 time: 0.131469 Oct 04 18:52:58.777857 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3679/7252] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:52:58 2022] POST /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:52:58.786827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:52:58.787670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:52:58.796957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:58.796957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:52:58.798342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.799096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.799675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.800567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:52:58.801031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:52:58.801467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:52:58.995702 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:52:59.005361 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c304eae9-27fc-4f31-ae8f-05c7118fb5b3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1725 microversion: 2.1 time: 0.223199 Oct 04 18:52:59.006097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3574/7253] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:52:58 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:00.031568 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:00.032205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:00.039414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.039795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.040507 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.041227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:00.041705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:00.042185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:00.176997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:00.186173 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c29db849-2a2e-4628-9d80-fbdcadf71834 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1725 microversion: 2.1 time: 0.160210 Oct 04 18:53:00.186949 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3680/7254] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:00 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:01.210002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:01.210622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:01.218173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.218662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.219096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.219796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:01.220251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:01.220679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:01.357127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:01.365366 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14ce7df6-728f-4857-9a41-78e953587d30 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.159359 Oct 04 18:53:01.365964 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3575/7255] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:01 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:02.389160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:02.389863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:02.396523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.397023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.397477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.398215 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:02.398690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:02.399133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:02.532260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:02.540439 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f85a6579-2be5-457e-80f3-abc33a8b3552 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.155857 Oct 04 18:53:02.541008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3681/7256] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:02 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:03.564858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:03.565487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:03.572227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.572723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.573172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.573899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:03.574376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:03.574803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:03.708274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:03.716654 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d72d9c25-0411-42a5-bbbd-61bb9fad70fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.155801 Oct 04 18:53:03.717249 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3576/7257] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:03 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:04.740504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:04.741153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:04.748857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.749360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.749809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.750539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:04.751005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:04.751444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:04.889158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:04.898168 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fd2e87e6-a223-46aa-835d-f3d03cc1f948 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.161596 Oct 04 18:53:04.898755 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3682/7258] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:04 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:05.923227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:05.923894 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:05.930858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.931899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.932360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:05.933082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:05.933653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:05.934300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:06.077949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:06.086754 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1fd10a5-f124-42e5-a9ce-7012342ae75d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.167732 Oct 04 18:53:06.087352 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3577/7259] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:05 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:07.112475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:07.113044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:07.120039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.120570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.121009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.123008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:07.123499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:07.123954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:07.255231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:07.263615 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-be2fbc61-0630-40f0-83aa-e49a2d428a02 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.155250 Oct 04 18:53:07.264185 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3683/7260] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:07 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:08.288299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:08.288923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:08.295829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.296320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.297258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.297996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:08.298458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:08.298891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:08.453966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:08.462503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48e279e7-9963-485e-a43d-7506d7558f58 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.178131 Oct 04 18:53:08.463079 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3578/7261] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:08 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:09.486862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:09.487499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:09.494540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.495047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.495500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.496208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:09.497336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:09.497785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:09.636714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:09.645393 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b7af24e0-23c6-483e-ada8-5fabfafba1fd tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.162538 Oct 04 18:53:09.646007 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3684/7262] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:09 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:10.669232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:10.669914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:10.676825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.677315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.677761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.678484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:10.678945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:10.679374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:10.809747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:10.818397 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9416ca9-c1e6-42d0-b51e-5aebe70438f3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.153736 Oct 04 18:53:10.818978 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3579/7263] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:10 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:11.843589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:11.844157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:11.851020 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.851519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.851966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:11.852682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:11.853145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:11.853585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:12.005532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:12.014882 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4929deff-9297-4642-8626-55eb59f712e9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.175497 Oct 04 18:53:12.015469 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3685/7264] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:11 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:13.040731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:13.041352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:13.049663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.049907 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.050539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.051061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:13.051530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:13.051968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:13.271814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:13.283202 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7db3cbf8-07fc-4995-a100-fecc0ef4057c tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.246369 Oct 04 18:53:13.283844 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3580/7265] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:13 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:14.306718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:14.307358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:14.314969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.315472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.315923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.316634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:14.317100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:14.317541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:14.452681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:14.461025 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d87ae397-9d07-4356-900b-a59a38aae8fe tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.158217 Oct 04 18:53:14.461602 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3686/7266] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:14 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:15.485394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:15.486052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:15.492932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.493421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.493890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.494589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:15.495052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:15.495486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:15.625286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:15.633504 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e84270bf-9e6d-4d6b-a218-acb9a94bd748 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.152407 Oct 04 18:53:15.634112 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3581/7267] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:15 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:16.657080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:16.657630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:16.664583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.665081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.665534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.666288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:16.666769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:16.667214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:16.801597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:16.810682 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-db434876-00a5-4195-9ca6-c7d34221666e tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.157996 Oct 04 18:53:16.811258 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3687/7268] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:16 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:17.834776 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:17.835402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:17.842709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.843203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.843962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.845228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:17.846677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:17.846677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:17.983208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:17.991555 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a18a2da-fea0-4450-ba4c-9c70025fe3bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.160708 Oct 04 18:53:17.992146 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3582/7269] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:17 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:19.016652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:19.017274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:19.024448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.024940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.025388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.026111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:19.026578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:19.027016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:19.161412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:19.169892 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2662bc1-fef0-49cf-8f72-cde44cd11d1a tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.158042 Oct 04 18:53:19.170475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3688/7270] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:19 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:20.192687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:20.193316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:20.200986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.201481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.202156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.202865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:20.203330 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:20.203769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:20.338524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:20.347255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-166a9b93-f280-4b6d-821e-30916dd297c7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.158532 Oct 04 18:53:20.347847 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3583/7271] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:20 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:21.371335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:21.372163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:21.379357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.379861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.380317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.381034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:21.381510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:21.381985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:21.521295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:21.531454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc7a2e3a-7b77-4cd0-90b0-96f0ff338746 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.164228 Oct 04 18:53:21.532054 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3689/7272] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:21 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:22.555501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:22.556067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:22.563132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.563624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.564070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.564770 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:22.565230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:22.565663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:22.696767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:22.706205 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b064cdf-c296-4492-9f28-711219df1018 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.154728 Oct 04 18:53:22.706795 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3584/7273] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:22 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:23.731886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:23.732513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:23.739872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.740373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.740822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.741541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:23.742044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:23.742483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:23.888780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:23.898170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c130b8d1-61af-4fc4-9478-15a9a52e16e2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.171055 Oct 04 18:53:23.898827 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3690/7274] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:23 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:24.922883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:24.923506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:24.930837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.931400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.931962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:24.932737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:24.933368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:24.934594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.120406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:25.129657 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-56409cc0-02e2-43a3-a905-efa5c6172e51 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1730 microversion: 2.1 time: 0.211532 Oct 04 18:53:25.130276 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3585/7275] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:24 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:25.821686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "name": "network-vif-unplugged", "status": "completed", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:25.834191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:25.834848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:25.835304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:25.854119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Creating event network-vif-unplugged:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h2-831194-21 Oct 04 18:53:25.863003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:25.878584 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-1c8ce464-4741-42a6-8d20-c11a7cb6e274 req-cf72dd2b-30bd-4815-a225-8defbe4d0f9e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142201 Oct 04 18:53:25.879217 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3691/7276] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:26.153765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:26.154412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:26.161649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.162172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.162612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.163313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:26.163772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:26.164195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:26.421371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:26.429927 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f05e1ec8-ee16-4e3b-bfa3-37d329f21764 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1729 microversion: 2.1 time: 0.280491 Oct 04 18:53:26.430525 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3586/7277] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:26 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1729 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.457379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:27.458139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:27.464532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.465579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.466153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.466874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.467343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.467778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.609759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:27.618569 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f1f88179-7641-4df3-b693-20904e765146 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1727 microversion: 2.1 time: 0.166438 Oct 04 18:53:27.619154 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3692/7278] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:27 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:27.900726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:27.906618 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:53:27.906827 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 04 18:53:27.915248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:27.915806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:27.916328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:27.929417 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Creating event network-changed:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h2-831194-21 Oct 04 18:53:27.936269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:27.947479 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-99d696f2-9b7a-46f8-a8e3-9bdc20f7e0c8 req-43121b7e-ffd3-45e7-88f4-84f7654ad609 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050364 Oct 04 18:53:27.948107 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3587/7279] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:28.648245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:28.649366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:28.655275 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:53:28.655506 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d (ip 10.222.0.42) !!! Oct 04 18:53:28.660096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=33 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:28.667099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.668151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.668756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.669335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:28.669808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:28.670281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:28.675561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:28.819290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:28.828429 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-38e41228-c32a-44c0-b045-37b9cfe97713 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1727 microversion: 2.1 time: 0.187618 Oct 04 18:53:28.829026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3693/7280] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:28 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:29.853338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:29.854081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:29.856135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=29 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:29.862417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.862916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.863360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.864069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:29.864696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:29.865160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:29.867962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=83 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:30.006685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:30.016146 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-662e2304-94a5-4f60-af2c-35f0f4537293 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1727 microversion: 2.1 time: 0.167928 Oct 04 18:53:30.016745 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3588/7281] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:29 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:31.040146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:31.040785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:31.047897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.048412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.048870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.049595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:31.050102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:31.050552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:31.186563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:31.195160 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-498882c3-b1ed-4949-b6c9-d01934c011d9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1727 microversion: 2.1 time: 0.159050 Oct 04 18:53:31.195774 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3694/7282] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:31 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:32.221974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:32.222912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:32.232462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.233144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.233803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.235128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:32.235454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:32.237439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:32.396386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:32.404905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aebafca5-7bd8-4d5e-a8b7-6fd2a6d5156b tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1727 microversion: 2.1 time: 0.188740 Oct 04 18:53:32.405430 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3589/7283] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:32 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:33.430547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.431133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.438126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.438649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.439100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.439824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.440331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.440786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.475925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.476692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.477167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.477775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:33.603220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.612110 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2253e46b-61f1-4ff0-9bb6-c12e174760df tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1778 microversion: 2.1 time: 0.186051 Oct 04 18:53:33.612691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3695/7284] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1778 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:33.653364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:33.654079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:33.660237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.660734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.661178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.661910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.662374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.662809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.695243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:33.695736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:33.696183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:33.696634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:33.820582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:33.829983 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac4457df-a90a-4818-8120-9397d585774f tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1778 microversion: 2.1 time: 0.181716 Oct 04 18:53:33.830569 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3590/7285] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:33 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1778 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:34.854577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:34.855259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:34.862304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.862825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.863283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.864008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.864487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.864939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.899013 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:34.899521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:34.899984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:34.900452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:35.014644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.023241 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8481be9e-a8d0-4803-ae68-fd65310d66d2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1778 microversion: 2.1 time: 0.172612 Oct 04 18:53:35.023818 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3696/7286] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:34 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1778 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:35.053450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.053995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.061485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.062006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.062474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.063170 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.063622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.064050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.092443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:35.183699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-082f8d15-bde2-4d75-b35c-351daa519c00 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 204 len: 0 microversion: 2.1 time: 0.133164 Oct 04 18:53:35.184843 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3591/7287] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:35 2022] DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:35.193970 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:35.194601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:35.201276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.201774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.202246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.202950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.203418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.203861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.238736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:35.239228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:35.239680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:35.240147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:35.357057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:35.365314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4fd42b4f-c751-468a-b688-1b6739b9edac tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1784 microversion: 2.1 time: 0.175225 Oct 04 18:53:35.365908 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3697/7288] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:35 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1784 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:36.391490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.392285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.400419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.400994 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.401508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.403183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.403822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.404629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.411592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5a2da-0a17-4ef2-ab50-94c33ab9b97d", "name": "network-vif-deleted", "tag": "d6dd0658-f011-4f15-b0c9-38e0bb824fb1"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:36.424985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.425802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.426471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.441469 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Creating event network-vif-deleted:d6dd0658-f011-4f15-b0c9-38e0bb824fb1 for instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d on n-h2-831194-21 Oct 04 18:53:36.448814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 18:53:36.463707 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3a6096d5-ac10-4667-b0a3-201dffbc2186 req-698afcd3-2596-4eda-91fb-d449303709f2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054981 Oct 04 18:53:36.465477 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3698/7289] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:36.467322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.467976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.468400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.469181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:36.529109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.546047 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0bb5f93e-046a-4dbe-a71f-aac1808313f1 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1716 microversion: 2.1 time: 0.159234 Oct 04 18:53:36.558316 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3592/7290] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1716 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:36.586807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.587122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.594943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.595320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.595723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.596460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.596943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.597380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.633715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:53:36.689591 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.compute.api [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Instance is already in deleting state, ignoring this request Oct 04 18:53:36.690488 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48de699f-460c-4d0e-9974-d64762d575e4 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 204 len: 0 microversion: 2.1 time: 0.108734 Oct 04 18:53:36.691105 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3699/7291] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:36 2022] DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:53:36.699715 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:36.700925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:36.708378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.708887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.709369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.710111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.710574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.711197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.752893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:36.753542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:36.754028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:36.754501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:36.802291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:36.815230 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bcf192b2-bc5a-4d7e-b0e7-0f74c910fa63 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1431 microversion: 2.1 time: 0.119430 Oct 04 18:53:36.815845 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3593/7292] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:36 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1431 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:37.840525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:37.841174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:37.848541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.849055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.849516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.850283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.850765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.851216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.885138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:37.885642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:37.886127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:37.886600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lazy-loading 'fault' on Instance uuid 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:53:37.929587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6f30742a5e74155970fbbedc6e60b69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af6eef94c54aec86b00290acde7bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:37.939225 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c644cf4b-ac47-4ac6-b71b-ef78af6b9494 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 200 len: 1431 microversion: 2.1 time: 0.102777 Oct 04 18:53:37.939802 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3700/7293] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:37 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 1431 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:38.019591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:38.021798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:38.029379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.029884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.030322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.031014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:38.031463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:38.031886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:38.063172 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-44431016-3644-4e40-a16a-1fb4d52aa102 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047881 Oct 04 18:53:38.064195 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3594/7294] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:53:38 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:39.076296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:39.078565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:39.085738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.086274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.086728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.087451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:39.087920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:39.088359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:39.126126 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9336a40b-2a79-4804-909a-e96ce7945530 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054528 Oct 04 18:53:39.126717 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3701/7295] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:53:39 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:53:40.139582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:40.141785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:40.148852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.149337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.149774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.150490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:40.150938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:40.151360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:40.182398 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a0af1def-78a3-4dc6-ab28-001d32a1057d tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047312 Oct 04 18:53:40.183033 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3595/7296] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:53:40 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:53:41.195081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:41.197350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:41.204651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.205160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.205620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.206426 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:41.206909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:41.207354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:41.221454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments HTTP/1.1 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '7be5a2da-0a17-4ef2-ab50-94c33ab9b97d'} Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:41.223204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd135889-150e-442e-97d8-c3c08038bd01 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033703 Oct 04 18:53:41.228034 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3702/7297] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:53:41 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 04 18:53:44.561212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.561717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.568797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.569286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.570027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.570727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.571185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.571616 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.585822 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d HTTP/1.1 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7be5a2da-0a17-4ef2-ab50-94c33ab9b97d'} Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.587533 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97f8b9f1-c024-47fb-9492-9694c759a2d7 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 404 len: 111 microversion: 2.1 time: 0.031860 Oct 04 18:53:44.593206 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3596/7298] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:44 2022] DELETE /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.598838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.599477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.607048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.607552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.608019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.608728 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.609345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.610135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.624238 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d HTTP/1.1 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '7be5a2da-0a17-4ef2-ab50-94c33ab9b97d'} Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.625865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7be5a2da-0a17-4ef2-ab50-94c33ab9b97d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da545c5b-6654-491d-8f3e-e3b52743addb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d" status: 404 len: 111 microversion: 2.1 time: 0.032470 Oct 04 18:53:44.630791 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3703/7299] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:44 2022] GET /compute/v2.1/servers/7be5a2da-0a17-4ef2-ab50-94c33ab9b97d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.636484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.637028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.643196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.643690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.644139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.645114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.646068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.646068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.660698 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa HTTP/1.1 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '7f754cb5-c872-49cb-b0b7-603cd0e5fbaa'} Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.662309 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b218aa55-e27e-4d30-8222-dda4b46478bb tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 404 len: 111 microversion: 2.1 time: 0.031625 Oct 04 18:53:44.666324 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3597/7300] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:44 2022] DELETE /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.673253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.673937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.679927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.680430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.680890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.681612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.682101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.682552 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.696556 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa HTTP/1.1 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '7f754cb5-c872-49cb-b0b7-603cd0e5fbaa'} Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.698121 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 7f754cb5-c872-49cb-b0b7-603cd0e5fbaa could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-35eaf007-f150-428c-a319-888a98a134ae tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa" status: 404 len: 111 microversion: 2.1 time: 0.030593 Oct 04 18:53:44.702623 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3704/7301] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:44 2022] GET /compute/v2.1/servers/7f754cb5-c872-49cb-b0b7-603cd0e5fbaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.708448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.709224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.715725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.716216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.716652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.717364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.717821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.718276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.734239 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 HTTP/1.1 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '69f13168-ae38-4e91-83f7-cfeb17d003e3'} Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.735842 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.740835 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b14e06ca-6577-4be4-a2da-802c29dc37bf tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 404 len: 111 microversion: 2.1 time: 0.032994 Oct 04 18:53:44.747432 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3598/7302] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:44 2022] DELETE /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.747793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.748450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 69f13168-ae38-4e91-83f7-cfeb17d003e3] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.754890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.755400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.755858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.756587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.757062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.757509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.775357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 HTTP/1.1 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '69f13168-ae38-4e91-83f7-cfeb17d003e3'} Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.777701 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 69f13168-ae38-4e91-83f7-cfeb17d003e3 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b505c82c-3bdf-4b38-b147-d140fed916b9 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3" status: 404 len: 111 microversion: 2.1 time: 0.037157 Oct 04 18:53:44.782475 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3705/7303] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:44 2022] GET /compute/v2.1/servers/69f13168-ae38-4e91-83f7-cfeb17d003e3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.791517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.792665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.802912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.823168 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 HTTP/1.1 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '487fc61a-a11f-45bb-b9e9-3e1bab97fa22'} Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.824909 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-feb8fb30-b889-4c3a-b290-27ee49f7d931 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 404 len: 111 microversion: 2.1 time: 0.039975 Oct 04 18:53:44.829820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3599/7304] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:53:44 2022] DELETE /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.837442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.838087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] [instance: 487fc61a-a11f-45bb-b9e9-3e1bab97fa22] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:44.844840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.845335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.845785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.846571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:44.847035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:44.847471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:44.862112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] HTTP exception thrown: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Request method failure captured: Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 HTTP/1.1 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPH_ds-XbyFQEdLHKEyJSfF4RT-v2VGhbBQLjdCGdJWHK7BHcIx5GGNGXSywTbHHdwYNu2Pji2WSOsqkXeh0lmzylZ3WusQisNYeGT3id2cl2zIS8bE3TPY3H3tPxWqtdfHsWtEokjiPCHwYW7mgv7EQGllfFA2Xz2SQDFQXqY2sRY9M Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_d0af6eef94c54aec86b00290acde7bfc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: d0af6eef94c54aec86b00290acde7bfc Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServerActionsTestJSON-1927096977 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: d6f30742a5e74155970fbbedc6e60b69 Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServerActionsTestJSON-1927096977-project Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '487fc61a-a11f-45bb-b9e9-3e1bab97fa22'} Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:53:44.863671 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Returning 404 to user: Instance 487fc61a-a11f-45bb-b9e9-3e1bab97fa22 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cc2330fb-638e-4a0a-8b01-d9a2eb466aa3 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22" status: 404 len: 111 microversion: 2.1 time: 0.031532 Oct 04 18:53:44.867950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3706/7305] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:44 2022] GET /compute/v2.1/servers/487fc61a-a11f-45bb-b9e9-3e1bab97fa22 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:53:44.874551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-657b000d-2b8a-42cb-be48-6d80deb3ead2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] Calling method '.version_select at 0x7fbdc1e69d30>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:44.899377 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-657b000d-2b8a-42cb-be48-6d80deb3ead2 tempest-ServerActionsTestJSON-1927096977 tempest-ServerActionsTestJSON-1927096977-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-653552464" status: 202 len: 0 microversion: 2.1 time: 0.028779 Oct 04 18:53:44.899994 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3600/7306] 10.222.0.42 () {58 vars in 1218 bytes} [Tue Oct 4 18:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-653552464 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:53:54.468437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1061080678", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "2b8662c1-8e72-4024-8687-fee16517230d"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:54.538561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] validate_networks() for [('2b8662c1-8e72-4024-8687-fee16517230d', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:53:54.852666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:55.369080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:53:55.370497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:53:55.371406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:53:55.372434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:53:55.373187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:53:55.384884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.386238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.387186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.388052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:55.388621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:55.389142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:55.409449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Getting quotas for project acc5a869176b46de8b3515a3059da88a. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:53:55.414851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Getting quotas for user b4745f651a8f41c78e520894191db932 and project acc5a869176b46de8b3515a3059da88a. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:53:55.427925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:53:55.430295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:53:55.478135 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0943c948-7e4c-4f6c-a680-deaa25b41422 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.147262 Oct 04 18:53:55.478785 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3707/7307] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:53:55.488398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:55.489182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:55.494034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6b37b8fc-0c5c-421d-964a-b72b466989b8 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:55.494671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6b37b8fc-0c5c-421d-964a-b72b466989b8 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:55.558304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6b37b8fc-0c5c-421d-964a-b72b466989b8 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:55.567221 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6b37b8fc-0c5c-421d-964a-b72b466989b8 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1217 microversion: 2.1 time: 0.080813 Oct 04 18:53:55.568143 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3601/7308] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:55 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:56.592852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:56.593501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:56.600550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.601062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.601538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:56.602256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:56.602727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:56.603167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:56.668745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:56.677653 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8590e43-394d-407f-925e-c87e0403ce47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1269 microversion: 2.1 time: 0.090289 Oct 04 18:53:56.678263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3708/7309] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:56 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1269 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:57.706651 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:57.707300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:57.715755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.716338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.716784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.717675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:57.718167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:57.718593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:57.834683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:57.845065 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4dc5767e-a3ef-4494-91c6-f5a52f7ae9b7 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1277 microversion: 2.1 time: 0.142502 Oct 04 18:53:57.845934 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3602/7310] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:57 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:53:58.871510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:53:58.872170 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:53:58.875335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:53:58.882652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:58.883604 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:58.884339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:58.885431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:58.886865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:58.887712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:59.031280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:53:59.039238 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd05bc09-6201-4dbd-bb83-32c179452eed tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.172286 Oct 04 18:53:59.039811 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3709/7311] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:53:58 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:53:59.273141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3347463b-61cc-44ab-bc0d-67b54a6478f6", "tag": "be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:53:59.284187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:53:59.284670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:53:59.285130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:53:59.297079 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] Creating event network-changed:be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3 for instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 on n-h2-831194-21 Oct 04 18:53:59.303444 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2e2f4dbd-c1e7-4411-bbb4-3da526eab46a req-b5a23f13-9e62-495f-99af-11d7ec323f77 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034421 Oct 04 18:53:59.304067 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3603/7312] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:00.063581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:00.064236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:00.071153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.071668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.072127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.072912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:00.073687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:00.074147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:00.213401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:00.222230 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-43dd4cf1-57cf-4de7-8352-94c94e2faba3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.162504 Oct 04 18:54:00.222845 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3710/7313] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:00 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:01.246244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:01.246976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:01.253286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.253774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.254237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.254928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:01.255383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:01.255805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:01.484238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:01.492631 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1e6c988-b2ca-4209-9651-e15851b0fc82 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.251585 Oct 04 18:54:01.493273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3604/7314] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:01 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:02.520266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:02.520907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:02.529977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.530498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.530962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.531708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:02.532188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:02.532641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:02.679811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:02.688635 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-da89ae1d-70bd-48e3-8fcf-e04dfb320425 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.172620 Oct 04 18:54:02.689284 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3711/7315] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:02 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:03.712589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:03.713200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:03.719558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.720047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.720482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.721174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:03.721627 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:03.722079 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:03.856438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:03.864747 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-af8a57ee-ff2c-4a2f-a1cb-b06bf93ed997 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.156109 Oct 04 18:54:03.865334 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3605/7316] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:03 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:04.719019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3347463b-61cc-44ab-bc0d-67b54a6478f6", "name": "network-vif-plugged", "status": "completed", "tag": "be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:04.729571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.730125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.730697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.742778 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] Creating event network-vif-plugged:be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3 for instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 on n-h2-831194-21 Oct 04 18:54:04.748715 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-011eaf95-f5cd-43fc-868b-61507f43a0bd req-54b7ccb2-1017-4bfe-8ed6-77e894e31e1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117457 Oct 04 18:54:04.749213 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3712/7317] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:04.889804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:04.890461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:04.897950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.898446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.898889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:04.899599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:04.900061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:04.900493 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:05.064129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:05.072091 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c9181113-8b13-4faa-999d-3338ddb1155a tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1317 microversion: 2.1 time: 0.187541 Oct 04 18:54:05.072683 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3606/7318] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:04 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1317 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:06.092848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:06.093632 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:06.099221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:06.099978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:06.108463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.108979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.109450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.110200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.110677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.111308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.251043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:06.260155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ed0652ac-7088-4a81-84f0-09a7ffe7421d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.168305 Oct 04 18:54:06.260776 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3713/7319] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:06 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:06.323597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-310227747", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "2b8662c1-8e72-4024-8687-fee16517230d"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:06.332570 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:06.379062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] validate_networks() for [('2b8662c1-8e72-4024-8687-fee16517230d', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:54:06.774087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:54:06.774518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:54:06.775037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:54:06.775509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:54:06.775926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:54:06.785850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.786350 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.786790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.787520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:06.787979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:06.788408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:06.806214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Getting quotas for project acc5a869176b46de8b3515a3059da88a. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:54:06.811547 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Getting quotas for user b4745f651a8f41c78e520894191db932 and project acc5a869176b46de8b3515a3059da88a. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:54:06.823800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:54:06.826639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:54:06.871592 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [a1a6119c-8217-4fe4-86af-c9f5ed59fa4e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 18:54:07.879156 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [a1a6119c-8217-4fe4-86af-c9f5ed59fa4e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 39128. Oct 04 18:54:07.883534 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4fab8b28-f1c0-4b52-bb28-e17ae48f55ba tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.563995 Oct 04 18:54:07.884188 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3607/7320] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:54:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:54:07.896018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-746f3d3f-25a5-4037-87a1-2a934343a26e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:07.896638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-746f3d3f-25a5-4037-87a1-2a934343a26e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:07.956146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-746f3d3f-25a5-4037-87a1-2a934343a26e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:07.964462 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-746f3d3f-25a5-4037-87a1-2a934343a26e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1216 microversion: 2.1 time: 0.072571 Oct 04 18:54:07.965041 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3714/7321] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:07 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1216 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:08.989725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:08.990510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:08.999969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.000560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.001020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.001785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:09.002467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:09.003412 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:09.086173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:09.094620 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dea4a587-1ee9-4053-a3e0-5e82526bcd6b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1286 microversion: 2.1 time: 0.109701 Oct 04 18:54:09.095200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3608/7322] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:08 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:10.116722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:10.117416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:10.124982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.125484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.125959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.126904 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.127149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.127587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.265700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:10.273685 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-273ff374-6676-4c42-9149-6c47f7564a10 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.160985 Oct 04 18:54:10.274301 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3715/7323] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:10 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:10.404248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c9d44c8-3966-4769-bd49-a3953dfa54ba", "tag": "fb21a35c-3a3e-4d36-ad90-4b8dd38a0871"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:10.415415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:10.415901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:10.416374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:10.441521 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] Creating event network-changed:fb21a35c-3a3e-4d36-ad90-4b8dd38a0871 for instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba on n-h1-831194-21 Oct 04 18:54:10.447861 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-73b801bf-23aa-4a5e-a8db-cf4b160b05ed req-105ccd80-8c23-498c-a602-b6d0fe033cac service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046998 Oct 04 18:54:10.448496 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3609/7324] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:11.296909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:11.297621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:11.305147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.305650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.306131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.306842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:11.307312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:11.307760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:11.439567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:11.447463 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9b5a71d-c2fb-442c-b219-ef2b1475455b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.154663 Oct 04 18:54:11.448047 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3716/7325] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:11 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:12.471578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:12.472245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:12.479380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.479871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.480318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.481014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:12.481473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:12.481927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:12.612138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:12.619817 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-da536920-f47f-4cf6-9f66-12b71b9c74c3 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.153182 Oct 04 18:54:12.620386 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3610/7326] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:12 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:13.643534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:13.644705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:13.651778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.652405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.652887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.653607 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:13.654279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:13.655660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:13.813255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:13.822169 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f8ebb9f9-3787-4e06-98b5-708a0d7c1e8c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.182606 Oct 04 18:54:13.822768 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3717/7327] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:13 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:54:14.849140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:14.850020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:14.856756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.858571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.859049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:14.859804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:14.860267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:14.860703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.005068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:15.013387 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0be36aed-e357-42ac-ace0-2c929cf16e6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.168534 Oct 04 18:54:15.014024 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3611/7328] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:14 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:15.309955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9d44c8-3966-4769-bd49-a3953dfa54ba", "name": "network-vif-plugged", "status": "completed", "tag": "fb21a35c-3a3e-4d36-ad90-4b8dd38a0871"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:15.322239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:15.322836 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:15.323297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:15.335985 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] Creating event network-vif-plugged:fb21a35c-3a3e-4d36-ad90-4b8dd38a0871 for instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba on n-h1-831194-21 Oct 04 18:54:15.341287 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-e4db174d-b6d4-4fb2-abaf-4003b9f32302 req-d86bbcd4-f55c-419d-b066-cc4e1c935c0a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Oct 04 18:54:15.343316 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3718/7329] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:16.040970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:16.041637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:16.049322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.049823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.050299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.050999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:16.051465 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:16.051901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:16.182721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:16.191741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e226105a-b786-4293-8880-f94d97acd82b tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1316 microversion: 2.1 time: 0.154774 Oct 04 18:54:16.192333 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3612/7330] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:16 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.217710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.218478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.224751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.225256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.225712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.226460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.226937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.227386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.361316 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.369085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-528984b7-18b1-4006-9771-6f7646bf4783 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1506 microversion: 2.1 time: 0.157288 Oct 04 18:54:17.369650 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3719/7331] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:17.391562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.392118 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.394051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:17.394988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:17.402253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.402742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.403179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.403920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.404377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.404802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.431221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:17.508045 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d8feec72-2cbd-4a10-9e5d-10e0053814de tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 204 len: 0 microversion: 2.1 time: 0.120328 Oct 04 18:54:17.508725 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3613/7332] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:17 2022] DELETE /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:54:17.517455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:17.518126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:17.524342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.524838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.525288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.526021 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:17.526488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:17.526925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:17.657180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:17.664944 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bd348f6b-4a6b-4f90-9f8c-08a8b1945be4 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1512 microversion: 2.1 time: 0.151713 Oct 04 18:54:17.665508 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3720/7333] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:17 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:18.689254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:18.689993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:18.696783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.697267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.697710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.698435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:18.698892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:18.699321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:18.837782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:18.845579 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-90873f70-1aed-4e28-b433-bee489916fdc tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1512 microversion: 2.1 time: 0.161339 Oct 04 18:54:18.846181 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3614/7334] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:18 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:19.719308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c9d44c8-3966-4769-bd49-a3953dfa54ba", "name": "network-vif-deleted", "tag": "fb21a35c-3a3e-4d36-ad90-4b8dd38a0871"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:19.725909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:19.736420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.736981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.737852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.753026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] Creating event network-vif-deleted:fb21a35c-3a3e-4d36-ad90-4b8dd38a0871 for instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba on n-h1-831194-21 Oct 04 18:54:19.758328 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3faa4026-3735-4c1c-855d-315b6df3508a req-416dcc33-6375-49fa-8729-f446445ae4d5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043624 Oct 04 18:54:19.759386 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3721/7335] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:19.869708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:19.870618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:19.878541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.879251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.879719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.880721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.881255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.882701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.928230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:19.928723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:19.929171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:19.929680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lazy-loading 'fault' on Instance uuid 5c9d44c8-3966-4769-bd49-a3953dfa54ba {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:19.982765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:19.991214 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b6b08c6-d4ca-4273-86e8-3bc62e5f8d57 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 200 len: 1306 microversion: 2.1 time: 0.126381 Oct 04 18:54:19.991805 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3615/7336] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:19 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 1306 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.016589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.017236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.024739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.025249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.025712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.026465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.026944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.027395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.044946 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba HTTP/1.1 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '5c9d44c8-3966-4769-bd49-a3953dfa54ba'} Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.046679 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 404 to user: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-906380a1-2e11-45b3-bac5-862057a57e47 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 404 len: 111 microversion: 2.1 time: 0.037150 Oct 04 18:54:21.053097 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3722/7337] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:21.058439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.059553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.065862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.066364 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.066816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.067510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.067959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.068382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.204681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.212763 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9098eae0-613a-4016-a043-75655e3c7ebd tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.158777 Oct 04 18:54:21.213349 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3616/7338] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.236078 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:21.238384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 4bfa19e7-2b08-4182-9ba1-d9260b50feec] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.244203 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/4bfa19e7-2b08-4182-9ba1-d9260b50feec/action HTTP/1.1 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 32 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: {"resize": {"flavorRef": "452"}} Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '4bfa19e7-2b08-4182-9ba1-d9260b50feec', 'body': {'resize': {'flavorRef': '452'}}} Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:21.245812 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 404 to user: Instance 4bfa19e7-2b08-4182-9ba1-d9260b50feec could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d637cf8-89f6-41a7-a840-bb641709b623 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "POST /compute/v2.1/servers/4bfa19e7-2b08-4182-9ba1-d9260b50feec/action" status: 404 len: 111 microversion: 2.1 time: 0.015385 Oct 04 18:54:21.250176 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3723/7339] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:21 2022] POST /compute/v2.1/servers/4bfa19e7-2b08-4182-9ba1-d9260b50feec/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:21.256332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.256956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.263656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.264154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.264601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.265318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.265781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.266243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.398843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.407762 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8123d7df-48c0-48a9-bcce-183014e285c0 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.155296 Oct 04 18:54:21.408346 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3617/7340] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.430827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.431454 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.439058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.439554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.440001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.440703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.441174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.441616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.580906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.588680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-951117f6-c650-4def-98b0-d55701e3234c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.161779 Oct 04 18:54:21.589253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3724/7341] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.611596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "9791f3af-5002-4de5-b7ff-4d776d6cb4dd"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:21.613949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.620362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.620858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.621307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.622044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.623063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.623456 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.643881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:21.654275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.659971 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: request: POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action HTTP/1.1 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 65 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: {"resize": {"flavorRef": "9791f3af-5002-4de5-b7ff-4d776d6cb4dd"}} Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: exception: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3347463b-61cc-44ab-bc0d-67b54a6478f6', 'body': {'resize': {'flavorRef': '9791f3af-5002-4de5-b7ff-4d776d6cb4dd'}}} Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:21.679752 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 400 to user: Flavor 9791f3af-5002-4de5-b7ff-4d776d6cb4dd could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4d420ac-3ab2-454f-be77-aa845179e411 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action" status: 400 len: 107 microversion: 2.1 time: 0.074304 Oct 04 18:54:21.684337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3618/7342] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:21 2022] POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action => generated 107 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:21.690974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.691617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.697716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.698257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.698718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.699434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.699909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.700361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.845807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:21.854373 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25d0c300-21a7-47c4-90c6-ae04e739a2a6 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.167169 Oct 04 18:54:21.854957 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3725/7343] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:21.879920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:21.880471 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:21.887347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.887844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.888327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:21.889040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:21.889507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:21.889976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.025179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.034184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aedeac65-4fca-43bf-9a0b-70d529218785 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.159552 Oct 04 18:54:22.034776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3619/7344] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:21 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.058345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f01f604c-59d2-418c-b45d-fd842d0a75b9 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f01f604c-59d2-418c-b45d-fd842d0a75b9 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: request: POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action HTTP/1.1 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 29 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: {"resize": {"flavorRef": ""}} Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '3347463b-61cc-44ab-bc0d-67b54a6478f6', 'body': {'resize': {'flavorRef': ''}}} Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise error Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi '' Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.062888 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f01f604c-59d2-418c-b45d-fd842d0a75b9 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f01f604c-59d2-418c-b45d-fd842d0a75b9 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action" status: 400 len: 113 microversion: 2.1 time: 0.010161 Oct 04 18:54:22.068279 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3726/7345] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:54:22 2022] POST /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 04 18:54:22.074284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.074913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.086746 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.087250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.087693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.088402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.088866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.089295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.228084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.236040 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d17faa1d-7273-492f-8236-7afd32501097 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1506 microversion: 2.1 time: 0.165774 Oct 04 18:54:22.236634 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3620/7346] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:22.264492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.265694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.272758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.273267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.273730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.274474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.274982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.275431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.289243 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba HTTP/1.1 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '5c9d44c8-3966-4769-bd49-a3953dfa54ba'} Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.290865 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 404 to user: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0fe3aca-1306-40e2-97b7-dd3664d62d6c tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 404 len: 111 microversion: 2.1 time: 0.033380 Oct 04 18:54:22.296658 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3727/7347] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:22 2022] DELETE /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:22.301300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.301939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 5c9d44c8-3966-4769-bd49-a3953dfa54ba] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.307937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.308421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.308856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.309538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.310521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.311062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.327500 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba HTTP/1.1 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '5c9d44c8-3966-4769-bd49-a3953dfa54ba'} Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:22.329040 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 404 to user: Instance 5c9d44c8-3966-4769-bd49-a3953dfa54ba could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7aac437c-13d0-43ae-a72f-2bfcb57f27ae tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba" status: 404 len: 111 microversion: 2.1 time: 0.033089 Oct 04 18:54:22.334077 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3621/7348] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/5c9d44c8-3966-4769-bd49-a3953dfa54ba => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:54:22.339238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.339747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.346289 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.346784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.347239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.347934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.348397 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.348831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.375359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:54:22.431535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:22.459861 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af3eec3f-747f-4039-b9c8-868b85e66c1d tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 204 len: 0 microversion: 2.1 time: 0.124086 Oct 04 18:54:22.460451 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3728/7349] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:54:22 2022] DELETE /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 18:54:22.468726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:22.469353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:22.475628 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.476121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.476571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.477281 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:22.477747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:22.478212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:22.613505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:22.621337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17d7621c-bf50-4316-8be4-2764e0e3f995 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1512 microversion: 2.1 time: 0.156629 Oct 04 18:54:22.621997 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3622/7350] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:22 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:23.646472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:23.647219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:23.654027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.655226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.655682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.656410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:23.656873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:23.657307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:23.796270 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:23.804338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b62901f4-8f49-4f73-a299-b8d47d076533 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1512 microversion: 2.1 time: 0.162482 Oct 04 18:54:23.804915 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3729/7351] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:23 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:24.538821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3347463b-61cc-44ab-bc0d-67b54a6478f6", "name": "network-vif-deleted", "tag": "be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:54:24.550893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.551473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.551906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.565783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] Creating event network-vif-deleted:be3cac2a-b60c-48b9-ba8a-5b4fe6d44af3 for instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 on n-h2-831194-21 Oct 04 18:54:24.571780 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2ea68144-e580-4768-8087-9672e7e496f7 req-27413c99-16fe-4888-9aef-a16c96511176 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036472 Oct 04 18:54:24.572501 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3623/7352] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:54:24.827128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:24.827764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:24.834358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.834786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.835233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.835947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.836414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.836853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.871288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:24.871785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:24.872238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:24.872698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lazy-loading 'fault' on Instance uuid 3347463b-61cc-44ab-bc0d-67b54a6478f6 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:54:24.918191 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b4745f651a8f41c78e520894191db932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acc5a869176b46de8b3515a3059da88a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:54:24.926920 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0f949968-a870-4ba2-9732-fecccecc653e tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 200 len: 1307 microversion: 2.1 time: 0.103852 Oct 04 18:54:24.927484 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3730/7353] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:24 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 1307 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:54:25.952753 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:54:25.953468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] [instance: 3347463b-61cc-44ab-bc0d-67b54a6478f6] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:54:25.955485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:54:25.961106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.961606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.962080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.962788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:54:25.963252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:54:25.963689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:54:25.979231 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] HTTP exception thrown: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Request method failure captured: Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 HTTP/1.1 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIFCzgoLlbCiGRiC_IuUZpFFKcM7bqQwaGbWcqrIgVUmaKypz0nU8jD3Z4VURMIhYdazyibYOSDIlBEkDwgZEtW9pfBz7Eu9IpO2VDBGyz7POPt-quM2lb00Ft-D24gMXcogFnKtQDo22WtxAbySYoNRoUrWeV2plU_2vercRaamGq0 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/acc5a869176b46de8b3515a3059da88a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_acc5a869176b46de8b3515a3059da88a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: acc5a869176b46de8b3515a3059da88a Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-ServersNegativeTestJSON-147695059 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: b4745f651a8f41c78e520894191db932 Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-ServersNegativeTestJSON-147695059-project Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3347463b-61cc-44ab-bc0d-67b54a6478f6'} Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:54:25.980919 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] Returning 404 to user: Instance 3347463b-61cc-44ab-bc0d-67b54a6478f6 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ebfd10e-0974-42da-88cf-6b3fb6f24d49 tempest-ServersNegativeTestJSON-147695059 tempest-ServersNegativeTestJSON-147695059-project] 10.222.0.42 "GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6" status: 404 len: 111 microversion: 2.1 time: 0.035048 Oct 04 18:54:25.987600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3624/7354] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:54:25 2022] GET /compute/v2.1/servers/3347463b-61cc-44ab-bc0d-67b54a6478f6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:00.002909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.004159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=14 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.181056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0087b8a-88db-40f2-907c-93ff68313078 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: .version_select at 0x7fbdbd067a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-624149389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHLLwDNO/1FxfbEXG8TCtMPp86bPlBbK1u6XcrYVqFgjUgVI6CTRRNDKp1OFJilTeI2XSMANsaFKe87+Y69pYyjvNsmrucg3vgYTk7ErRl9lZhs8IjY7Wuk5J/LZItQprg=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:00.197350 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d0087b8a-88db-40f2-907c-93ff68313078 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:00.203236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-d0087b8a-88db-40f2-907c-93ff68313078 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:00.234677 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0087b8a-88db-40f2-907c-93ff68313078 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.237574 Oct 04 18:55:00.235292 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3731/7355] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:54:59 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:00.335953 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-667586985", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-624149389", "networks": [{"uuid": "a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:00.346877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=24 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.347673 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:00.398931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] validate_networks() for [('a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:01.033366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:01.034470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:01.039885 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:01.042297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:01.046009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:01.066425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.066992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.067501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.068313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:01.068768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:01.069196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:01.087520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:01.094245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:01.115598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:01.118167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:01.175190 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-387727c6-b6a9-4a27-bba1-7e3c229c5dc4 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.843166 Oct 04 18:55:01.176574 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3625/7356] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:01.189205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7641a8da-4879-4657-8c6d-f4b0727ec191 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:01.190656 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7641a8da-4879-4657-8c6d-f4b0727ec191 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:01.265795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7641a8da-4879-4657-8c6d-f4b0727ec191 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:01.275816 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7641a8da-4879-4657-8c6d-f4b0727ec191 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1261 microversion: 2.1 time: 0.092077 Oct 04 18:55:01.286256 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3732/7357] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:01 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1261 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:02.303052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:02.303688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:02.312834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.313371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.313950 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.314575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:02.315718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:02.315718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:02.422550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:02.433774 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eff29be5-26ac-4120-a151-24f6d784c090 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1313 microversion: 2.1 time: 0.136715 Oct 04 18:55:02.446560 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3626/7358] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:02 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:03.457069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:03.457698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:03.468218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.468969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.469587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.470512 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:03.471138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:03.471755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:03.625802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:03.634084 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b443b1f7-3e11-4a4b-b623-b68978909c5e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.181071 Oct 04 18:55:03.635346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3733/7359] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:03 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:03.959098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e8d5d0c-9049-4f56-b7b1-e57945d58f4f", "tag": "2347631e-a3fb-4d58-b52e-8710e9bc92da"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:03.999851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.001149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.001859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.020081 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] Creating event network-changed:2347631e-a3fb-4d58-b52e-8710e9bc92da for instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f on n-h1-831194-21 Oct 04 18:55:04.028027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b82642b6-0ec8-46cb-88fd-0340c9aa6599 req-26468ad5-fd43-40eb-8754-08b4a25a9b50 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079423 Oct 04 18:55:04.029770 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3627/7360] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:04.662126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:04.663500 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:04.671580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.672093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.672550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.673415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:04.673914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:04.674357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:04.821962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:04.848054 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a85aa88-35a5-4787-b4ea-ef401c438382 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.190999 Oct 04 18:55:04.858848 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3734/7361] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:04 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:05.872972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:05.873690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:05.880967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.881474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.881961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:05.882679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:05.883140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:05.883575 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:06.026559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:06.034914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5219cd8b-2a32-4740-80fd-ba23319c430a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.166596 Oct 04 18:55:06.035488 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3628/7362] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:05 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:07.058414 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:07.059053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:07.066125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.066631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.067087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.067832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:07.068302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:07.068748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:07.208905 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:07.217128 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1d3528f9-09c1-44ba-a66b-9db6297cdbe3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.162620 Oct 04 18:55:07.217702 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3735/7363] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:07 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:08.239826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:08.240450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:08.249006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.249497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.249974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.250682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:08.251141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:08.251579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:08.389818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:08.397749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f8c86f65-e2c9-477d-abde-8f2030b9414a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.161871 Oct 04 18:55:08.398350 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3629/7364] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:08 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:09.423035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:09.423736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:09.432174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.432683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.433140 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.434423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.434981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.435419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.551548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8d5d0c-9049-4f56-b7b1-e57945d58f4f", "name": "network-vif-plugged", "status": "completed", "tag": "2347631e-a3fb-4d58-b52e-8710e9bc92da"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:09.564861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:09.565403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:09.566272 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:09.580181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:09.581298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] Creating event network-vif-plugged:2347631e-a3fb-4d58-b52e-8710e9bc92da for instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f on n-h1-831194-21 Oct 04 18:55:09.586914 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f443b632-1631-4325-84da-1787856dbf2b req-0bbab95f-2df8-4787-892f-1443d0d4c73b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039785 Oct 04 18:55:09.587927 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3630/7365] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:09.588472 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-00da9282-451d-4a9d-a1cc-c666eab7a074 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.170166 Oct 04 18:55:09.589049 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3736/7366] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:09 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:10.613017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:10.613727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:10.620767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.621341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.622463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.623196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:10.623669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:10.624107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:10.755164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:10.763136 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e280c1f9-aad7-4194-b8d9-e463260b0f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1361 microversion: 2.1 time: 0.154349 Oct 04 18:55:10.763715 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3631/7367] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:10 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:11.786780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.787421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.790282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:11.796560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.797096 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.797556 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.798302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.798783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.799229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.929479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:11.937767 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eeea6eb2-7f34-4a43-a6a4-e1f69f09a043 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1553 microversion: 2.1 time: 0.154984 Oct 04 18:55:11.938389 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3737/7368] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:11.960592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:11.961250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:11.963240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:11.963921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:11.971004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.971499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.971941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:11.972638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:11.973099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:11.973531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:12.109106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:12.117024 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4bfc3853-ac15-44ae-ae2e-21302de3abcb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1553 microversion: 2.1 time: 0.160359 Oct 04 18:55:12.117600 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3632/7369] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:11 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1553 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:13.734626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "478f0e05-47e8-46b6-b288-b5baa2060d4b"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:13.737107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:13.743909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.744407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.744855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.745565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:13.746070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:13.746765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:13.999792 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9369aba-f4d3-4489-8fac-aeea8eea50a8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269435 Oct 04 18:55:14.000471 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3738/7370] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:55:13 2022] POST /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:25.824437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:25.824989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:25.828564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:25.829447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=36 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:25.835648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:25.836145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:25.836595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:25.837295 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:25.837756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:25.838215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:25.924760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lazy-loading 'services' on Instance uuid 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:55:25.996960 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-60a186b8-1dc9-4b55-92b8-3d244506402d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments/478f0e05-47e8-46b6-b288-b5baa2060d4b" status: 202 len: 0 microversion: 2.1 time: 0.176517 Oct 04 18:55:25.998087 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3633/7371] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:55:25 2022] DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments/478f0e05-47e8-46b6-b288-b5baa2060d4b => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:26.005618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:26.007101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:26.011819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:26.014945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:26.026127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.026638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.027100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.027825 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:26.028314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:26.029196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:26.063137 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-038bdf06-e835-413b-83ef-d2a78cd30fb7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060050 Oct 04 18:55:26.063705 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3739/7372] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:26 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:27.078558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:27.080959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:27.087531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:27.088023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:27.088472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.089176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:27.089631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:27.090091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:27.121724 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79fc8c80-3274-4d2c-bba8-3977ab90368c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049235 Oct 04 18:55:27.122260 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3634/7373] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:27 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:28.135193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:28.137469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:28.145586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.146120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.146572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.147288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:28.147749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:28.148186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:28.182272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fdf88702-a18c-4d92-8b92-a621f9c1e7b2 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051700 Oct 04 18:55:28.182865 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3740/7374] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:28 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:29.196766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:29.199158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:29.206327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.206826 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.207277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.207983 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:29.208444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:29.208879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:29.241513 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e311967a-0982-40c3-a1ad-fb5c34312233 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048796 Oct 04 18:55:29.242132 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3635/7375] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:29 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:30.254943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:30.257228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:30.264649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.265153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.265609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.266363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:30.266835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:30.267280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:30.299580 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42ee16d3-c1a3-491f-8e52-c8bb18d64810 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048673 Oct 04 18:55:30.300164 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3741/7376] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:30 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:31.311745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:31.313968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.321194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.321780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.322314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.323153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.323683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.324113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.356717 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ce082a00-b8ef-4b18-9371-7502c801a133 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049056 Oct 04 18:55:31.357930 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3636/7377] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:55:31 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:55:31.369172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:31.369697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:31.376752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.377255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.377740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.378525 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:31.379092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:31.379541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:31.456992 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f is not attached to volume 478f0e05-47e8-46b6-b288-b5baa2060d4b Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments/478f0e05-47e8-46b6-b288-b5baa2060d4b HTTP/1.1 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f is not attached to volume 478f0e05-47e8-46b6-b288-b5baa2060d4b Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '4e8d5d0c-9049-4f56-b7b1-e57945d58f4f', 'id': '478f0e05-47e8-46b6-b288-b5baa2060d4b'} Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 478f0e05-47e8-46b6-b288-b5baa2060d4b. Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f is not attached to volume 478f0e05-47e8-46b6-b288-b5baa2060d4b Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:31.467923 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f is not attached to volume 478f0e05-47e8-46b6-b288-b5baa2060d4b Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f is not attached to volume 478f0e05-47e8-46b6-b288-b5baa2060d4b {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2c72c46d-82c7-4417-ae7a-bb78d15c3197 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments/478f0e05-47e8-46b6-b288-b5baa2060d4b" status: 404 len: 154 microversion: 2.1 time: 0.104328 Oct 04 18:55:31.472694 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3742/7378] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:55:31 2022] DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f/os-volume_attachments/478f0e05-47e8-46b6-b288-b5baa2060d4b => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:34.829601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.830132 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.836044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.836532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.836982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.837679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.838174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.838599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.863905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:55:34.950389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-46aec169-bb41-421d-979a-328d1e986e2a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 204 len: 0 microversion: 2.1 time: 0.125525 Oct 04 18:55:34.951013 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3637/7379] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:55:34 2022] DELETE /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:55:34.961882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:34.963069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:34.970496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.970995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.971448 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:34.972161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:34.972624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:34.973062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:35.108811 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:35.116947 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ff8e2b2c-6e2f-41ac-903d-c36ac8cc5761 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1559 microversion: 2.1 time: 0.160577 Oct 04 18:55:35.117513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3743/7380] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:34 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:36.142966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:36.143686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:36.150977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.151475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.151922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.152629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:36.153092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:36.153531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:36.286369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:36.294409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-25b887a2-ea86-49df-b17f-96ae4f7c34b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1559 microversion: 2.1 time: 0.156616 Oct 04 18:55:36.295489 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3638/7381] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:36 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:37.319418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:37.320584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:37.333235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e8d5d0c-9049-4f56-b7b1-e57945d58f4f", "name": "network-vif-deleted", "tag": "2347631e-a3fb-4d58-b52e-8710e9bc92da"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:37.339917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.340446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.340927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.342256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.342741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.343285 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.351567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:37.352048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:37.352484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:37.368489 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] Creating event network-vif-deleted:2347631e-a3fb-4d58-b52e-8710e9bc92da for instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f on n-h1-831194-21 Oct 04 18:55:37.373980 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-57e75c71-9279-4f15-887d-bd6d68bdd8ec req-961a3460-0b39-4222-ab5e-ab69c1f2bedc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044589 Oct 04 18:55:37.374595 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3639/7382] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:37.441321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:37.449639 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b448ea7d-cb0d-45d0-8546-91444a186c3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 200 len: 1517 microversion: 2.1 time: 0.134832 Oct 04 18:55:37.450505 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3744/7383] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:37 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 1517 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:38.474708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.475424 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:38.481601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.482127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.482644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.483277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:38.483738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:38.484172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:38.497575 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f HTTP/1.1 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '4e8d5d0c-9049-4f56-b7b1-e57945d58f4f'} Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.499623 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 4e8d5d0c-9049-4f56-b7b1-e57945d58f4f could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9d39475b-1ad9-4307-83d9-fa653bfc155f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f" status: 404 len: 111 microversion: 2.1 time: 0.031526 Oct 04 18:55:38.504283 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3640/7384] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:38 2022] GET /compute/v2.1/servers/4e8d5d0c-9049-4f56-b7b1-e57945d58f4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:55:38.510124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-97e45c9e-274c-4bcc-b777-7ba9197ad95c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '.version_select at 0x7fbdbc552430>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:38.532352 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-97e45c9e-274c-4bcc-b777-7ba9197ad95c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-624149389" status: 202 len: 0 microversion: 2.1 time: 0.026129 Oct 04 18:55:38.532931 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3745/7385] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:55:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-624149389 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:55:38.550155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-604548c9-8f2e-4deb-a0a4-afb0cd02a328 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: .version_select at 0x7fbdbd997d30>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-300346471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKhzAOqbs66QlTshp9Zq/do8KX8rSc7MvIS4xmQPzy1MZVhTTvfLTofNl28bJxVt7wte6x2w/SEmZdBHhiVhEhwhhrZk+YOJhTqaJwMiCagl2e59k3GmKsq3naNqLb2Sg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:38.566023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-604548c9-8f2e-4deb-a0a4-afb0cd02a328 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:38.571163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-604548c9-8f2e-4deb-a0a4-afb0cd02a328 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:38.596139 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-604548c9-8f2e-4deb-a0a4-afb0cd02a328 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049983 Oct 04 18:55:38.596746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3641/7386] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:55:38 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:38.658330 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1328114818", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-300346471", "networks": [{"uuid": "a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:38.715155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] validate_networks() for [('a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:55:39.114902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:55:39.115341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:55:39.115827 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:55:39.116245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:55:39.116675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:55:39.125666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.126195 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.126646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.127387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:39.127850 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:39.128288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:39.145723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:55:39.151121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:55:39.163887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:55:39.166232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:55:39.213563 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-234609ac-a51e-479e-9c60-e4567ebe6e85 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562558 Oct 04 18:55:39.214262 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3746/7387] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:55:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:55:39.227012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be7b7fb1-8f7c-474d-b304-119115a20ce9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:39.227640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be7b7fb1-8f7c-474d-b304-119115a20ce9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:39.286807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be7b7fb1-8f7c-474d-b304-119115a20ce9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:39.295376 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be7b7fb1-8f7c-474d-b304-119115a20ce9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1262 microversion: 2.1 time: 0.072040 Oct 04 18:55:39.296301 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3642/7388] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:39 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1262 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:40.319144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:40.320465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:40.329736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.330407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.330863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.331593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:40.332064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:40.332508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:40.405259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:40.413364 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-30531219-df82-47a4-a27a-16dc8f29f7c0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1322 microversion: 2.1 time: 0.098269 Oct 04 18:55:40.414302 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3747/7389] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:40 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1322 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:41.439597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:41.440378 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:41.447328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.447899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.448294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.449003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.449468 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.449972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.673476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:41.681943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b26b872b-574e-44f9-8e44-b780611a09cf tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.246895 Oct 04 18:55:41.682541 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3643/7390] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:41 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:41.787956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64218d26-4bcf-432a-bb72-4a7df7fac5c0", "tag": "7cd8919d-1da1-48ed-a9bd-da3996b57a27"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:41.801696 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:41.802517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:41.803120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:41.815889 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] Creating event network-changed:7cd8919d-1da1-48ed-a9bd-da3996b57a27 for instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 on n-h1-831194-21 Oct 04 18:55:41.821407 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-530c6081-096f-4dba-909c-0f399f7e91a1 req-25a20ea2-598a-41ef-80d8-c7c02a454e26 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038654 Oct 04 18:55:41.822470 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3748/7391] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:42.707013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:42.707552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:42.714492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.715044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.715543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.716282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:42.717390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:42.717859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:42.866332 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:42.874232 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a479294-9c28-46e2-874f-e23ccddfb45f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.171104 Oct 04 18:55:42.874824 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3644/7392] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:42 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:43.898685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:43.899315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:43.906969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.907470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.907916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:43.908617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:43.909080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:43.909519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:44.040898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:44.048571 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9c6f70e1-8a80-46ce-afd6-41eea02be88b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.154561 Oct 04 18:55:44.049143 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3749/7393] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:43 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:45.072049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:45.072594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:45.081076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.081580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.082068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.082789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:45.083251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:45.083878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:45.222508 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:45.230093 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-badb078a-f798-4530-8646-984c927869f7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.162083 Oct 04 18:55:45.230670 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3645/7394] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:45 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:46.253105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:46.253729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:46.260647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.261144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.261625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.262349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:46.262820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:46.263374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:46.398622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:46.407051 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7142468d-5041-457e-bf3a-e08ebd8979d8 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.157869 Oct 04 18:55:46.407624 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3750/7395] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:46 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:47.430510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:47.431061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:47.438459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.438949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.439606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.440676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.441404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.442086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.590128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:47.599077 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d10cf5af-6f61-4f66-850f-9015e91d6478 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.172513 Oct 04 18:55:47.599669 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3646/7396] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:47 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:55:47.764743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64218d26-4bcf-432a-bb72-4a7df7fac5c0", "name": "network-vif-plugged", "status": "completed", "tag": "7cd8919d-1da1-48ed-a9bd-da3996b57a27"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:47.776305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:47.776818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:47.777457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:47.790266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] Creating event network-vif-plugged:7cd8919d-1da1-48ed-a9bd-da3996b57a27 for instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 on n-h1-831194-21 Oct 04 18:55:47.796268 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8e84ecf8-96b6-44f9-a887-4cddfb811a32 req-f923ce4c-af75-4064-9b66-ddc850970ba0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036098 Oct 04 18:55:47.796886 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3751/7397] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:55:48.622046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:48.623292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:48.630419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.630908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.631346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.632044 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:48.632499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:48.632922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:48.763872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:48.772036 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e15e968-025b-4264-86d5-101b850009cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1362 microversion: 2.1 time: 0.153956 Oct 04 18:55:48.772611 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3647/7398] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:48 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:49.793633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:49.794557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:49.798631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.799346 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.806419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.806915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.807367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.808095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.808561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.808999 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.944849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:49.954106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d246b85-fdc3-464b-98cb-f45332684288 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1554 microversion: 2.1 time: 0.162068 Oct 04 18:55:49.954691 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3752/7399] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:49 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:49.977072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:55:49.978241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:49.980190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:55:49.986268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.986754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.987194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:49.987886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:49.988340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:49.988764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:50.127948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:55:50.135719 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dc1adab5-62aa-433c-9d37-352056ca1f02 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1554 microversion: 2.1 time: 0.162704 Oct 04 18:55:50.136292 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3648/7400] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:55:49 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:55:51.642375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "24999541-fd83-413e-8898-27e099d60110"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:55:51.644996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:55:51.651892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.652403 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.652866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.653596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:55:51.654226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:55:51.654677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:55:51.911823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9200f498-2d76-42f4-bb6e-91b9fc37daf7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274091 Oct 04 18:55:51.912534 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3753/7401] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:55:51 2022] POST /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:02.667452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.668035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.671109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:02.672152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:02.679065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.679568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.680007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.680712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.681173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.681602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.776288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lazy-loading 'services' on Instance uuid 64218d26-4bcf-432a-bb72-4a7df7fac5c0 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:02.852850 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0670a70e-9999-48e3-a99d-113cb7b221b3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments/24999541-fd83-413e-8898-27e099d60110" status: 202 len: 0 microversion: 2.1 time: 0.189836 Oct 04 18:56:02.853503 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3649/7402] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:02 2022] DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments/24999541-fd83-413e-8898-27e099d60110 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:56:02.861415 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:02.862293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:02.866781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:02.869475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:02.876935 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.877613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.878092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.878861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:02.879351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:02.879795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:02.915070 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a6b9326d-fa5d-41c1-ad71-301c145ccd7e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055655 Oct 04 18:56:02.915633 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3754/7403] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:02 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:03.929327 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:03.931796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:03.939688 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.940184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.940631 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.941351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:03.941812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:03.942261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:03.984371 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bad78ec5-1280-458e-b789-aa0342ee15cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056798 Oct 04 18:56:03.988548 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3650/7404] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:03 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:05.001091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:05.003704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:05.011155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.011674 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.012138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.013160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:05.013682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:05.014216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:05.050883 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca98d52a-9acd-4031-935b-c0d9380bc232 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055495 Oct 04 18:56:05.051698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3755/7405] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:04 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:06.065028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:06.067614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:06.073844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.074268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.074710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.075962 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:06.076429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:06.076863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:06.109216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-193b1a57-9e28-4c82-a2fb-664b6b907a10 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049669 Oct 04 18:56:06.109852 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3651/7406] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:06 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:07.121225 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:07.124347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:07.131580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.132222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.132694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.133509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:07.134084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:07.134769 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:07.169469 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-959e642a-6ff7-4583-adcb-0e23f6add3de tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051579 Oct 04 18:56:07.174642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3756/7407] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:07 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:08.182124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.184362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.191282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.191781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.192229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.192934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.193396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.193911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.224192 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ac79091a-2d29-4cd4-ad92-af1095a26779 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046120 Oct 04 18:56:08.224771 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3652/7408] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:08 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:56:08.236037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:08.236543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:08.243383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.243893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.244353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.245067 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:08.245541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:08.246025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:08.323253 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 is not attached to volume 24999541-fd83-413e-8898-27e099d60110 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments/24999541-fd83-413e-8898-27e099d60110 HTTP/1.1 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 is not attached to volume 24999541-fd83-413e-8898-27e099d60110 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': '64218d26-4bcf-432a-bb72-4a7df7fac5c0', 'id': '24999541-fd83-413e-8898-27e099d60110'} Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 24999541-fd83-413e-8898-27e099d60110. Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 is not attached to volume 24999541-fd83-413e-8898-27e099d60110 Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:08.325477 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 is not attached to volume 24999541-fd83-413e-8898-27e099d60110 Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 is not attached to volume 24999541-fd83-413e-8898-27e099d60110 {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb0dfaba-8c75-4f6c-85ba-c04d6ac931cb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments/24999541-fd83-413e-8898-27e099d60110" status: 404 len: 154 microversion: 2.1 time: 0.095841 Oct 04 18:56:08.330495 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3757/7409] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:08 2022] DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0/os-volume_attachments/24999541-fd83-413e-8898-27e099d60110 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:11.694719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:11.695212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:11.702967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.703457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.703965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.704915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.705371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.705800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.732720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:11.822352 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a476e51d-61d3-45a5-a051-00c547fef758 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 204 len: 0 microversion: 2.1 time: 0.131033 Oct 04 18:56:11.823143 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3653/7410] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:11 2022] DELETE /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:11.832286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:11.832920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:11.843116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.843621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.844084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.844805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:11.845271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:11.845710 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:11.999665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:12.012064 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0a57de8a-0362-4161-8e62-dcdf06e87851 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1560 microversion: 2.1 time: 0.184132 Oct 04 18:56:12.013888 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3758/7411] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:11 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:13.037811 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:13.038566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:13.046905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.046905 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.047202 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.048196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:13.048663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:13.049085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:13.191445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:13.199305 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-776189f2-b7b4-42d3-88bf-d471c2d33fa1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1560 microversion: 2.1 time: 0.165814 Oct 04 18:56:13.200056 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3654/7412] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:13 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.223174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:14.224053 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:14.232223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.232741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.233386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.234148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.235424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.235892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.313250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:14.325892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64218d26-4bcf-432a-bb72-4a7df7fac5c0", "name": "network-vif-deleted", "tag": "7cd8919d-1da1-48ed-a9bd-da3996b57a27"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:14.333934 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-776ab807-649c-460f-b50c-e62551840757 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 200 len: 1518 microversion: 2.1 time: 0.114464 Oct 04 18:56:14.334754 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3759/7413] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:14 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 1518 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:14.337358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:14.337975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:14.338417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:14.353281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] Creating event network-vif-deleted:7cd8919d-1da1-48ed-a9bd-da3996b57a27 for instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 on n-h1-831194-21 Oct 04 18:56:14.360185 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9ee060c1-6d68-4f13-bd4e-adbe71f7ea02 req-05cbdcb0-1747-44a8-bd05-945434f59647 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038789 Oct 04 18:56:14.360801 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3655/7414] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:15.360468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.361018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 64218d26-4bcf-432a-bb72-4a7df7fac5c0] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:15.367951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.368459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.368922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.369634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:15.370582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:15.370744 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:15.384977 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 HTTP/1.1 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '64218d26-4bcf-432a-bb72-4a7df7fac5c0'} Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:15.386575 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 64218d26-4bcf-432a-bb72-4a7df7fac5c0 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a957865-b597-4b37-9df1-be3ed626a5b7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0" status: 404 len: 111 microversion: 2.1 time: 0.032520 Oct 04 18:56:15.391676 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3760/7415] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:15 2022] GET /compute/v2.1/servers/64218d26-4bcf-432a-bb72-4a7df7fac5c0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:15.398727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5d297c30-5cdb-4502-aa33-d4a61e72d81d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '.version_select at 0x7fbdc1e3a940>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:15.420805 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5d297c30-5cdb-4502-aa33-d4a61e72d81d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-300346471" status: 202 len: 0 microversion: 2.1 time: 0.027306 Oct 04 18:56:15.421404 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3656/7416] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-300346471 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:15.441358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4f58875d-d541-450c-a59d-71e471e1794f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: .version_select at 0x7fbdbd239af0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-433050051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMi1UD2Rpj8h/ymTIgVazSWQcSQ+OW+c+t9t/BQxPUUBXLxKgkvSxQoNpSp7QuTqh2mBk971F1Y9n2HGRGGWYCNrq5pzbhDVoOj2IiW7rJ+GzKv58rWrZloztnV1q0z1sw=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:15.456704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4f58875d-d541-450c-a59d-71e471e1794f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:15.461782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4f58875d-d541-450c-a59d-71e471e1794f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:15.488032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4f58875d-d541-450c-a59d-71e471e1794f tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.050574 Oct 04 18:56:15.488603 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3761/7417] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:56:15 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:15.540139 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-457028936", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-433050051", "networks": [{"uuid": "a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:15.596805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] validate_networks() for [('a69feedb-b1d4-4dd2-bcf2-dfbb4d7d430f', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:56:15.993886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:56:15.994323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:56:15.994806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:56:15.995221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:56:15.995637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:56:16.005190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.005678 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.006149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.006881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:16.007341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:16.007821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:16.027031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:56:16.033074 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Getting quotas for user ad43f5f193e24ff1982a1b4afe482738 and project b3572e107c7a40d89caffd66bf5e3324. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:56:16.046126 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:56:16.048562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:56:16.098566 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd04713e-fca1-4eed-9dd0-94728ae419e7 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562271 Oct 04 18:56:16.099727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3657/7418] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:56:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:56:16.112384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ffe708d-21af-428c-b8e6-1e36d665eb6a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:16.113147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ffe708d-21af-428c-b8e6-1e36d665eb6a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:16.175934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ffe708d-21af-428c-b8e6-1e36d665eb6a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:16.189272 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ffe708d-21af-428c-b8e6-1e36d665eb6a tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1261 microversion: 2.1 time: 0.078578 Oct 04 18:56:16.189272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3762/7419] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:16 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1261 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:17.213890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:17.214774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:17.225893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.226398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.226859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.227572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:17.228031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:17.228466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:17.308474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:17.318807 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-93c0421f-c21b-4efe-abc2-f587f8be2585 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1313 microversion: 2.1 time: 0.111306 Oct 04 18:56:17.319885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3658/7420] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:17 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1313 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.345014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:18.346712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:18.353704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.354267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.354757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.355461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.356252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.357349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.515434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:18.525129 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33ffc5c1-cbb3-46f7-ba49-aa78c3293bc3 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1361 microversion: 2.1 time: 0.185042 Oct 04 18:56:18.525727 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3763/7421] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:18 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:18.900868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a84b2ec-23a4-4956-9f22-14d2e98b9e7b", "tag": "7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:18.914744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:18.915329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:18.915860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:18.927814 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] Creating event network-changed:7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6 for instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b on n-h2-831194-21 Oct 04 18:56:18.933527 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-bba836a0-4e04-4aa5-b07a-bd8ede896835 req-ae7f0dec-35d4-44e1-864a-760aac5d09b8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036583 Oct 04 18:56:18.935492 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3659/7422] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:19.549551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:19.550425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:19.558795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.560113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.560486 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.562121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:19.562599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:19.563049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:19.702260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:19.710163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d7a56be5-968e-4b2d-8d83-b0f58bf6c8bb tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1361 microversion: 2.1 time: 0.164732 Oct 04 18:56:19.710733 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3764/7423] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:19 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:20.735121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:20.735840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:20.743680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.744189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.744642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:20.745380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:20.745867 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:20.746909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:21.164470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:21.172529 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-49594db8-63d1-469a-82e9-8694d0810389 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1361 microversion: 2.1 time: 0.442281 Oct 04 18:56:21.173270 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3660/7424] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:20 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:22.207117 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:22.207790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:22.214760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.215264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.215789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.217188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:22.217667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:22.218138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:22.367094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:22.375391 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-df7e0c7a-2757-46d1-913d-c81cece3509b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1361 microversion: 2.1 time: 0.172226 Oct 04 18:56:22.375972 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3765/7425] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:22 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:56:23.126356 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a84b2ec-23a4-4956-9f22-14d2e98b9e7b", "name": "network-vif-plugged", "status": "completed", "tag": "7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:23.138182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.138878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.139316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.151292 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] Creating event network-vif-plugged:7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6 for instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b on n-h2-831194-21 Oct 04 18:56:23.156895 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-7008d4aa-4878-45f2-822b-da9e7976779e req-edd96402-6ff7-446a-a46e-36f0aae7041c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034798 Oct 04 18:56:23.157580 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3661/7426] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:23.399681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:23.400291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:23.408328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.408833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.409281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.410024 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:23.410492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:23.410932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:23.556374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:23.565143 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a781395-ccf2-4883-a2fb-d2eef344d2dd tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1361 microversion: 2.1 time: 0.169323 Oct 04 18:56:23.565758 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3766/7427] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:23 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.590503 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.592362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.598623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.599131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.599574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.600275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.600737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.601169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.739834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.748241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-78d869d7-3ed5-42b3-b3ac-b920c534c08d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1553 microversion: 2.1 time: 0.162364 Oct 04 18:56:24.748827 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3662/7428] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:24.771328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:24.771967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:24.780333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.780844 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.781309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.782070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:24.782551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:24.783008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:24.916637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:24.925089 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5b1d1c59-70e3-444b-8c11-e00d19ce8a5b tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1553 microversion: 2.1 time: 0.157928 Oct 04 18:56:24.925664 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3767/7429] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:24 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:26.437819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35c88e95-47ab-45d1-967c-b29f1da1363f"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:26.440227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:26.443050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:26.443729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:26.449642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.450167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.451103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.451841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:26.452305 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:26.452744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:26.723382 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-000f8d96-880b-47b7-a6aa-1b44c41b81a1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "POST /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290379 Oct 04 18:56:26.725681 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3663/7430] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:56:26 2022] POST /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:38.510803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.511303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.513555 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.514866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.515588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=68 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.522808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.523324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.523785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.524509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.524985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.525432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.610249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lazy-loading 'services' on Instance uuid 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:38.682059 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8e07760f-6aeb-4934-be28-7670692de101 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments/35c88e95-47ab-45d1-967c-b29f1da1363f" status: 202 len: 0 microversion: 2.1 time: 0.175173 Oct 04 18:56:38.682687 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3768/7431] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:38 2022] DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments/35c88e95-47ab-45d1-967c-b29f1da1363f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:56:38.690218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.691169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:56:38.695640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:38.698043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:38.706986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.707490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.707935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.708644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:38.709106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:38.709541 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:38.746098 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8403594-5884-47db-a9e0-a8b7af06b04c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057781 Oct 04 18:56:38.746687 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3664/7432] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:38 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:56:39.759804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:39.762328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:39.770226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.770731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.771186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.771901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:39.772369 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:39.772813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:39.804475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0a4ef34-69a0-4627-b927-e575649014cc tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049036 Oct 04 18:56:39.805044 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3769/7433] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:39 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:40.817362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:40.819801 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:40.827947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.828563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.829075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.829904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:40.830482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:40.830978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:40.865271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84089437-1855-44d9-b7f5-663c98e706f0 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052048 Oct 04 18:56:40.865908 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3665/7434] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:40 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:41.878611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:41.880840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:41.887824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.888470 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.889633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.890377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:41.890858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:41.891302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:41.922939 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0aa77ff-6174-4fc5-979c-2ee228259fb5 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048251 Oct 04 18:56:41.923406 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3770/7435] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:41 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:42.935519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:42.937461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:42.944401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.944896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.945334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.946065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:42.946516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:42.946938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:42.979503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c0c270e-627c-409e-aca9-a194f935f53c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048217 Oct 04 18:56:42.980083 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3666/7436] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:42 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:43.992260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:43.994509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.002193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.002699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.003156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.003869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.004342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.004789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.036436 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-698eacbf-cef9-41ef-bb35-26d48492314e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048189 Oct 04 18:56:44.037006 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3771/7437] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 18:56:43 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 18:56:44.048482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:44.049038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:44.055782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.056262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.056700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.057387 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:44.057889 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:44.058321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:44.134310 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b is not attached to volume 35c88e95-47ab-45d1-967c-b29f1da1363f Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments/35c88e95-47ab-45d1-967c-b29f1da1363f HTTP/1.1 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b is not attached to volume 35c88e95-47ab-45d1-967c-b29f1da1363f Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '2a84b2ec-23a4-4956-9f22-14d2e98b9e7b', 'id': '35c88e95-47ab-45d1-967c-b29f1da1363f'} Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 35c88e95-47ab-45d1-967c-b29f1da1363f. Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b is not attached to volume 35c88e95-47ab-45d1-967c-b29f1da1363f Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:44.136286 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b is not attached to volume 35c88e95-47ab-45d1-967c-b29f1da1363f Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b is not attached to volume 35c88e95-47ab-45d1-967c-b29f1da1363f {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8cce1945-aafc-42db-8ea2-46d1b3bb213e tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments/35c88e95-47ab-45d1-967c-b29f1da1363f" status: 404 len: 154 microversion: 2.1 time: 0.094101 Oct 04 18:56:44.142057 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3667/7438] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 18:56:44 2022] DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b/os-volume_attachments/35c88e95-47ab-45d1-967c-b29f1da1363f => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:47.503739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.504264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.511290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.511799 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.512257 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.512971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.513944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.514068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.542808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 18:56:47.632115 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e690ccc8-c935-4dff-9b5d-fb40b1cf3d53 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 204 len: 0 microversion: 2.1 time: 0.132633 Oct 04 18:56:47.633340 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3772/7439] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 18:56:47 2022] DELETE /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 18:56:47.644043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:47.644769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:47.652006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.652505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.652973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.654605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:47.655205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:47.655395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:47.792135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:47.801155 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-100e6c33-e600-4f12-af23-0ceccc7d8a1d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1559 microversion: 2.1 time: 0.163264 Oct 04 18:56:47.801746 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3668/7440] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:47 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:48.824815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:48.825564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:48.833083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.833592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.834081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.834800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:48.835281 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:48.835729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:48.968272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:48.976128 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0169037-b22b-4f4e-8b48-c5dbaf06da3d tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1559 microversion: 2.1 time: 0.155672 Oct 04 18:56:48.976872 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3773/7441] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:48 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:49.836377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a84b2ec-23a4-4956-9f22-14d2e98b9e7b", "name": "network-vif-deleted", "tag": "7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:56:49.848585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:49.849060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:49.849489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:49.862343 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] Creating event network-vif-deleted:7f2299b7-fc96-4e68-80d1-1bf6b6eb7ce6 for instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b on n-h2-831194-21 Oct 04 18:56:49.867959 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-5f27c39c-451d-4d2e-9908-165aa9b12253 req-d86f0177-5d96-4d4d-a8e0-16f1b78c6113 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035160 Oct 04 18:56:49.868565 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3669/7442] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:56:50.001633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:50.002208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:50.009797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.010461 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.011083 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.011820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.012631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.012756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.056463 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:50.056974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:50.057433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:50.057956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lazy-loading 'fault' on Instance uuid 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 18:56:50.104885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad43f5f193e24ff1982a1b4afe482738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3572e107c7a40d89caffd66bf5e3324', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:56:50.113874 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e02aa7ab-cbf9-4b48-a281-bc477ed392d1 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 200 len: 1351 microversion: 2.1 time: 0.117183 Oct 04 18:56:50.114461 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3774/7443] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:49 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 1351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:56:51.138379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.139157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] [instance: 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:56:51.145785 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.146312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.146759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.147459 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:56:51.147926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:56:51.148360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:56:51.162138 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] HTTP exception thrown: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Request method failure captured: Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b HTTP/1.1 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIF_Wu68KqbPAvjP8sfDTiDkpkWLaElsbT6PP9ccDmbNATC3u8Nrv_IXWgCmH62aqdYqoRqLSHoKhL8Jk2qs9Qsl9D1SmcRrrYJsw35gdPOn_D1gTEevl1lTGoVR04cjALCWj_XU3hserp5H2Zsz67smbvWea23YbIVBea2u9Dks0RU Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_b3572e107c7a40d89caffd66bf5e3324"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: b3572e107c7a40d89caffd66bf5e3324 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1929233291 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: ad43f5f193e24ff1982a1b4afe482738 Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestEncryptedCinderVolumes-1929233291-project Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '2a84b2ec-23a4-4956-9f22-14d2e98b9e7b'} Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.163774 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Returning 404 to user: Instance 2a84b2ec-23a4-4956-9f22-14d2e98b9e7b could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8c4b0a48-aab3-4550-b1ba-e3af2c6e007c tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b" status: 404 len: 111 microversion: 2.1 time: 0.032278 Oct 04 18:56:51.169027 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3670/7444] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:56:51 2022] GET /compute/v2.1/servers/2a84b2ec-23a4-4956-9f22-14d2e98b9e7b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 18:56:51.174546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2642788c-f005-44b4-872d-375ec2c533e9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] Calling method '.version_select at 0x7fbdbc768e50>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:56:51.194791 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2642788c-f005-44b4-872d-375ec2c533e9 tempest-TestEncryptedCinderVolumes-1929233291 tempest-TestEncryptedCinderVolumes-1929233291-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-433050051" status: 202 len: 0 microversion: 2.1 time: 0.024065 Oct 04 18:56:51.195370 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3775/7445] 10.222.0.42 () {58 vars in 1275 bytes} [Tue Oct 4 18:56:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-433050051 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:57:19.027429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bd6559b9-f06f-431f-b794-f42c16974cc4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: .version_select at 0x7fbdbda430d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1720911717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDE3NEfxujvhAQtu+hkzTcRoKVwxis4E9nwWiyezEI9EF0uMOQWVVKmlXtL9dX7Tv4cq22CpQxfNuIBJwi2rhlsZildaXj0b9zpZnFpVvPcqYk/SCeQoM4tY4KWX7XT6Vg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:19.034217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=14 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:19.034877 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=34 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:19.050767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bd6559b9-f06f-431f-b794-f42c16974cc4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:19.062402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-bd6559b9-f06f-431f-b794-f42c16974cc4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for user 97880f8da59b4b75997061c1885561fc and project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:19.094951 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bd6559b9-f06f-431f-b794-f42c16974cc4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072087 Oct 04 18:57:19.095568 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3671/7446] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 18:57:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:19.146255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:19.147015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:19.151146 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1074209824", "imageRef": "0fc180f3-d418-49c0-8954-094fd70406ad", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1720911717", "networks": [{"uuid": "560cd4ef-0466-403b-9211-489ad2186bee"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:19.208240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] validate_networks() for [('560cd4ef-0466-403b-9211-489ad2186bee', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 18:57:19.596599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 18:57:19.597038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 18:57:19.597527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 18:57:19.597983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 18:57:19.598410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 18:57:19.607483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:19.607972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:19.608419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:19.609153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:19.609621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:19.610089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:19.627990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 18:57:19.633142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for user 97880f8da59b4b75997061c1885561fc and project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 18:57:19.646244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 18:57:19.648469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0fc180f3-d418-49c0-8954-094fd70406ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 18:57:19.694891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-55ce70ad-c19a-411c-ba6f-abe72ffe95d3 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550973 Oct 04 18:57:19.695541 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3776/7447] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 18:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 18:57:19.707169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1968326c-ef6e-4818-a21c-8803e24b0cdf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:19.707792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1968326c-ef6e-4818-a21c-8803e24b0cdf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:19.764390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1968326c-ef6e-4818-a21c-8803e24b0cdf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:19.772733 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1968326c-ef6e-4818-a21c-8803e24b0cdf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1259 microversion: 2.1 time: 0.069489 Oct 04 18:57:19.773266 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3672/7448] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:19 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:20.798437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:20.799288 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:20.806814 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.807611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.808245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:20.810545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:20.811040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:20.811570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:20.883743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:20.894137 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5fb7b1c7-fd35-4f5e-990a-bdaae041f995 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1319 microversion: 2.1 time: 0.101737 Oct 04 18:57:20.895026 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3777/7449] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:20 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1319 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:21.920819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:21.922214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:21.933143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:21.933970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:21.934453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:21.935831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:21.936656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:21.937176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:22.140182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:22.148960 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77be6dbc-b369-4421-8deb-901f853ff7f2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.233692 Oct 04 18:57:22.149608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3673/7450] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:21 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:23.172296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:23.172928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:23.179854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.180351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.180801 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.181503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:23.181993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:23.182434 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:23.320041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:23.327978 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2031ee1-9dcc-41a0-a381-36d5cb6e7767 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.159569 Oct 04 18:57:23.328706 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3778/7451] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:23 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:24.350957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:24.351527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:24.359238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.359792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.360265 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.361013 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:24.361506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:24.362010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:24.514019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:24.522255 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2fb97ec3-edfb-4a80-8580-86fc378c29b5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.175410 Oct 04 18:57:24.523115 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3674/7452] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:24 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:25.545380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:25.546131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:25.553113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.553613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.554094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.554809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:25.555279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:25.555724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:25.694391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:25.703150 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9d8e3bae-38c5-4b5f-8781-3064abe2ab22 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.161777 Oct 04 18:57:25.703782 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3779/7453] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:25 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:26.728537 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:26.729157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:26.736854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.737347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.737793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:26.738535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:26.738999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:26.739438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:26.922492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:26.931010 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e89b16d-ba5d-47a7-a92e-e455bdf49503 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.206526 Oct 04 18:57:26.931885 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3675/7454] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:26 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:27.956726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:27.957460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:27.964419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:27.965906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:27.966375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:27.967090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:27.967564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:27.968014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:28.109106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:28.120102 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-74db8dee-4337-4fb8-a5ec-9a002f51cb35 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.167057 Oct 04 18:57:28.122351 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3780/7455] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:27 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:29.150415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:29.151036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:29.159360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.159840 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.160288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.160990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:29.161450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:29.161915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:29.304937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:29.312695 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-603ea737-70ad-4348-aad7-77760f5a56f8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.166271 Oct 04 18:57:29.313273 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3676/7456] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:29 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:30.336981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:30.337899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:30.341583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:30.342400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:30.349675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.350236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.350701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.351439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:30.351912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:30.352361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:30.489611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:30.497998 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-63be5f14-29fd-4cb1-88f6-e9a6893a0e39 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.165042 Oct 04 18:57:30.498578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3781/7457] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:30 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:31.524422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:31.525226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:31.532858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:31.536048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.536671 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.537172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.537963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:31.538484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:31.538995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:31.692318 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:31.700371 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-231faebd-5231-4aeb-9784-9418a43deda6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.182227 Oct 04 18:57:31.700948 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3677/7458] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:31 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:32.731667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:32.732847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:32.739967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:32.740476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:32.740946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:32.741679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:32.742211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:32.743085 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:32.879076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:32.886817 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2dd94379-f30a-4d49-8866-ea05608e2f7a tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.167070 Oct 04 18:57:32.887404 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3782/7459] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:32 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:33.911428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:33.912040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:33.919070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.919634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.920072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:33.920783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:33.921234 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:33.921657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.126528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:34.134206 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b1fe2c1f-d0ff-4738-8ef5-9f4ac6f070c2 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.226722 Oct 04 18:57:34.134781 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3678/7460] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:33 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:34.221259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:34.233863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:34.234465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:34.234991 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:34.256322 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] Creating event network-changed:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 18:57:34.261489 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f2a70bb9-59f6-4404-a8f8-ec2736690787 req-1c362f50-a321-424c-ae3d-2852d1755e67 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044012 Oct 04 18:57:34.262135 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3783/7461] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 18:57:35.158970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:35.159585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:35.166396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.166879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.167316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.168003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:35.168454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:35.169501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:35.334539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:35.346018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2bd1439b-c45b-4316-ba5e-aa3c6adedf6f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.190851 Oct 04 18:57:35.346621 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3679/7462] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:35 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 18:57:36.371238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:36.372560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:36.378927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.379431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.379884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.380593 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:36.381061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:36.381503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:36.523893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:36.532980 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-61bb2e17-3dec-467f-b622-93d4c45c7fcc tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.166589 Oct 04 18:57:36.534239 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3784/7463] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:36 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:37.558827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:37.559647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:37.566517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.566995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.567462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.568146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:37.568597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:37.569019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:37.705187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:37.713130 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-10da93b5-6e6c-4754-878f-b4c3f3bc3877 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.158124 Oct 04 18:57:37.713718 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3680/7464] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:37 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:38.345780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "name": "network-vif-plugged", "status": "completed", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:38.358580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.359268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.359735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.371341 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] Creating event network-vif-plugged:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 18:57:38.377170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0b48865f-1053-47c1-824b-871d39112b60 req-b4628de3-222c-4372-b02a-07af19316c6f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036552 Oct 04 18:57:38.378063 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3785/7465] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:38.736477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:38.737103 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:38.744034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.744531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.744977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.745683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:38.746179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:38.747221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:38.877247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:38.885293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17dcd2e5-9931-4709-884a-36ae12ebcc02 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1359 microversion: 2.1 time: 0.152707 Oct 04 18:57:38.885887 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3681/7466] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:38 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:39.909337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:39.910122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:39.917649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.918177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.919167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:39.920017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:39.920515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:39.920959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.060786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.068952 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5cab662d-5950-45c3-874e-5e6a3935e4ad tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1549 microversion: 2.1 time: 0.163961 Oct 04 18:57:40.069536 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3786/7467] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:39 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:40.094041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.094777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:40.102472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.103026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.103527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.104299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.104763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.105259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.242352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.251620 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eafacb3c-3c0e-4729-b551-e2036b62c6df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1549 microversion: 2.1 time: 0.163436 Oct 04 18:57:40.252296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3682/7468] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:40.276034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.281340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.282157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Searching by: {'deleted': False, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 18:57:40.287531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.288031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.288517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.289255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.289726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.290198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.315496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 18:57:40.344169 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a269e106-b765-438a-bffc-cb5d1909ba40 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.071952 Oct 04 18:57:40.344748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3787/7469] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:40.357731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:40.358517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:40.364595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.365085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.365535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.366345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:40.366792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:40.367262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:40.501781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:40.509553 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9fc6d52-8c75-44f7-a933-698ed6af61e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1549 microversion: 2.1 time: 0.156839 Oct 04 18:57:40.510166 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3683/7470] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:40 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:42.080371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d63ad692-a18d-4284-8de8-09d49e315cee"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:42.082815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:42.089813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.090352 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.090815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.091534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:42.092011 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:42.092457 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:42.339759 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c70e61ec-fbc1-48bf-a351-cada0e09e23c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263505 Oct 04 18:57:42.341190 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3788/7471] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 18:57:42 2022] POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:55.584385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:55.585009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:55.587913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:55.588583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=66 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:55.596349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.596859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.597294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:55.598030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:55.598500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:55.598932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:56.278321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:56.287818 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a04ac4cf-9042-4571-bd35-974e1db5f08c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1595 microversion: 2.1 time: 0.707357 Oct 04 18:57:56.288405 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3684/7472] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:55 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1595 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:57:58.013181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:58.023880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:58.025074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:58.026427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:57:58.037586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:58.038155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:58.038677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:58.060412 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] Creating event network-changed:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 18:57:58.069677 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8d81b3e3-4d29-48f6-8c90-4a3073a7425f req-42a51858-e10e-41d6-9245-5aa4bdc6f9cc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063257 Oct 04 18:57:58.071362 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3789/7473] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:57:59.042141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1559160056"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:57:59.042741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:59.049644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.050174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.050625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.051334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.051790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.052221 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.194357 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.network.security_group_api [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Adding security group 3c1e4bdf-7dcf-4fc0-8f67-f9cc93bcf75d to port b182f8a6-ddd1-41d3-b7b1-123e5d54653d Oct 04 18:57:59.533972 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-01987f4a-1428-45c9-9ab9-6cb05a5364e4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action" status: 202 len: 0 microversion: 2.1 time: 0.495878 Oct 04 18:57:59.534955 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3685/7474] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:57:59 2022] POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 18:57:59.544232 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:57:59.545001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:57:59.552606 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.553122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.553586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.554487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:57:59.554963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:57:59.555609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:57:59.768708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:57:59.777932 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-91a83c3f-92c6-4b3d-868c-e5082d6a258f tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1760 microversion: 2.1 time: 0.238098 Oct 04 18:57:59.778599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3790/7475] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:57:59 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1760 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:58:00.086548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:58:00.097034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:58:00.097522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:58:00.097985 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:58:00.110699 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] Creating event network-changed:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 18:58:00.115901 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e57496cd-033c-48eb-b91c-01e00ffdfbc1 req-60d4e747-74d4-45b6-a429-f25765b771a0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033981 Oct 04 18:58:00.116514 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3686/7476] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 18:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 18:59:41.854158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:41.855119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:41.857330 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:59:41.857476 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 18:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action (ip 10.222.0.42) !!! Oct 04 18:59:41.861871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 18:59:41.864107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:41.873391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.873925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.874388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.875103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.875578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.876027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.951518 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a195da2c-590b-4f14-986a-ca4d4739d693 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action" status: 202 len: 0 microversion: 2.1 time: 0.099254 Oct 04 18:59:41.952350 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3791/7477] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 18:59:41 2022] POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 18:59:41.958622 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 18:59:41.959948 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 18:59:41.960270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:41.960976 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 18:59:41.961917 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 18:59:41.962096 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 (ip 10.222.0.42) !!! Oct 04 18:59:41.963789 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 18:59:41.964090 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 18:59:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 (ip 10.222.0.42) !!! Oct 04 18:59:41.970989 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:41.971707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:41.980187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.980954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.981399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:41.982130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:41.982592 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:41.983029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:42.238928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:42.248140 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a45ccb85-caee-49b0-ab48-de18b0df64be tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1762 microversion: 2.1 time: 0.291558 Oct 04 18:59:42.248737 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3687/7478] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:41 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1762 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 18:59:43.274625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 18:59:43.275340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 18:59:43.281569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.282111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.282567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.283283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 18:59:43.283752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 18:59:43.284193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 18:59:43.434551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 18:59:43.442865 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-69f549d0-f4df-4a5c-a903-6c00ff069d93 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1760 microversion: 2.1 time: 0.174012 Oct 04 18:59:43.443437 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3792/7479] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 18:59:43 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:00:58.476536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.477396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.482283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1559160056"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:58.482943 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:00:58.494977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.495505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.495955 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.496667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:58.497130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:58.497566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:58.498229 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40310. Oct 04 19:00:58.498961 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40308. Oct 04 19:00:58.640711 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.network.security_group_api [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Removing security group 3c1e4bdf-7dcf-4fc0-8f67-f9cc93bcf75d from port b182f8a6-ddd1-41d3-b7b1-123e5d54653d Oct 04 19:00:58.955463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4072f91b-89c4-4138-8d06-13bb3feef22c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action" status: 202 len: 0 microversion: 2.1 time: 0.481641 Oct 04 19:00:58.959201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.960142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:00:58.971406 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3688/7480] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:00:58 2022] POST /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:00:59.071979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:00:59.083983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:00:59.084903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:00:59.086045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:00:59.099160 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] Creating event network-changed:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 19:00:59.108334 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a8174e13-7292-4e41-bc50-320579ab01aa req-194d4b26-613b-4471-8f8a-04d5ceca5a10 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149368 Oct 04 19:00:59.111569 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3793/7481] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:00.164218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.165996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.172758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.173349 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.173883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.174677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.175220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.176012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.195909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:00.206086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.206897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.207439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.220334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] Creating event network-changed:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 19:01:00.223994 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] [d7731a71-2d18-4df8-9191-b52871c24888] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:01:00.265998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lazy-loading 'services' on Instance uuid 461fd88b-ec05-4553-8cb4-e728a5033e54 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:01:00.346404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-239dd459-e1fc-47e8-ab88-6aadf1c83b8d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments/d63ad692-a18d-4284-8de8-09d49e315cee" status: 202 len: 0 microversion: 2.1 time: 0.188033 Oct 04 19:01:00.347812 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3794/7482] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 19:01:00 2022] DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments/d63ad692-a18d-4284-8de8-09d49e315cee => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:01:00.359280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:00.360750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:00.369210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.369729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.370203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.370926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:00.371478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:00.371949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:00.407342 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4af66dc9-71b2-4df1-8a73-b62adb7c6193 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053840 Oct 04 19:01:00.408383 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3795/7483] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:00 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:01:01.232559 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] [d7731a71-2d18-4df8-9191-b52871c24888] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40344. Oct 04 19:01:01.236909 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a4497457-23d8-43fa-98a4-e2faee13bcf6 req-d3706c0f-5b6d-4686-a7c2-4d26f53be7af service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.131024 Oct 04 19:01:01.237560 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3689/7484] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:01.422220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:01.424586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:01.431502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.432005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.432459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.433217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:01.433713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:01.434149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:01.471968 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5bed54c1-cf57-476c-b463-2f84e97f0c6b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055068 Oct 04 19:01:01.472561 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3796/7485] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:01 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:02.486908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:02.489230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:02.496743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.497238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.497677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.498423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:02.498876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:02.499303 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:02.532569 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c514a18a-5526-40d7-9427-0adc34cac7fd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050942 Oct 04 19:01:02.533426 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3690/7486] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:02 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:03.545154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:03.547391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:03.555151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.555657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.556105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.556819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:03.557283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:03.557730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:03.591311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ab604d4-230f-4e90-8c66-1446c5f2f148 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050253 Oct 04 19:01:03.591932 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3797/7487] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:03 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:04.606659 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:04.609062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:04.617246 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.617946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.618389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.620752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:04.621407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:04.622046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:04.656973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b229dc10-4071-423a-92ea-cf59a6284b54 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056024 Oct 04 19:01:04.657549 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3691/7488] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:04 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:05.670739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:05.672989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:05.680620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.681131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.681584 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.682327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.682795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.683234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.714684 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5a52beba-fb9b-465c-9d3b-45cfa905ac73 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047898 Oct 04 19:01:05.715255 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3798/7489] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:01:05 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:01:05.726165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:05.726712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:05.733518 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.734048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.734500 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.735197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:05.735658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:05.736096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:05.816216 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] HTTP exception thrown: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 is not attached to volume d63ad692-a18d-4284-8de8-09d49e315cee Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Request method failure captured: Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: request: DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments/d63ad692-a18d-4284-8de8-09d49e315cee HTTP/1.1 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIH_k7GnqNUIXfkYwxxIFFZGY2zcSH4KP5SgeM8N_XJrIx48tlNOHbPeOYQbGoJL_GfJVAaDf-HtKpxsePtXz8mCVpslweUonjaJfhiY_Rn92QA1r1eq1CAT0J2TMrLpS3fi6IkBMjGMjlhpxTW66OCSsq1q7pcHaihTMBuTXWubvqw Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 97880f8da59b4b75997061c1885561fc Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 is not attached to volume d63ad692-a18d-4284-8de8-09d49e315cee Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'server_id': '461fd88b-ec05-4553-8cb4-e728a5033e54', 'id': 'd63ad692-a18d-4284-8de8-09d49e315cee'} Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d63ad692-a18d-4284-8de8-09d49e315cee. Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 is not attached to volume d63ad692-a18d-4284-8de8-09d49e315cee Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:05.817809 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 is not attached to volume d63ad692-a18d-4284-8de8-09d49e315cee Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Returning 404 to user: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 is not attached to volume d63ad692-a18d-4284-8de8-09d49e315cee {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3911532c-892c-460a-aebd-8046b6a39575 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments/d63ad692-a18d-4284-8de8-09d49e315cee" status: 404 len: 154 microversion: 2.1 time: 0.097315 Oct 04 19:01:05.824092 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3692/7490] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 19:01:05 2022] DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54/os-volume_attachments/d63ad692-a18d-4284-8de8-09d49e315cee => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:09.088095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.088784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.096139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.096678 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.097131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.098036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.098510 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.099145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.128121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:01:09.222468 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6822e81c-a4fd-40f0-b8c9-2d807206d71d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 204 len: 0 microversion: 2.1 time: 0.137937 Oct 04 19:01:09.223283 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3799/7491] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:01:09 2022] DELETE /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:01:09.232632 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:09.233241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:09.242521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.242766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.243029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.243756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:09.244288 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:09.244711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:09.403584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:09.412962 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0fb742b2-4c70-4b1c-a1fb-2ae3a19f6178 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1555 microversion: 2.1 time: 0.184330 Oct 04 19:01:09.414260 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3693/7492] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:09 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:10.440376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:10.440975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:10.449238 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.449766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.450242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.450964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:10.451437 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:10.451878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:10.592453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:10.601244 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2e97973b-969a-4d5f-a830-a9c98edf0ffa tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1555 microversion: 2.1 time: 0.165105 Oct 04 19:01:10.601852 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3800/7493] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:10 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:11.598494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "461fd88b-ec05-4553-8cb4-e728a5033e54", "name": "network-vif-deleted", "tag": "b182f8a6-ddd1-41d3-b7b1-123e5d54653d"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:11.609484 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.610251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.610485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.623212 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] Creating event network-vif-deleted:b182f8a6-ddd1-41d3-b7b1-123e5d54653d for instance 461fd88b-ec05-4553-8cb4-e728a5033e54 on n-h1-831194-21 Oct 04 19:01:11.625167 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:11.625862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:11.628587 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-58b899ab-730f-4e6f-a2ed-c957780f5ebe req-af9a5161-0343-4e87-b5d1-a1149c0c6d5b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Oct 04 19:01:11.629198 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3694/7494] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:11.634622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.635141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.635681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.636705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:11.637218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:11.637665 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:11.704888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:11.713795 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-598ec231-5f7b-49d7-a2c6-0c545b792cb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 200 len: 1344 microversion: 2.1 time: 0.092695 Oct 04 19:01:11.714418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3801/7495] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:11 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 1344 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:01:12.739967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:12.740704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: 461fd88b-ec05-4553-8cb4-e728a5033e54] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:12.747990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.748474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.748911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.749607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:12.750091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:12.750520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:12.765245 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] HTTP exception thrown: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Request method failure captured: Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 HTTP/1.1 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIH_k7GnqNUIXfkYwxxIFFZGY2zcSH4KP5SgeM8N_XJrIx48tlNOHbPeOYQbGoJL_GfJVAaDf-HtKpxsePtXz8mCVpslweUonjaJfhiY_Rn92QA1r1eq1CAT0J2TMrLpS3fi6IkBMjGMjlhpxTW66OCSsq1q7pcHaihTMBuTXWubvqw Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 97880f8da59b4b75997061c1885561fc Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '461fd88b-ec05-4553-8cb4-e728a5033e54'} Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:01:12.766986 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Returning 404 to user: Instance 461fd88b-ec05-4553-8cb4-e728a5033e54 could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84edd7d5-9592-4bf4-bc02-b33357185ad6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54" status: 404 len: 111 microversion: 2.1 time: 0.033665 Oct 04 19:01:12.773320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3695/7496] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:12 2022] GET /compute/v2.1/servers/461fd88b-ec05-4553-8cb4-e728a5033e54 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:01:12.777950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e99ee5ab-28ca-453c-849f-bdf6993359ea tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '.version_select at 0x7fbdbd172b80>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:12.803300 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e99ee5ab-28ca-453c-849f-bdf6993359ea tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1720911717" status: 202 len: 0 microversion: 2.1 time: 0.029573 Oct 04 19:01:12.804700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3802/7497] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 19:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1720911717 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:01:22.389724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d8cb9576-f8a9-49ed-bd78-644e1b235bce tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: .version_select at 0x7fbdbc85a9d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1441593712", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLD3mILRYLJhe9SyWa8xN+E4g29chnVrArDPT8uhD6HpBm+fKtsqYm0ibIY9J+TJuRBatbJKIV+Y4XqBbKSIBxWLLRegsnb/kZl9PyqXohDJp6oajfdVPZqPbnkhS5zRVA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:22.411155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d8cb9576-f8a9-49ed-bd78-644e1b235bce tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:22.416975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-d8cb9576-f8a9-49ed-bd78-644e1b235bce tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for user 97880f8da59b4b75997061c1885561fc and project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:22.444456 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d8cb9576-f8a9-49ed-bd78-644e1b235bce tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058001 Oct 04 19:01:22.445093 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3696/7498] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:01:22 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:22.497547 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-579664544", "imageRef": "3a0da4a8-5f2f-4a48-8778-1ca84fc2ec54", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1441593712", "networks": [{"uuid": "560cd4ef-0466-403b-9211-489ad2186bee"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:22.508693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:22.509661 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:01:22.509893 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:01:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Oct 04 19:01:22.557597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] validate_networks() for [('560cd4ef-0466-403b-9211-489ad2186bee', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:01:23.317882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:01:23.318326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:01:23.318898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:01:23.319319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:01:23.319778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:01:23.328709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.329197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.329643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.330419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:23.330884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:23.331323 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:23.348996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:01:23.355031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Getting quotas for user 97880f8da59b4b75997061c1885561fc and project 10b97db0448a4fea9fc02fa63ec8e634. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:01:23.367898 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:01:23.370158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a0da4a8-5f2f-4a48-8778-1ca84fc2ec54',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:01:23.417404 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f92dfcf-59a8-420c-b4f7-e1f177438cf0 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.923824 Oct 04 19:01:23.418091 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3803/7499] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:01:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:01:23.425947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=34 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:23.431884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03fabc62-0bcc-492c-adca-fe9c33e824a9 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:23.432510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03fabc62-0bcc-492c-adca-fe9c33e824a9 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:23.494268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03fabc62-0bcc-492c-adca-fe9c33e824a9 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:23.501505 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03fabc62-0bcc-492c-adca-fe9c33e824a9 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1258 microversion: 2.1 time: 0.076382 Oct 04 19:01:23.502275 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3697/7500] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:23 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:24.529736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:24.530497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:24.538581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.539111 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.539574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.540464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:24.541308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:24.542888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:24.615952 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:24.624628 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfc3695a-8393-4de7-8219-58d327f2ad66 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1318 microversion: 2.1 time: 0.099232 Oct 04 19:01:24.625211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3804/7501] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:24 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1318 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:25.650866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:25.659325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:25.671075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.671669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.672172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.673108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:25.673760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:25.674423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:25.822728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:25.832076 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-27136a59-6a47-447b-84b6-203c2caf35f4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.186642 Oct 04 19:01:25.832668 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3698/7502] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:25 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:26.856569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:26.857890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:26.865098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.865820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.866695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:26.867492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:26.868038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:26.868557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:27.016488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:27.024942 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a3d3c3be-06bf-4d1a-8630-65680e3c2547 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.172310 Oct 04 19:01:27.025506 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3805/7503] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:26 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:28.049400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:28.050780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:28.059763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.060590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.061436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.062259 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:28.062721 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:28.063156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:28.228675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:28.236421 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-14658f65-23e4-4a76-9d4d-6e26660f6381 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.191509 Oct 04 19:01:28.237000 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3699/7504] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:28 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:29.259480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:29.260302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:29.263062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:29.268198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.268959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.269419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.270163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:29.270635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:29.271329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:29.419917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:29.430217 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2f355453-794e-4016-a899-e1df5880a6f6 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.174466 Oct 04 19:01:29.444552 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3806/7505] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:29 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:30.461262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:30.463188 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:30.468058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:30.474317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.475521 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.476144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.476857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:30.477323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:30.477789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:30.617129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:30.626389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7b39588e-b7cb-41ad-8c32-2a057e2740d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.172651 Oct 04 19:01:30.627429 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3700/7506] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:30 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:31.653856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:31.656557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:31.674790 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.675514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.676002 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.676702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:31.677166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:31.677763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:31.827951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:31.836311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9463fbe4-a933-4974-80a5-91da9cd868b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.190448 Oct 04 19:01:31.836872 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3807/7507] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:31 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:32.859769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:32.860416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:32.867951 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.868449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.868897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:32.869602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:32.870093 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:32.870530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:33.008796 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:33.016580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-08877ab7-2a55-42cb-a580-249d82a54698 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.160788 Oct 04 19:01:33.017153 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3701/7508] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:32 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:34.042767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:34.044106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:34.047347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:34.049779 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:34.057645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:34.058493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:34.065681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.072733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.073234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.073689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.078111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.078528 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.079280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:34.079756 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:34.080226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:34.100645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] Creating event network-changed:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:01:34.108497 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c46f6fc0-43bb-47cf-828d-1ca062d57ca5 req-c68e7aef-a587-444c-89a8-5fdc1b2e9b73 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081136 Oct 04 19:01:34.109946 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3808/7509] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:34.305398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:34.317132 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1576d52f-8fc9-4b81-afe3-d21c42533145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.280123 Oct 04 19:01:34.317744 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3702/7510] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:34 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:35.342237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:35.342867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:35.351248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.351916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.352379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.353105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:35.353601 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:35.354293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:35.494780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:35.502733 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a61df37-bdf1-4004-94b2-257f381ecd87 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.165862 Oct 04 19:01:35.503298 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3809/7511] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:35 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:36.525880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:36.526434 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:36.533282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.533984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.534441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.535143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:36.535604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:36.536041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:36.666426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:36.674283 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c4abf97-8554-4624-9e7f-7e072e609510 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.152481 Oct 04 19:01:36.674861 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3703/7512] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:36 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:37.698529 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:37.699166 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:37.706106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.706617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.707074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.707822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:37.708301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:37.708753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:37.847107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:37.856002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c38a9dc5-2a43-4507-9c44-56129f51ee76 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.161527 Oct 04 19:01:37.856696 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3810/7513] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:37 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:38.878108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:38.878727 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:38.886474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.886966 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.887409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:38.888111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:38.888568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:38.888999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.028990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:39.036934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9825123b-f3a7-42a7-97e8-df7a883b69d8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.162761 Oct 04 19:01:39.037523 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3704/7514] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:38 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:39.602263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "name": "network-vif-plugged", "status": "completed", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:39.613480 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:39.614023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:39.614479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:39.626670 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] Creating event network-vif-plugged:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:01:39.631657 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8c9538bf-fa2e-44f3-acb5-a082570e37f2 req-821c6692-ed0c-4dad-b0b4-1ba155f6f3cd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089572 Oct 04 19:01:39.632687 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3811/7515] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:40.061407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:40.062054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:40.068806 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.069294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.069736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.071187 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:40.071654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:40.072086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:40.207492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:40.215628 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d87af9bf-75e8-45b4-8c48-5360149baf05 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1358 microversion: 2.1 time: 0.158064 Oct 04 19:01:40.216216 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3705/7516] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:40 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:41.239328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.239962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.247269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.247762 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.248213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.248920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.249383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.249821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.385131 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.393228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-83c5d3bb-e1d8-43e5-bf8e-bfe182431396 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1549 microversion: 2.1 time: 0.158281 Oct 04 19:01:41.394097 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3812/7517] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:41.417787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.418802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.425463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.425990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.426437 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.427163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.427622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.428055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.562302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.570943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f695ea8a-cf6b-465d-9dad-646c90152f63 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1549 microversion: 2.1 time: 0.156867 Oct 04 19:01:41.571660 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3706/7518] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:41.593223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.598948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.599742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Searching by: {'deleted': False, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634'} {{(pid=128849) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 04 19:01:41.606125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.606797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.607259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.608301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.608781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.609444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.635465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.multi_cell_list [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128849) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 04 19:01:41.662658 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-736de167-836f-4c44-a0c4-615816dfd31d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.073390 Oct 04 19:01:41.663238 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3813/7519] 10.222.0.42 () {58 vars in 1125 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:41.675609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:41.676229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:41.682748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.683228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.683667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.684355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:41.684807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:41.685230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:41.831029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:41.839404 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ad91b18f-775e-4703-8411-85674f61dd29 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1549 microversion: 2.1 time: 0.167789 Oct 04 19:01:41.839993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3707/7520] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:41 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:43.382070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61b14c12-9030-4d9b-9e0a-fa6c3f93aafa"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:43.384530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:43.391439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.391939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.392395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.393105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:43.393859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:43.394294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:43.647652 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3164d4cd-7539-4354-8eef-8b3433cb0a68 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269199 Oct 04 19:01:43.654486 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3814/7521] 10.222.0.42 () {60 vars in 1323 bytes} [Tue Oct 4 19:01:43 2022] POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:54.467694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:54.468319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:54.471258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=15 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:54.471942 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=60 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:54.477792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.478308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.478751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.479582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:54.479916 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:54.480344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:54.626151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:54.635142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b82f4992-fb2e-475f-8d6d-a26426a7dabb tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1595 microversion: 2.1 time: 0.171414 Oct 04 19:01:54.635716 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3708/7522] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:54 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1595 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:01:56.315366 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:56.331420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:56.332172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=17 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:56.336077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:01:56.348923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:56.350001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:56.351138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:56.367689 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] Creating event network-changed:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:01:56.374922 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f62a5a00-e3b2-4a40-8e12-56d095e4d362 req-55684252-3b1e-4d2b-b27a-243b10f396ab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068229 Oct 04 19:01:56.376018 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3815/7523] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:57.666014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1459169832"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:57.666551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:57.673399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:57.673920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:57.674360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:57.675052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:57.675502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:57.675926 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:57.813484 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.network.security_group_api [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Adding security group 67466038-1dab-40ce-8098-b6af0318804d to port 91077780-7ab3-4281-a8c9-ca07ecf87c36 Oct 04 19:01:58.129883 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7c123fbf-3875-440d-b0da-1405583644bf tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action" status: 202 len: 0 microversion: 2.1 time: 0.468511 Oct 04 19:01:58.130522 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3709/7524] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:01:57 2022] POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:01:58.141754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:01:58.146781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:01:58.148097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:01:58.152680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:58.153167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:58.153605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.161680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:58.162263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:58.162721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.164284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:01:58.164770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:01:58.165259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:01:58.167507 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] Creating event network-changed:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:01:58.173056 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-127846a9-26fc-4955-804b-205a4b57b171 req-cabaa532-fcc3-4685-b1ea-1e2e7ef311fa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035793 Oct 04 19:01:58.174230 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3710/7525] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:01:58.360260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:01:58.370468 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bbc1cbaf-21ad-48db-bd26-01ff768c607d tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1760 microversion: 2.1 time: 0.235102 Oct 04 19:01:58.371229 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3816/7526] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:01:58 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1760 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:21.091527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:21.092446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:21.145566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:02:21.148732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:21.154932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.155419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.155858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.156553 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.157008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.157433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.239701 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-36021506-cef5-46c8-aa49-ced884208bde tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action" status: 202 len: 0 microversion: 2.1 time: 0.150154 Oct 04 19:02:21.240375 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3711/7527] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:02:21 2022] POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:02:21.250398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:21.251115 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:21.255305 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:02:21.256196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:21.257680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:02:21.263750 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.264271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.264735 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.265471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:21.265976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:21.266449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:21.438575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:21.449007 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ddcb3036-d36d-46df-860a-99e73ba14359 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1752 microversion: 2.1 time: 0.203164 Oct 04 19:02:21.459020 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3817/7528] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:21 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1752 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:22.474453 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:22.475212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:22.482331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.482823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.483269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.483988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:22.484444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:22.484912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:22.646294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:22.656000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-65d3ce7c-6c57-44b2-80ac-6c90a4b584b4 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.186997 Oct 04 19:02:22.656592 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3712/7529] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:22 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:02:23.681419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:23.682213 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:23.690341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.690853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.691315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.692042 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:23.692515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:23.692963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:23.711343 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40662. Oct 04 19:02:23.839917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:23.848205 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-80facc0f-51c7-4164-b036-3d6291741fcd tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.171565 Oct 04 19:02:23.848773 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3818/7530] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:23 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:24.872343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:24.872961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:24.880033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.880520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.880958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:24.881738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:24.882355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:24.882637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:25.035655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:25.044934 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a6602888-8310-4fac-8bba-8c8bdebbd8c1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.176487 Oct 04 19:02:25.045518 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3713/7531] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:24 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:26.067300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:26.067992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:26.075854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:26.076377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:26.076806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:26.077524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:26.078016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:26.078455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:26.235458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:26.244669 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f75b8d84-f76a-430c-b23e-7e6d475fd480 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.181336 Oct 04 19:02:26.245253 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3819/7532] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:26 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:27.272159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:27.272846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:27.279899 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.280399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.280845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.281546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:27.282037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:27.282469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:27.427473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:27.437014 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2c99782a-dfdb-41ec-9d21-f72ef3a8e717 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.169074 Oct 04 19:02:27.437608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3714/7533] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:27 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:28.463252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:28.463894 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:28.471000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.471506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.471964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.472689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:28.473165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:28.473614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:28.640912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:28.649739 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bf9a6268-3a32-4b6a-ad32-7c27b8749b47 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.191619 Oct 04 19:02:28.650338 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3820/7534] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:28 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:29.673141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:29.673763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:29.680733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:29.681264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:29.681701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:29.682436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:29.682892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:29.683320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:29.832341 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:29.840889 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-574beddc-0466-4c8c-b725-67efeb87b305 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.171675 Oct 04 19:02:29.841462 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3715/7535] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:29 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:30.864824 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:30.865459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:30.873494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.874039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.874498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:30.875219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:30.875694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:30.876141 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:31.027499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:31.035938 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-10e996fe-990c-4549-b3cf-fbf9152f9f71 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.175122 Oct 04 19:02:31.036513 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3821/7536] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:30 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:32.059240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:32.059846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:32.067475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.067967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.068408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:32.069104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:32.069562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:32.070020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:32.217533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:32.226102 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c8bf433d-04ad-42a9-b072-8a4107dce656 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.170705 Oct 04 19:02:32.226879 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3716/7537] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:32 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:33.249348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:33.249994 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:33.256812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.257315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.257772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.258950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:33.259432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:33.259881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:33.409044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:33.418311 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f16f5ae9-f2ba-4b57-9fc5-baa71857d3df tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.172988 Oct 04 19:02:33.418889 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3822/7538] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:33 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:34.442878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:34.443433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:34.450865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.451357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.451807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.452525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:34.453012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:34.453426 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:34.600334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:34.609396 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-cd709ece-8e80-4edc-8fa7-c5928eb287b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.170566 Oct 04 19:02:34.610007 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3717/7539] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:34 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:35.633497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:35.634386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:35.641088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.641594 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.642072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.642791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:35.643258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:35.643956 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:35.790484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:35.798811 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-171ad7ef-6174-48a7-ab2c-d022670c25b7 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.169306 Oct 04 19:02:35.799385 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3823/7540] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:35 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:36.822807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:36.823472 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:36.830382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.830874 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.831321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.832028 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:36.832494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:36.832931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:36.994407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:37.002903 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-eae39597-a526-460e-b6e3-232eae1c80ef tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.184196 Oct 04 19:02:37.003497 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3718/7541] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:36 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:38.027713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:38.028393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:38.035194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.035698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.036153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.036866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:38.037365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:38.037812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:38.194493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:38.203722 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6203ca32-1988-4d84-a343-2f4efebf5b9e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1757 microversion: 2.1 time: 0.180075 Oct 04 19:02:38.204319 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3824/7542] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:38 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:02:39.226810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:02:39.227643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:02:39.234744 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.235238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.235884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.236598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:02:39.237066 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:02:39.237501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:02:39.382526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:02:39.391835 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-39865616-c645-47cc-ac15-36eb4670b4ae tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1760 microversion: 2.1 time: 0.169063 Oct 04 19:02:39.392421 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3719/7543] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:02:39 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:13.066433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1459169832"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:13.067079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:13.069130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:13.070041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=48 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:13.078029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.078545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.079009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.079740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.080218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.080670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.262719 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.network.security_group_api [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Removing security group 67466038-1dab-40ce-8098-b6af0318804d from port 91077780-7ab3-4281-a8c9-ca07ecf87c36 Oct 04 19:03:13.573929 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e8576a07-8b20-40dc-a2ee-8dd51cdb945e tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action" status: 202 len: 0 microversion: 2.1 time: 0.511769 Oct 04 19:03:13.575159 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3825/7544] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:03:13 2022] POST /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:13.585572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:13.594089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=18 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:13.606818 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:13.608365 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:03:13.608563 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:03:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 04 19:03:13.621719 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:13.622516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:13.623326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:13.642463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] Creating event network-changed:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:03:13.648317 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-14976997-bb81-45b1-9f18-df38e40b2b44 req-8d647f03-f82e-4906-be38-c27bc6053574 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069859 Oct 04 19:03:13.650580 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3720/7545] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:14.771327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:14.771851 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:14.782459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.782977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.783438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.784171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:14.784640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:14.785077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:14.875948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lazy-loading 'services' on Instance uuid e2102026-c0a7-4c5d-b1ff-aadec6b48176 {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:03:14.972327 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f314f30b-c6f6-456e-80bf-5bb5398fb6a5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments/61b14c12-9030-4d9b-9e0a-fa6c3f93aafa" status: 202 len: 0 microversion: 2.1 time: 0.206006 Oct 04 19:03:14.976746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3826/7546] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 19:03:14 2022] DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments/61b14c12-9030-4d9b-9e0a-fa6c3f93aafa => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:14.987278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:14.991035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:15.004509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.005311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.005965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.006850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.007470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.008860 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.045896 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-17148048-d934-4369-88d7-b6898a941eb5 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065770 Oct 04 19:03:15.046808 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3721/7547] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:14 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:15.673508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:15.685312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:15.685820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:15.686319 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:15.699611 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] Creating event network-changed:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:03:15.704496 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-8a1a5529-c7ee-4287-80cb-12fc03dacac4 req-57843e92-ec46-401e-b950-8c5d6f371f91 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035167 Oct 04 19:03:15.705090 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3827/7548] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:16.065067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:16.068063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:16.080485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:16.111794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3453c9a-d7d8-4971-b52e-61f3212cfc4b tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050967 Oct 04 19:03:16.112658 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3722/7549] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:16 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:17.126097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:17.128459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:17.136438 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.136947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.137401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.138150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:17.138621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:17.139063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:17.173686 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b647fc6-3d7b-4f8d-a6d7-c69a09aed01c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052049 Oct 04 19:03:17.174332 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3828/7550] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:17 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:18.187031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:18.189326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:18.197021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.197582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.198060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.198767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:18.199227 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:18.199655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:18.230706 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d13d1f11-bd51-4852-8da9-b770379d8445 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047735 Oct 04 19:03:18.231285 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3723/7551] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:18 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:19.243940 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:19.246234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:19.254831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.255677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.256488 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.257581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:19.258104 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:19.258563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:19.291614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-027bf5f6-eac8-4aa3-b499-f259ea4526b8 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052232 Oct 04 19:03:19.292186 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3829/7552] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:19 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:20.304269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:20.306585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.314063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.314549 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.314988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.315682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.316138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.316565 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.348067 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4223706d-633a-40bb-8625-e0dfb3cc1629 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047620 Oct 04 19:03:20.348616 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3724/7553] 10.222.0.42 () {58 vars in 1302 bytes} [Tue Oct 4 19:03:20 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 04 19:03:20.360023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:20.360554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:20.367495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.368007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.368468 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.369187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:20.370326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:20.370966 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:20.446622 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] HTTP exception thrown: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 is not attached to volume 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Request method failure captured: Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: request: DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments/61b14c12-9030-4d9b-9e0a-fa6c3f93aafa HTTP/1.1 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIH_k7GnqNUIXfkYwxxIFFZGY2zcSH4KP5SgeM8N_XJrIx48tlNOHbPeOYQbGoJL_GfJVAaDf-HtKpxsePtXz8mCVpslweUonjaJfhiY_Rn92QA1r1eq1CAT0J2TMrLpS3fi6IkBMjGMjlhpxTW66OCSsq1q7pcHaihTMBuTXWubvqw Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 97880f8da59b4b75997061c1885561fc Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 is not attached to volume 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'server_id': 'e2102026-c0a7-4c5d-b1ff-aadec6b48176', 'id': '61b14c12-9030-4d9b-9e0a-fa6c3f93aafa'} Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa. Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 is not attached to volume 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:20.448776 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 is not attached to volume 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Returning 404 to user: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 is not attached to volume 61b14c12-9030-4d9b-9e0a-fa6c3f93aafa {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4de57950-66b4-4998-aa5f-c7f380e54866 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments/61b14c12-9030-4d9b-9e0a-fa6c3f93aafa" status: 404 len: 154 microversion: 2.1 time: 0.094485 Oct 04 19:03:20.453266 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3830/7554] 10.222.0.42 () {58 vars in 1416 bytes} [Tue Oct 4 19:03:20 2022] DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176/os-volume_attachments/61b14c12-9030-4d9b-9e0a-fa6c3f93aafa => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:23.712900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.713915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.721269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.721760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.722239 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.722939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.723392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.723817 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.750544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:03:23.834666 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-122ae2bf-0db6-4695-a0f2-e18e0c6a3f67 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 204 len: 0 microversion: 2.1 time: 0.125325 Oct 04 19:03:23.835283 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3725/7555] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:03:23 2022] DELETE /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:03:23.844815 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:23.845466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:23.852666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.853206 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.853704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:23.855009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:23.855492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:23.855944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:24.000405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:24.009281 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ea6a223f-65e9-4d01-80b4-5604d4bb088c tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1555 microversion: 2.1 time: 0.168274 Oct 04 19:03:24.010461 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3831/7556] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:23 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:25.038084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:25.038793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:25.047590 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.048077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.048515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.049216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:25.049670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:25.050129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:25.230076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:25.237910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3e64ec5a-2862-4c1e-9be8-25ca816f0040 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1555 microversion: 2.1 time: 0.204113 Oct 04 19:03:25.238498 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3726/7557] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:25 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1555 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:26.235599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2102026-c0a7-4c5d-b1ff-aadec6b48176", "name": "network-vif-deleted", "tag": "91077780-7ab3-4281-a8c9-ca07ecf87c36"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:26.248200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.248809 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.249260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.260761 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:26.261552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] Creating event network-vif-deleted:91077780-7ab3-4281-a8c9-ca07ecf87c36 for instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 on n-h1-831194-21 Oct 04 19:03:26.261658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:26.267112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-a03572b8-26c3-4a60-a4d7-445e55955ecf req-11e90787-a015-476f-a8be-a43826665d24 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Oct 04 19:03:26.268029 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3832/7558] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:26.270016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.270915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.271428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.272402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:26.272921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:26.274401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:26.343612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97880f8da59b4b75997061c1885561fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b97db0448a4fea9fc02fa63ec8e634', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:26.351576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efbfdd6e-8f34-467d-b994-ca9104277405 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 200 len: 1343 microversion: 2.1 time: 0.094935 Oct 04 19:03:26.352251 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3727/7559] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:26 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 1343 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:27.379963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.380605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] [instance: e2102026-c0a7-4c5d-b1ff-aadec6b48176] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:27.387655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.388165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.388619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.389331 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:27.389805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:27.390277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:27.404425 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] HTTP exception thrown: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Request method failure captured: Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 HTTP/1.1 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIH_k7GnqNUIXfkYwxxIFFZGY2zcSH4KP5SgeM8N_XJrIx48tlNOHbPeOYQbGoJL_GfJVAaDf-HtKpxsePtXz8mCVpslweUonjaJfhiY_Rn92QA1r1eq1CAT0J2TMrLpS3fi6IkBMjGMjlhpxTW66OCSsq1q7pcHaihTMBuTXWubvqw Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_10b97db0448a4fea9fc02fa63ec8e634"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 10b97db0448a4fea9fc02fa63ec8e634 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1929593643 Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 97880f8da59b4b75997061c1885561fc Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestMinimumBasicScenario-1929593643-project Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e2102026-c0a7-4c5d-b1ff-aadec6b48176'} Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:03:27.406137 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Returning 404 to user: Instance e2102026-c0a7-4c5d-b1ff-aadec6b48176 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-24ac7584-05cc-4ef9-8321-60cfb5db1145 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176" status: 404 len: 111 microversion: 2.1 time: 0.032888 Oct 04 19:03:27.414056 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3833/7560] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:27 2022] GET /compute/v2.1/servers/e2102026-c0a7-4c5d-b1ff-aadec6b48176 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:03:27.416473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5766dc9e-a767-4c01-9430-714c6c9381d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] Calling method '.version_select at 0x7fbdbddc2040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:27.438053 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5766dc9e-a767-4c01-9430-714c6c9381d1 tempest-TestMinimumBasicScenario-1929593643 tempest-TestMinimumBasicScenario-1929593643-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441593712" status: 202 len: 0 microversion: 2.1 time: 0.025236 Oct 04 19:03:27.438638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3728/7561] 10.222.0.42 () {58 vars in 1272 bytes} [Tue Oct 4 19:03:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1441593712 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:03:37.224045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-996c82a2-8dae-4d2c-b582-61c88c2ef9ca tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: .version_select at 0x7fbdbd694f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1303341043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI9EjtKYcTQUholu/Pz2I8J3pomL6IzkwhWFnzey+SvI/sAv3ie6iE1C2Sv0eZJf7izgCvhXsKgjawlk9vZQbN+h8N/nGL5anP4zNGx/X5pdTvncQSV144g+8J9Ha6Oi8A=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:37.240822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-996c82a2-8dae-4d2c-b582-61c88c2ef9ca tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:37.250382 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-996c82a2-8dae-4d2c-b582-61c88c2ef9ca tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:37.277006 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-996c82a2-8dae-4d2c-b582-61c88c2ef9ca tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.239112 Oct 04 19:03:37.277640 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3834/7562] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:03:37 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:43.157460 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:43.158253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:43.163315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1062142886", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "010dca06-175a-456f-8614-22c674c0ea8f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1303341043", "security_groups": [{"name": "tempest-secgroup-smoke-1687189862"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:43.296533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] validate_networks() for [('010dca06-175a-456f-8614-22c674c0ea8f', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:03:43.879891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:03:43.880394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:03:43.880946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:03:43.881427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:03:43.881954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:03:43.896347 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.896934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.897618 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.898474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:43.899073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:43.899723 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:43.921411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:03:43.927155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:03:43.941388 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:03:43.944026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:03:43.999453 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-48547249-a3dd-4ce7-8d16-6d218e2551cc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843903 Oct 04 19:03:44.000223 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3729/7563] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:03:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:03:44.008589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:44.018587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-908243ee-8c2d-44e7-9989-b1113159386b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:44.019334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-908243ee-8c2d-44e7-9989-b1113159386b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:44.022019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:44.094730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-908243ee-8c2d-44e7-9989-b1113159386b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:44.103026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-908243ee-8c2d-44e7-9989-b1113159386b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1267 microversion: 2.1 time: 0.095305 Oct 04 19:03:44.104700 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3835/7564] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:44 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:45.128725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:45.129375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:45.137236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.137731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.138231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.138911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:45.139373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:45.139869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:45.207228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:45.216381 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-727038c3-9d79-476c-ba50-350ac5e4843c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1319 microversion: 2.1 time: 0.092476 Oct 04 19:03:45.217150 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3730/7565] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:45 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1319 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:46.241772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:46.243338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:46.252409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.253018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.253563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.254441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:46.254914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:46.255357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:46.409456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:46.418548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d1b64aa0-f71d-404b-9808-2d76bcdc09a0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.182646 Oct 04 19:03:46.419152 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3836/7566] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:46 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:47.037314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d28160f-a442-48f3-964f-56231094e70f", "tag": "6562b499-0f7e-4700-8741-d184aacd57a9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:47.047914 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:47.048510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:47.049033 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.064407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] Creating event network-changed:6562b499-0f7e-4700-8741-d184aacd57a9 for instance 9d28160f-a442-48f3-964f-56231094e70f on n-h2-831194-21 Oct 04 19:03:47.070591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8f776ccb-31fb-4e96-a8d0-7ca8d26c5842 req-c524b54d-af9f-489e-a05f-dfa2d71a1d96 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038309 Oct 04 19:03:47.071221 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3731/7567] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:47.442989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:47.444516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:47.452359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:47.452868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:47.453333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.454087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:47.454566 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:47.455023 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:47.602498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:47.611163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ebd9f45-1372-474b-b94c-3e6c6544dcfa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.172246 Oct 04 19:03:47.611748 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3837/7568] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:47 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:48.634747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:48.635513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:48.641887 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.642385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.642827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:48.643791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:48.644260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:48.644682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:48.909529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:48.922085 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-97a492d5-57e6-47ab-9b9d-2da216c584e7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.292179 Oct 04 19:03:48.922993 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3732/7569] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:48 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:49.945574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:49.946321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:49.954309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:49.954820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:49.955280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:49.956000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:49.956476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:49.956925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:50.090451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:50.098072 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-70bd7e88-2d4a-40c8-9251-7ecbbfc2ea30 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.156463 Oct 04 19:03:50.098635 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3838/7570] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:49 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:51.122777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:51.123402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:51.130689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.131216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.131672 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.133196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:51.133196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:51.133532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:51.282516 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:51.290474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9a27ea45-a7ea-43fe-9d58-e5534f71f23f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.172588 Oct 04 19:03:51.291250 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3733/7571] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:51 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:52.313545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:52.314132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:52.321074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.321580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.322734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.323484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:52.323889 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:52.324338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:52.460730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:52.470422 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1168683-df2b-490a-bdb7-2574f8502cbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.160806 Oct 04 19:03:52.471008 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3839/7572] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:52 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:53.110978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d28160f-a442-48f3-964f-56231094e70f", "name": "network-vif-plugged", "status": "completed", "tag": "6562b499-0f7e-4700-8741-d184aacd57a9"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:53.124513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:53.125034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:53.125473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:53.138217 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] Creating event network-vif-plugged:6562b499-0f7e-4700-8741-d184aacd57a9 for instance 9d28160f-a442-48f3-964f-56231094e70f on n-h2-831194-21 Oct 04 19:03:53.143816 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-f72c3604-e4a8-47c9-96c3-97a260292a52 req-8f568cbe-dcdc-4af0-86fa-37d4c0e88a36 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036898 Oct 04 19:03:53.144462 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3734/7573] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:03:53.494641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:53.495452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:53.502168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:53.502670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:53.503129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:53.503841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:53.504314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:53.504760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:53.660076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:53.668643 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5f4b50c-944a-4ac5-b43d-a82400f7f015 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1393 microversion: 2.1 time: 0.178413 Oct 04 19:03:53.669222 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3840/7574] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:53 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:54.689334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:54.690144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:54.695232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:54.695974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:54.703634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.704133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.704581 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.705282 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.705745 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.706204 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.842821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:54.850677 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa45254f-88c4-4bfa-9fef-1b06b8f8ee4a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1564 microversion: 2.1 time: 0.162313 Oct 04 19:03:54.851275 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3735/7575] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:54 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:03:54.873629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:54.874296 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:54.876180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:03:54.882063 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.882578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.883043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:54.883761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:54.884287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:54.884925 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:55.032138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:55.039959 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7db07f79-428b-460b-8ac6-77f76eb83780 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1564 microversion: 2.1 time: 0.170590 Oct 04 19:03:55.041177 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3841/7576] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:54 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:03:56.671046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:03:56.671663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:03:56.674818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d28160f-a442-48f3-964f-56231094e70f", "tag": "6562b499-0f7e-4700-8741-d184aacd57a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:03:56.678477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.679097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.679542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.680250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.680707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.681466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.687523 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:03:56.688034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:03:56.688520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:03:56.701297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] Creating event network-changed:6562b499-0f7e-4700-8741-d184aacd57a9 for instance 9d28160f-a442-48f3-964f-56231094e70f on n-h2-831194-21 Oct 04 19:03:56.707891 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-cb54d0b2-e596-4737-a7e9-70cda4ec1e73 req-ca3feaa8-a209-4898-b44b-23d8fbfc1a66 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037002 Oct 04 19:03:56.708894 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3842/7577] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:03:56.901199 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:03:56.909215 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-485e1cec-552a-4bce-8a9a-52c9e8964158 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1564 microversion: 2.1 time: 0.242381 Oct 04 19:03:56.910097 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3736/7578] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:03:56 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1564 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:20.181591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:20.183923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:20.186748 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=17 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:20.187433 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=38 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:20.194129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.194642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.195101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.195831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:20.196308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:20.196757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:20.271528 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-231ecc6f-5812-4294-bee3-af9fffd75ce9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action" status: 200 len: 24573 microversion: 2.1 time: 0.094188 Oct 04 19:04:20.272477 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3843/7579] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:20 2022] POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action => generated 24573 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:04:26.702496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:26.703110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:26.705216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:26.705904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=36 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:26.712689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.713189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.713645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.714390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.714852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.715747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.784334 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86bbaef6-8f26-4a98-82ea-bcc24c5d8ac6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action" status: 202 len: 0 microversion: 2.1 time: 0.085964 Oct 04 19:04:26.785046 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3737/7580] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:26 2022] POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:26.794543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:26.795282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:26.802647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.803194 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.803612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.804329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:26.804863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:26.805246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:26.943541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:26.951935 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f4bba0f9-fcfa-4269-9908-cd3be56f5d5f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1688 microversion: 2.1 time: 0.162269 Oct 04 19:04:26.952575 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3844/7581] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:26 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:27.979868 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:27.980576 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:27.986866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.987361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.987812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:27.988505 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:27.988967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:27.989401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:28.221759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:28.229528 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d2656ae-c202-4f10-ba8e-2a0f9ac24d45 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1668 microversion: 2.1 time: 0.255102 Oct 04 19:04:28.230141 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3738/7582] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:27 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1668 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:29.331398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:29.333570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.341425 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.341964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.342418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.343123 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.343589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.344027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.408666 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b4737623-8568-4950-8a5a-a994b3138ccd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action" status: 200 len: 32646 microversion: 2.1 time: 0.081091 Oct 04 19:04:29.409591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3845/7583] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:29 2022] POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action => generated 32646 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 04 19:04:29.421418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:29.421999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.428166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.428653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.429091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.429781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.430262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.430685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.497482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be3d1419-206f-4d46-b15b-dad8fbdd3eb9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action" status: 202 len: 0 microversion: 2.1 time: 0.080310 Oct 04 19:04:29.498170 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3739/7584] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:29 2022] POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:29.507027 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:29.507757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:29.516372 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.516888 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.517402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.518637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:29.519119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:29.519572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:29.660628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:29.668996 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e4855aea-2bcc-4b31-9eda-8daae0a154a7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1675 microversion: 2.1 time: 0.166287 Oct 04 19:04:29.669566 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3846/7585] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:29 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.693138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:30.693865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.701578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.702086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.702526 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.703213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.703664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.704085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.837881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:30.845554 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-012eb60b-e518-4b8a-8fd2-35221555353a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1683 microversion: 2.1 time: 0.156634 Oct 04 19:04:30.846154 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3740/7586] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:30 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:30.944109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:30.946271 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:30.954852 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.955359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.955819 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:30.956565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:30.957040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:30.957483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:31.021168 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-277625b4-ad85-44b4-9214-65f88512158a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action" status: 200 len: 35370 microversion: 2.1 time: 0.080843 Oct 04 19:04:31.022252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3847/7587] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:04:30 2022] POST /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f/action => generated 35370 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:04:32.073130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.073814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.075014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d28160f-a442-48f3-964f-56231094e70f", "tag": "6562b499-0f7e-4700-8741-d184aacd57a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:32.084915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.085429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.085903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.086773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.087245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.087681 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.088180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.088773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.089295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.110930 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] Creating event network-changed:6562b499-0f7e-4700-8741-d184aacd57a9 for instance 9d28160f-a442-48f3-964f-56231094e70f on n-h2-831194-21 Oct 04 19:04:32.116314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:04:32.117079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7ae213d3-4dde-4bd2-9ab4-08b8b9ecf30f req-050c28d3-e7f2-44fc-9448-9f9cb3c2baab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045863 Oct 04 19:04:32.117893 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3848/7588] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:04:32.202184 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e296cdc2-8dea-4116-9d58-082f83d04989 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 204 len: 0 microversion: 2.1 time: 0.132168 Oct 04 19:04:32.202827 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3741/7589] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:04:32 2022] DELETE /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:04:32.213029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:32.213918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:32.222137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.222733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.223396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.224151 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:32.224677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:32.225367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:32.364099 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:32.373172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-690862d2-59d4-4198-b6a7-c621c1e51d3f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1689 microversion: 2.1 time: 0.165357 Oct 04 19:04:32.374038 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3849/7590] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:32 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:04:33.398873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:33.399497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:33.406443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.406929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.407367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.408067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:33.408520 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:33.408946 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:33.546360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:33.554293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa294f01-c48e-4fbe-9fac-b976ebccaf62 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1689 microversion: 2.1 time: 0.159734 Oct 04 19:04:33.554877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3742/7591] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:33 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:34.482881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d28160f-a442-48f3-964f-56231094e70f", "name": "network-vif-deleted", "tag": "6562b499-0f7e-4700-8741-d184aacd57a9"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:34.494613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.495108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.495576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.509747 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] Creating event network-vif-deleted:6562b499-0f7e-4700-8741-d184aacd57a9 for instance 9d28160f-a442-48f3-964f-56231094e70f on n-h2-831194-21 Oct 04 19:04:34.515321 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7e55519a-8a09-4ca9-b12a-a632fe07f0c2 req-76718818-b805-4412-8de4-ab29ae063543 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036418 Oct 04 19:04:34.515922 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3850/7592] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:34.581077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:34.581849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:34.588054 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.588540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.589249 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.589978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.590430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.590913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.627340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:34.627741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:34.628176 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:34.628625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lazy-loading 'fault' on Instance uuid 9d28160f-a442-48f3-964f-56231094e70f {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:04:34.673764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:34.681796 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0da74fde-345e-4e70-8238-da37513a624e tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 200 len: 1357 microversion: 2.1 time: 0.106588 Oct 04 19:04:34.682351 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3743/7593] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:34 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:35.707429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:35.708210 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 9d28160f-a442-48f3-964f-56231094e70f] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:35.714489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.714989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.715447 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.717039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:35.717519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:35.718004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:35.731369 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] HTTP exception thrown: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Request method failure captured: Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f HTTP/1.1 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIOIaonZfVtiCZcxjbfUh-aLHpQNYmqf-3e1wnuAoTMieQIwR64Q1YRACc1yytYac4fxEDpLMtKYTx6FRF2uPQTfRgoxbZjGI6120R9G23oxUJYP6qjX4FREVW6CR7d2lN9OcJ3JKf0CNJW1XyrGaVWIgcq-ZAPguxYRhVMEz-jwqSY Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 93276379bf2b4dcda083b892bf0e6518 Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '9d28160f-a442-48f3-964f-56231094e70f'} Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:04:35.733127 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Returning 404 to user: Instance 9d28160f-a442-48f3-964f-56231094e70f could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-092e6078-cb9d-4fd6-aeb1-0a09e525eecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f" status: 404 len: 111 microversion: 2.1 time: 0.032352 Oct 04 19:04:35.738018 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3851/7594] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:35 2022] GET /compute/v2.1/servers/9d28160f-a442-48f3-964f-56231094e70f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:04:39.121098 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-261b84b1-6ac8-4382-a035-fc98029e2c85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '.version_select at 0x7fbdbddc2040>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:39.145344 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-261b84b1-6ac8-4382-a035-fc98029e2c85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1303341043" status: 202 len: 0 microversion: 2.1 time: 0.027987 Oct 04 19:04:39.146419 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3744/7595] 10.222.0.42 () {58 vars in 1284 bytes} [Tue Oct 4 19:04:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1303341043 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:04:39.177279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fea3037d-b62c-4dc5-b5e1-74b644f8d85c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: .version_select at 0x7fbdc1dd20d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1092551784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRc9QKTFkPMM9ZLc9L827JeShg8LjvaQZOEjxcChUolHCUNIl1NmM7Lr6VPHOXl0g2uwPtXNSuHm0RXzsuJo+ZtJ4j/Fq0T0gb0f8zx2eorQj2OWktlGBCyr3Lu+AVn0w=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:39.194687 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fea3037d-b62c-4dc5-b5e1-74b644f8d85c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:39.200884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-fea3037d-b62c-4dc5-b5e1-74b644f8d85c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:39.225620 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fea3037d-b62c-4dc5-b5e1-74b644f8d85c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.052513 Oct 04 19:04:39.226268 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3852/7596] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:04:39 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:44.875910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:44.880116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2124285820", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "4b57163f-8e40-42a2-a543-ba5200273bee"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1092551784", "security_groups": [{"name": "tempest-secgroup-smoke-1562725854"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:45.017740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] validate_networks() for [('4b57163f-8e40-42a2-a543-ba5200273bee', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:04:45.773418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:04:45.773876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:04:45.774394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:04:45.774805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:04:45.775231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:04:45.785703 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.786222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.786731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.787469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:45.787928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:45.788354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:45.805822 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:04:45.811859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:04:45.832360 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:04:45.835534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:04:45.888298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba49d108-3bdd-427e-a0ef-c31bbd38ae26 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.014046 Oct 04 19:04:45.895621 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3745/7597] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:04:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:04:45.898417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:45.904961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bfddb837-9bbd-4106-a438-6a6866bc0c58 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:45.906095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bfddb837-9bbd-4106-a438-6a6866bc0c58 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:45.966670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bfddb837-9bbd-4106-a438-6a6866bc0c58 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:45.976638 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bfddb837-9bbd-4106-a438-6a6866bc0c58 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1267 microversion: 2.1 time: 0.078855 Oct 04 19:04:45.977965 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3853/7598] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:45 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1267 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:47.002094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:47.002612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:47.011205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.012485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.013433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.015063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:47.015623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:47.016837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:47.100506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:47.110660 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ba15673e-e30b-4148-8887-ef9a435fa0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1327 microversion: 2.1 time: 0.114136 Oct 04 19:04:47.111259 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3746/7599] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:46 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1327 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:48.135046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:48.136551 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:48.145090 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.145595 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.146089 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.146833 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.147309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.147972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.363797 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:48.374989 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-576e3a0f-b904-48eb-92bf-87910510789d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.242898 Oct 04 19:04:48.375755 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3854/7600] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:48 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:48.682099 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bef0f7b-4898-4445-b8b7-64c2e336cc7d", "tag": "189bea97-0dae-4af3-b308-8c479aa3761c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:48.693897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:48.694479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:48.695113 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:48.707694 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] Creating event network-changed:189bea97-0dae-4af3-b308-8c479aa3761c for instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d on n-h2-831194-21 Oct 04 19:04:48.713044 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-b7519d0e-99ec-4379-bbda-03a3dfbf50f4 req-32967ad9-6c50-4453-8efe-fabd987a35de service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035977 Oct 04 19:04:48.713651 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3747/7601] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:49.398804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:49.399353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:49.406487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.406995 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.407453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.408184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:49.408659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:49.409103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:49.553185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:49.561025 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b6565eb-9110-4d86-8a6d-fb0ad9afa9a3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.166112 Oct 04 19:04:49.561466 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3855/7602] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:49 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:50.584395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:50.585105 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:50.592273 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.592765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.593211 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.593939 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:50.594400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:50.594829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:50.725192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:50.733454 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-94f8d4c5-228e-4b53-9d34-4fe9dc4ddecd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.153326 Oct 04 19:04:50.734056 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3748/7603] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:50 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:51.756686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:51.757318 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:51.760180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:51.767292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.767804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.768532 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.769295 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:51.769770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:51.770248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:51.924309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:51.932107 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48c1ad76-dbc9-4383-9782-ecb0494c13aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.179469 Oct 04 19:04:51.932683 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3856/7604] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:51 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:52.956383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:52.956998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:52.963813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.964301 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.964748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:52.966193 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:52.966655 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:52.967087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:53.106737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:53.114477 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7a5f3e68-1908-4f00-9350-f6e9124aa701 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.161993 Oct 04 19:04:53.115064 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3749/7605] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:52 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:54.137256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:54.137930 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:54.140709 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:04:54.140859 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d (ip 10.222.0.42) !!! Oct 04 19:04:54.147561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.148068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.148812 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.149530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:54.150036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:54.150490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:54.287743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:54.296661 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-44ff8069-7671-4dab-b991-4b1b7f61bdf6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.163979 Oct 04 19:04:54.297247 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3857/7606] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:54 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:55.318948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:55.319617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:55.328254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.328751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.329285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.330040 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.330510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.330941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.379406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bef0f7b-4898-4445-b8b7-64c2e336cc7d", "name": "network-vif-plugged", "status": "completed", "tag": "189bea97-0dae-4af3-b308-8c479aa3761c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:55.391116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:55.391774 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:55.392229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:55.405054 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] Creating event network-vif-plugged:189bea97-0dae-4af3-b308-8c479aa3761c for instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d on n-h2-831194-21 Oct 04 19:04:55.410672 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-69f98dd2-f70e-4c45-bcb2-0d31bf891216 req-2cf29f99-fb12-4828-a070-1e11ddf6d076 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035008 Oct 04 19:04:55.411578 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3858/7607] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:04:55.469398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:55.477257 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-38b01ad9-8052-470a-9d57-b3c2181fd5ed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.162301 Oct 04 19:04:55.477853 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3750/7608] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:55 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:56.498116 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:56.503689 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:56.504400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:56.511220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.511863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.512444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.513159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:56.513628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:56.514098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:56.657429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:56.665427 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-614db104-3b91-4bb1-a3d5-3e717c0c678b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1393 microversion: 2.1 time: 0.168386 Oct 04 19:04:56.666062 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3859/7609] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:56 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1393 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:57.688522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:57.689168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:57.691149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:57.691816 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:57.693307 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:04:57.700149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.700638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.701080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.701779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.702263 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.702694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.843107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:57.850848 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3dce26a2-2ea9-409d-8d92-7d478011d21c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1563 microversion: 2.1 time: 0.166262 Oct 04 19:04:57.851463 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3751/7610] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:57 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:57.873449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:57.874030 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:57.880897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.881396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.881873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:57.882585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:57.883048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:57.883514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:04:58.025945 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:04:58.034066 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8fffe86d-7818-489c-85fb-f44f8f2fa079 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1563 microversion: 2.1 time: 0.165096 Oct 04 19:04:58.034634 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3860/7611] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:57 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:04:59.982664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bef0f7b-4898-4445-b8b7-64c2e336cc7d", "tag": "189bea97-0dae-4af3-b308-8c479aa3761c"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:04:59.985957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:04:59.993679 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:04:59.998081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:04:59.998589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:04:59.999043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.001245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.002049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.003354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.003354 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:00.003819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:00.004321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:00.010966 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] Creating event network-changed:189bea97-0dae-4af3-b308-8c479aa3761c for instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d on n-h2-831194-21 Oct 04 19:05:00.017112 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-26377005-b4e8-4765-85ca-bd3e85972ad6 req-a5dee1c4-150b-4418-b252-0f3823d6370c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037994 Oct 04 19:05:00.018340 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3861/7612] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:05:00.147278 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:00.157080 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8a925c31-b60d-449b-b943-84648d5d9851 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1563 microversion: 2.1 time: 0.181246 Oct 04 19:05:00.158357 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3752/7613] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:04:59 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1563 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:21.405756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=11 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.406893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=40 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:21.411716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:21.414057 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:21.422019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.422516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.422968 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.423675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:21.424172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:21.424612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:21.492457 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-01feb900-4947-4cd4-90f9-cf25ea6ebe98 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action" status: 200 len: 24575 microversion: 2.1 time: 0.088536 Oct 04 19:05:21.493105 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3862/7614] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:21 2022] POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action => generated 24575 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:05:32.580718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:05:32.583059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:32.585253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:32.585937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=40 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:32.592862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.593352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.593790 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.594515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.594971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.595391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.668730 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-efe645da-bda9-44cf-b86f-4e685f15e64b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action" status: 202 len: 0 microversion: 2.1 time: 0.092010 Oct 04 19:05:32.669717 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3753/7615] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:05:32 2022] POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:05:32.678788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:32.679515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:32.682266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:32.683101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:05:32.694988 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.695518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.695981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.696849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:32.697740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:32.698592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:32.936462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:32.944331 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0122a65-3cb7-4479-b140-d14a5a877aed tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1673 microversion: 2.1 time: 0.269862 Oct 04 19:05:32.944907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3863/7616] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:32 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1673 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:33.971904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:33.972639 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:33.978779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.979262 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.979710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:33.980379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:33.980828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:33.981986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:34.117036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:34.125629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2f65b340-21f0-4aec-a4fd-026e2705a1bc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.159678 Oct 04 19:05:34.126249 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3754/7617] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:33 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:35.149428 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:35.150113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:35.157262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.157761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.158234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.158937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:35.159402 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:35.159840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:35.296567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:35.304295 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3372a774-bd8b-4782-a707-fec9f7f1bc52 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.158807 Oct 04 19:05:35.304871 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3864/7618] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:35 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:36.328361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:36.328986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:36.335930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.336367 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.336813 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.337514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:36.338011 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:36.338454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:36.471633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:36.479620 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-22f8081a-92a0-490d-acc6-0f7300611a9a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.155919 Oct 04 19:05:36.480199 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3755/7619] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:36 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:37.503476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:37.504108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:37.510923 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.511419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.511868 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.512681 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:37.513178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:37.513646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:37.648953 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:37.657317 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-969307c5-310a-4a55-8334-cb1a1f7a282a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.157736 Oct 04 19:05:37.657907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3865/7620] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:37 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:38.680960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:38.681609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:38.689160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.689640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.690104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.690791 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:38.691245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:38.691670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:38.828644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:38.836409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-45eee302-d401-4691-97f3-337ac2d20edd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.159344 Oct 04 19:05:38.836985 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3756/7621] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:38 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:39.858706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:39.859337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:39.866200 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.866703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.867155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:39.867865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:39.868334 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:39.868772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:40.002513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:40.010338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3ee7184b-d828-4cf7-90df-a13f2a135ff5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.155567 Oct 04 19:05:40.010914 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3866/7622] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:39 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:41.035640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:41.036196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:41.043158 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.043652 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.044254 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.045114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:41.045580 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:41.046075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:41.180420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:41.190773 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3bc2a05c-5ae9-49d8-8fd9-d935ba61891d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.159180 Oct 04 19:05:41.191354 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3757/7623] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:41 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:42.217373 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:42.218180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:42.225018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.225521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.226019 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.226730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:42.227204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:42.227645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:42.364643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:42.373573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f47a6f01-b306-4b12-b130-de5ecf346099 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.160801 Oct 04 19:05:42.374195 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3867/7624] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:42 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:43.397597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:43.398196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:43.405846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.406368 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.406814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.407515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:43.407974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:43.408403 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:43.546022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:43.553851 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b04be655-ae6f-42cb-a24f-3bdd8f7231d0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.160548 Oct 04 19:05:43.554436 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3758/7625] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:43 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:44.578564 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:44.579109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:44.586379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.586887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.587341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.588071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:44.588539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:44.588977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:44.722675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:44.730464 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-09d153d3-8d9d-4be1-bcee-da277f0802ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.156501 Oct 04 19:05:44.731032 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3868/7626] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:44 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:45.753620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:45.754407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:45.761277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.761772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.762253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.763156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:45.763760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:45.764197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:45.910499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:45.918414 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e655ef91-5ac6-44a3-9ff9-ccfac86cc2bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.168740 Oct 04 19:05:45.919632 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3759/7627] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:45 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:46.942760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:46.943354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:46.950344 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:46.950859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:46.951313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:46.952034 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:46.952511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:46.952963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:47.087137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:47.095107 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7a7754eb-55ce-4885-8220-e020c9cc0e95 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.156463 Oct 04 19:05:47.095680 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3869/7628] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:46 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:48.118987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:48.119614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:48.127077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.127572 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.128019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.128720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:48.129180 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:48.129614 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:48.266391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:48.275910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2d6fc139-9a6b-451a-b5a4-46006ba1f2d5 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1678 microversion: 2.1 time: 0.160860 Oct 04 19:05:48.276480 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3760/7629] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:48 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:05:49.299826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:05:49.300393 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:05:49.307208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.307716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.308156 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.308853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:05:49.309322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:05:49.309789 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:05:49.451490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:05:49.459314 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1409aec5-a08d-465a-a35a-6fc1a1acde3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1681 microversion: 2.1 time: 0.163475 Oct 04 19:05:49.459905 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3870/7630] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:05:49 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:13.664065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:13.666322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:13.668797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:13.670026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:13.675931 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.676435 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.676882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.677591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:13.678080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:13.678514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:13.757574 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-dd317800-e681-4591-bbec-db9ec0cd8b57 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action" status: 200 len: 69246 microversion: 2.1 time: 0.097227 Oct 04 19:06:13.758290 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3761/7631] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:06:13 2022] POST /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d/action => generated 69246 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:06:21.023926 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.024855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.029528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:21.030912 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=48 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:21.036992 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.037747 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.038451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.039221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.039698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.040312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.071102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:06:21.133584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bef0f7b-4898-4445-b8b7-64c2e336cc7d", "tag": "189bea97-0dae-4af3-b308-8c479aa3761c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:21.146775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.147339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.147850 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.160764 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] Creating event network-changed:189bea97-0dae-4af3-b308-8c479aa3761c for instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d on n-h2-831194-21 Oct 04 19:06:21.166591 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-01dde6b6-0cac-4a92-90b7-292ec0ec1fc1 req-4f5008a0-be0a-4270-8eac-e8dd557ffd54 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140586 Oct 04 19:06:21.172272 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3762/7632] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:21.181195 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6fffd519-11e6-47a9-989f-5ebeb3b8c3ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 204 len: 0 microversion: 2.1 time: 0.161382 Oct 04 19:06:21.181798 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3871/7633] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:06:21 2022] DELETE /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:06:21.192078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:21.192893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:21.199478 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.200069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.201186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.201965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:21.202438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:21.202870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:21.349294 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:21.357293 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2a154f02-1f4f-42c8-90d3-324a120fce87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1687 microversion: 2.1 time: 0.170751 Oct 04 19:06:21.358029 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3763/7634] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:21 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:22.384897 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:22.385627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:22.394074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.394588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.395047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.395773 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:22.396516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:22.396963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:22.553256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:22.562266 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5d19596f-580d-4b60-b1f7-45c287725fbf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1687 microversion: 2.1 time: 0.181640 Oct 04 19:06:22.562971 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3872/7635] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:22 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1687 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:23.494621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bef0f7b-4898-4445-b8b7-64c2e336cc7d", "name": "network-vif-deleted", "tag": "189bea97-0dae-4af3-b308-8c479aa3761c"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:23.509787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.511080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.511737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.525668 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] Creating event network-vif-deleted:189bea97-0dae-4af3-b308-8c479aa3761c for instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d on n-h2-831194-21 Oct 04 19:06:23.532246 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6e8dbcce-adcc-4ba7-987a-6dc6f45ffeff req-cab0a6ac-7032-4c1f-9d37-94458b269456 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042525 Oct 04 19:06:23.532862 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3764/7636] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:23.585837 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:23.586518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:23.594831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.595345 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.595805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.596530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.597008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.597459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.629490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:23.630036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:23.630494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:23.630964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lazy-loading 'fault' on Instance uuid 1bef0f7b-4898-4445-b8b7-64c2e336cc7d {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:06:23.674780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:23.682508 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-359d6698-023a-4c3c-b15b-07c144d0c818 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 200 len: 1357 microversion: 2.1 time: 0.100690 Oct 04 19:06:23.683079 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3873/7637] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:23 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 1357 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:24.708738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:24.709445 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: 1bef0f7b-4898-4445-b8b7-64c2e336cc7d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:24.715668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.716326 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.716789 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.717482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:24.717973 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:24.718407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:24.734968 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] HTTP exception thrown: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Request method failure captured: Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d HTTP/1.1 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIOIaonZfVtiCZcxjbfUh-aLHpQNYmqf-3e1wnuAoTMieQIwR64Q1YRACc1yytYac4fxEDpLMtKYTx6FRF2uPQTfRgoxbZjGI6120R9G23oxUJYP6qjX4FREVW6CR7d2lN9OcJ3JKf0CNJW1XyrGaVWIgcq-ZAPguxYRhVMEz-jwqSY Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 93276379bf2b4dcda083b892bf0e6518 Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '1bef0f7b-4898-4445-b8b7-64c2e336cc7d'} Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:06:24.736622 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Returning 404 to user: Instance 1bef0f7b-4898-4445-b8b7-64c2e336cc7d could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3b3e9724-d644-4f8f-8670-d40247b4e970 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d" status: 404 len: 111 microversion: 2.1 time: 0.034595 Oct 04 19:06:24.741967 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3765/7638] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:24 2022] GET /compute/v2.1/servers/1bef0f7b-4898-4445-b8b7-64c2e336cc7d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:06:27.983214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8406602-ac34-45bc-849d-68dddcb3c2e2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '.version_select at 0x7fbdbdd091f0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:28.016588 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8406602-ac34-45bc-849d-68dddcb3c2e2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092551784" status: 202 len: 0 microversion: 2.1 time: 0.038606 Oct 04 19:06:28.016950 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3874/7639] 10.222.0.42 () {58 vars in 1284 bytes} [Tue Oct 4 19:06:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1092551784 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:06:28.052594 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-fa71ba4a-5ff8-4cf9-8158-70936727a374 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: .version_select at 0x7fbdbc92fca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-604921869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVy76yYRTWf/ahuiUuIricKKook90zRtKRamdnsy5DWMV2u2ny9lG/5cdZZBIYMxa1UhNrycvyUAXv0gGneTYYFFPq39sCJZeCM4iTELFocswqjS58KcNo3OijakF79xg=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:28.076611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fa71ba4a-5ff8-4cf9-8158-70936727a374 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:28.084138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-fa71ba4a-5ff8-4cf9-8158-70936727a374 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:28.114973 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-fa71ba4a-5ff8-4cf9-8158-70936727a374 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.066518 Oct 04 19:06:28.115685 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3766/7640] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:06:28 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:33.818981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:33.823339 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1728570070", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "5628257c-f1f7-49fa-964b-750660877ac9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-604921869", "security_groups": [{"name": "tempest-secgroup-smoke-1436691363"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:33.940946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] validate_networks() for [('5628257c-f1f7-49fa-964b-750660877ac9', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:06:34.841385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:06:34.842035 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:06:34.842579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:06:34.843105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:06:34.843637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:06:34.861423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.862220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.862768 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.863741 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:34.864359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:34.864901 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:34.893899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:06:34.901121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:06:34.918558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:06:34.921222 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:06:34.979392 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9da18215-97de-4064-a9d6-930b87cfabeb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.162179 Oct 04 19:06:34.981875 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3875/7641] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:06:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:06:34.990925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:35.001236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d38ec38b-bb75-4426-8358-eb21e41c5955 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:35.002340 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d38ec38b-bb75-4426-8358-eb21e41c5955 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:35.091083 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d38ec38b-bb75-4426-8358-eb21e41c5955 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:35.100437 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d38ec38b-bb75-4426-8358-eb21e41c5955 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1266 microversion: 2.1 time: 0.111667 Oct 04 19:06:35.101401 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3767/7642] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:34 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1266 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:36.127670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:36.128315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:36.135746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.136260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.136780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.137496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:36.138001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:36.138630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:36.228542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:36.238472 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c06a9435-a97b-4936-b774-e94432c39b4c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1326 microversion: 2.1 time: 0.116376 Oct 04 19:06:36.239088 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3876/7643] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:36 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1326 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:37.263513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:37.264831 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:37.277469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.278438 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.278974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.279779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.280323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.280836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.539419 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:37.547461 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-58f65c41-d657-4034-a65b-e1d36d071b6d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.287869 Oct 04 19:06:37.548267 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3768/7644] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:37 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:37.816950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:37.829869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:37.830276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:37.830722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:37.842441 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] Creating event network-changed:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h1-831194-21 Oct 04 19:06:37.847740 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2f152d2b-6660-41ba-a5d3-c162c95d332f req-7cbedc48-7ff0-4950-b736-ba36ebd37289 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035147 Oct 04 19:06:37.848738 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3877/7645] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:38.571766 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:38.572382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:38.579820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.580319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.580773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.581473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:38.581972 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:38.582410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:38.720739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:38.729225 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a4b0c68c-add2-48fd-b864-eded6b238eef tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.161515 Oct 04 19:06:38.729814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3769/7646] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:38 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:39.753474 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:39.754219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:39.760450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.760950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.761407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.762150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:39.762627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:39.763075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:39.900671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:39.909178 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ecbedaca-df86-4df0-ad1a-31485862d4b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.161024 Oct 04 19:06:39.909764 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3878/7647] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:39 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:40.932065 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:40.932668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:40.940152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.940635 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.941076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:40.941763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:40.942344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:40.942685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:41.082092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:41.095087 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aecc4766-9d54-46ad-9a3a-8d3ebd5a0002 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.166806 Oct 04 19:06:41.095689 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3770/7648] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:40 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:42.124560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:42.125218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:42.132444 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.132950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.133443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.134180 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:42.134658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:42.135103 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:42.282148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:42.290448 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a9b7becc-1df8-483f-b316-359ad50c9e19 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.169743 Oct 04 19:06:42.290955 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3879/7649] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:42 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:43.312726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:43.313287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:43.320893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.321663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.322423 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.323223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.323683 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.324110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.450227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "name": "network-vif-plugged", "status": "completed", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:43.460763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:43.461259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:43.461709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:43.464648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:43.475389 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-79255278-71a9-4af5-a344-5c12c04c910a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.166224 Oct 04 19:06:43.476374 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3771/7650] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:43 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:43.481687 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] Creating event network-vif-plugged:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h1-831194-21 Oct 04 19:06:43.490713 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7352b73a-34b8-4f4e-b75d-53b8189aca03 req-3d75daec-2a61-4320-a9e8-befbd7a81ad6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119916 Oct 04 19:06:43.491346 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3880/7651] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:06:44.503666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:44.504292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:44.507010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:44.513345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.513908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.514358 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.515062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:44.515881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:44.516561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:44.655451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:44.663869 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-df0a5e16-fa3a-4bdd-a25a-1b3eb294f4d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1392 microversion: 2.1 time: 0.164695 Oct 04 19:06:44.664448 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3772/7652] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:44 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.686429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:45.687136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:45.692379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.693127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.700248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.700746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.701202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.701942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.702420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.702865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.837631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:45.845550 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0b5bbb65-8edd-4c38-8e72-a79b74adb52a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1564 microversion: 2.1 time: 0.161012 Oct 04 19:06:45.846154 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3881/7653] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:06:45.868408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:45.869124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:45.871089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:06:45.877748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.878287 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.878731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:45.879432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:45.879892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:45.880323 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:46.018757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:46.026809 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f7e317c1-577b-412c-8d06-2bb3c5136a87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1564 microversion: 2.1 time: 0.162482 Oct 04 19:06:46.027402 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3773/7654] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:45 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:06:47.705181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:06:47.706531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:06:47.715553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.716274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.716730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.717449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.718142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.718585 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.777536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:06:47.788507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:06:47.789102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:06:47.789684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:06:47.801436 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] Creating event network-changed:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h1-831194-21 Oct 04 19:06:47.806872 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3b32db6c-d4a5-4caa-94cd-afdb9500fa18 req-72768420-16a7-4faa-9f69-b03878315330 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100787 Oct 04 19:06:47.807926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3774/7655] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:06:47.865706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:06:47.874963 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3f2c6e80-8d55-49cd-8d90-3d40e1864dc1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1564 microversion: 2.1 time: 0.174096 Oct 04 19:06:47.876134 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3882/7656] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:06:47 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:11.209845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:11.210629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=38 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:11.215699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:11.218045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:11.226308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.226802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.227248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.227956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:11.228415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:11.228848 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:11.286969 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4fcad457-2076-4cf0-8d15-3abe672ce7e9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action" status: 200 len: 24543 microversion: 2.1 time: 0.079026 Oct 04 19:07:11.287875 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3775/7657] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:11 2022] POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action => generated 24543 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:07:22.247913 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:22.250442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:22.252670 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:22.253353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:22.261190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.261701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.262193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.262921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.263399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.263849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.308153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:22.314427 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128849) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 04 19:07:22.321631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:07:22.322100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:07:22.322599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:07:22.323029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:07:22.323465 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:07:22.395015 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e5dcf9fd-666f-40b9-a696-bfe503c28548 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action" status: 202 len: 0 microversion: 2.1 time: 0.150655 Oct 04 19:07:22.396384 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3883/7658] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:22 2022] POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:07:22.405205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:22.405937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:22.408927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:22.409551 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:07:22.417764 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.418513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.418986 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.419929 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:22.420398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:22.420856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:22.574057 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:22.582905 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c4d65bd8-161d-4c5d-81bd-20712ea5c84a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1692 microversion: 2.1 time: 0.181151 Oct 04 19:07:22.583586 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3776/7659] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:22 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1692 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:23.610874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:23.611631 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:23.625662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:23.626220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:23.626691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:23.627439 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:23.627920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:23.628374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:23.782197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:23.790985 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ca1f7a37-a473-48cb-a99b-6af55d9fe6d7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1692 microversion: 2.1 time: 0.186099 Oct 04 19:07:23.791560 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3884/7660] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:23 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1692 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:24.816164 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:24.817102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:24.824633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.825148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.825585 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.826316 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:24.826778 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:24.827207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:24.961325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:24.969118 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-456baae4-cd60-4321-bc15-37094f785910 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.157042 Oct 04 19:07:24.969691 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3777/7661] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:24 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:25.992535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:25.993240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:26.000919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.001423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.001899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.002618 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:26.003110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:26.003635 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:26.141605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:26.151356 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eea39fd8-9d3c-439a-a4f5-53b9b2af6eac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.162628 Oct 04 19:07:26.151942 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3885/7662] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:25 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:27.178300 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:27.178937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:27.185911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.186406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.186849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.187554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:27.188014 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:27.188443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:27.330004 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:27.338467 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-865d10fd-ab3e-4907-9f79-be08535a42bd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.164652 Oct 04 19:07:27.338976 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3778/7663] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:27 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:28.363724 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:28.364291 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:28.374637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.375493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.376226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.377646 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:28.378284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:28.378967 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:28.544041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:28.554748 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2107d650-4ece-4a1f-ab62-6abd22f81cc8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.196575 Oct 04 19:07:28.555363 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3886/7664] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:28 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:29.579087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:29.579696 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:29.587179 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.587676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.588121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.588873 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:29.589296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:29.589730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:29.727377 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:29.735148 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77f11bdf-fab2-4a86-869f-96bbe39744c4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.159950 Oct 04 19:07:29.735728 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3779/7665] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:29 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:30.758821 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:30.759450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:30.766816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.767320 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.767778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.768490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:30.768963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:30.769943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:30.907165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:30.915808 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6215d404-13b2-43d9-9d03-7bb192cff963 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.160876 Oct 04 19:07:30.916378 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3887/7666] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:30 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:31.939266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:31.939915 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:31.946897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.947386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.947829 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:31.948522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:31.948979 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:31.949408 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:32.092361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:32.100696 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-037cf73b-6c2e-429d-8317-1997ae02f666 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.165352 Oct 04 19:07:32.101274 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3780/7667] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:31 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:33.124740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:33.125368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:33.132922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.133418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.133892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.134602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:33.135070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:33.135508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:33.277036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:33.285409 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-18a8afca-50c7-4c41-9aac-606bdbb59e0b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.164141 Oct 04 19:07:33.286002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3888/7668] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:33 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:34.309748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:34.310402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:34.317376 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.317882 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.318321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.319009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:34.319462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:34.319886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:34.452001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:34.460741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f5d1909d-4149-4f0d-b024-10c43448b960 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.154921 Oct 04 19:07:34.461319 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3781/7669] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:34 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:35.486377 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:35.487014 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:35.494983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.495491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.495951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.496671 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:35.497147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:35.497596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:35.638982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:35.648419 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-46fe21c6-4aa4-4968-89c3-0a50e1fe751c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.165952 Oct 04 19:07:35.649263 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3889/7670] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:35 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:36.675339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:36.676306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:36.683185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.683698 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.684418 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.685116 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:36.685574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:36.686030 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:36.824828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:36.833265 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-09177799-1c4b-416e-9b07-84585ba8800a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.164094 Oct 04 19:07:36.833847 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3782/7671] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:36 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:37.856637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:37.857203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:37.864719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.865217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.865666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:37.866406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:37.866883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:37.867324 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:38.002659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:38.011136 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-880eec2c-3fa2-486f-ad1d-b8e31f1b2439 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.158479 Oct 04 19:07:38.011708 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3890/7672] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:37 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:39.035284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:39.036022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:39.043043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.043538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.043988 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.044689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:39.045155 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:39.045591 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:39.180690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:39.189232 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f4914ff3-0661-4a13-8c50-676ce3aea230 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.158026 Oct 04 19:07:39.189806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3783/7673] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:39 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:40.213872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:40.214496 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:40.221472 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.222033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.222491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.223205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:40.223676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:40.224119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:40.376971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:40.386607 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-53123394-6595-41f8-859d-5670c22a17b0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.177533 Oct 04 19:07:40.387184 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3891/7674] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:40 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:41.410747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:41.411304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:41.419092 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.419686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.420145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.420847 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:41.421312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:41.421767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:41.554893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:41.562629 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12ec2690-2674-474a-8f3b-0afb0844fdc2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1697 microversion: 2.1 time: 0.156008 Oct 04 19:07:41.563200 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3784/7675] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:41 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1697 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:42.288048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "name": "network-vif-unplugged", "status": "completed", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:42.299766 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.300268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.300720 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.313046 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Creating event network-vif-unplugged:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h2-831194-21 Oct 04 19:07:42.319006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] Instance a7f99453-5f86-4963-9334-accd5584734e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128849) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:07:42.331093 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-454af1a1-5504-4512-8105-1181115cd38b req-a7e0eaf9-431c-47c0-bbce-44e08dc22038 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047253 Oct 04 19:07:42.331703 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3892/7676] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:42.587543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:42.588153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:42.594975 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.595467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.595903 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.596599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:42.597051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:42.597479 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:42.791335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:42.799259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a0d9fcc8-832c-4791-8cd0-7ec2418b5244 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1696 microversion: 2.1 time: 0.215686 Oct 04 19:07:42.799847 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3785/7677] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:42 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1696 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:43.825667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:43.826399 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:43.833581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.834126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.834603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.835902 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:43.836385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:43.836928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:43.970343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:43.978803 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-cb140a5b-07c7-44c9-a125-884ba8899fa6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1694 microversion: 2.1 time: 0.157593 Oct 04 19:07:43.979405 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3893/7678] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:43 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:44.371452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:44.383003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:44.383486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:44.383920 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:44.398794 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Creating event network-changed:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h2-831194-21 Oct 04 19:07:44.404611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] Instance a7f99453-5f86-4963-9334-accd5584734e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-831194-21', 'n-h2-831194-21'} {{(pid=128850) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 04 19:07:44.416829 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c7e4e460-2c9e-4412-bb49-9346f487fee8 req-5c7a7e1a-3e67-4c35-8bfa-2cace32cdfc2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050119 Oct 04 19:07:44.417473 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3786/7679] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:07:45.012005 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:45.013731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:45.020661 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.021199 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.021662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.022417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:45.023467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:45.024249 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:45.192193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:45.204339 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ccd56241-0bea-4e04-b55c-985de502bd3a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1694 microversion: 2.1 time: 0.197090 Oct 04 19:07:45.204979 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3894/7680] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:45 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1694 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:07:46.233923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.234560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.240690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.241174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.242154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.242864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.243311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.243743 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.386624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.398679 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bb0b249f-b552-444c-aa3e-99d9e32b77a8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1691 microversion: 2.1 time: 0.169541 Oct 04 19:07:46.400189 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3787/7681] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:46.424076 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:46.424644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.432464 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.432972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.433436 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.434184 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.434662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.435109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.494085 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2a96e24d-9148-4d8f-8eb7-7056ac16b76c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action" status: 204 len: 0 microversion: 2.1 time: 0.073614 Oct 04 19:07:46.494670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3895/7682] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:07:46 2022] POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:07:46.502908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.503584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.510754 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.511236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.511731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.512515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.513080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.513502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.736382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.746134 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f97a0c7-4199-44ba-b9ce-928f45e2b76d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1691 microversion: 2.1 time: 0.247043 Oct 04 19:07:46.749888 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3788/7683] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1691 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:46.770719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:46.771446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:46.779519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.780048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.780504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.781245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:46.781716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:46.782185 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:46.941955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:46.950769 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b1d92777-d342-47fa-9105-531a4372e4ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1691 microversion: 2.1 time: 0.184438 Oct 04 19:07:46.951357 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3896/7684] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:46 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:47.974601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:07:47.975228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:07:47.983063 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.983563 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.984016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:47.984762 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:47.985230 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:47.985664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.130496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:07:48.138960 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "name": "network-vif-plugged", "status": "completed", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:07:48.140119 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89715b0f-9aac-4918-9149-f848201c7fb7 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1683 microversion: 2.1 time: 0.169472 Oct 04 19:07:48.141883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3789/7685] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:07:47 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:07:48.154596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:07:48.155688 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:07:48.156149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:07:48.169073 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] Creating event network-vif-plugged:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h2-831194-21 Oct 04 19:07:48.174713 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-7f945c82-791f-449f-a97f-8c7bc124c5de req-2579952e-fbba-40c1-9ec4-68ae6a65c590 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039887 Oct 04 19:07:48.175594 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3897/7686] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:10.352574 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:10.354774 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:10.356993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=28 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.357658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=82 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:10.364019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.364523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.364971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.365684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:10.366250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:10.366706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:10.442502 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ed469a2a-1c20-4d47-8592-99007af83119 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action" status: 200 len: 24576 microversion: 2.1 time: 0.094770 Oct 04 19:08:10.443077 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3790/7687] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:08:10 2022] POST /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e/action => generated 24576 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:08:17.820186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:17.820804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:17.822175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:17.826922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=34 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:17.827826 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:17.831969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.832603 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.833126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.834036 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.834706 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.834828 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.835237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.835348 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.835804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.849048 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] Creating event network-changed:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h2-831194-21 Oct 04 19:08:17.855337 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-03f388ab-114b-4a44-b774-bc9bf13f9142 req-0a40569c-7756-4567-a9b8-058c5ed819a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037181 Oct 04 19:08:17.856193 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3791/7688] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:17.866466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:08:17.952119 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f70aec8-c0ed-410d-b2f9-c635045ae98d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 204 len: 0 microversion: 2.1 time: 0.136221 Oct 04 19:08:17.955862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3898/7689] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:08:17 2022] DELETE /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:08:17.964391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:17.965162 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:17.973186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.973676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.974146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:17.974852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:17.975343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:17.975777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:18.139244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:18.147939 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4c0d0287-4f16-4faf-9fc9-d6fd120854ac tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1689 microversion: 2.1 time: 0.189364 Oct 04 19:08:18.148638 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3792/7690] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:17 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1689 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:19.174308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:19.175109 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:19.183625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.184139 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.184638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.185368 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.185870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.186326 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.440259 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:19.448357 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2467bd41-3bb9-42d4-ae91-32e133aba385 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1689 microversion: 2.1 time: 0.278576 Oct 04 19:08:19.449144 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3899/7691] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:19 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1689 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:19.937218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7f99453-5f86-4963-9334-accd5584734e", "name": "network-vif-deleted", "tag": "34ec7bdf-122c-4e18-96fa-5ebdffa1690f"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:19.950584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:19.951883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:19.952375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:19.964170 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] Creating event network-vif-deleted:34ec7bdf-122c-4e18-96fa-5ebdffa1690f for instance a7f99453-5f86-4963-9334-accd5584734e on n-h2-831194-21 Oct 04 19:08:19.970303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-dbef1dc6-8c47-4e22-a162-ebaa023b5d79 req-3fc73191-49ef-4979-866f-06626fe9abc1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 Oct 04 19:08:19.970923 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3793/7692] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:20.472340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:20.472914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:20.480091 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:20.480600 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:20.481062 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.481782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:20.482290 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:20.482738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.518808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:20.519648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:20.520226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:20.521243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lazy-loading 'fault' on Instance uuid a7f99453-5f86-4963-9334-accd5584734e {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:08:20.570969 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:20.579605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6f35cc4b-fc5e-43cc-83fb-67246b648da6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 200 len: 1356 microversion: 2.1 time: 0.111243 Oct 04 19:08:20.580341 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3900/7693] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:20 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 1356 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:21.606334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:21.607043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: a7f99453-5f86-4963-9334-accd5584734e] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:21.613196 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:21.613695 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:21.614256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:21.614861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:21.615320 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:21.615749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:21.632120 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] HTTP exception thrown: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Request method failure captured: Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e HTTP/1.1 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIOIaonZfVtiCZcxjbfUh-aLHpQNYmqf-3e1wnuAoTMieQIwR64Q1YRACc1yytYac4fxEDpLMtKYTx6FRF2uPQTfRgoxbZjGI6120R9G23oxUJYP6qjX4FREVW6CR7d2lN9OcJ3JKf0CNJW1XyrGaVWIgcq-ZAPguxYRhVMEz-jwqSY Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 93276379bf2b4dcda083b892bf0e6518 Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'a7f99453-5f86-4963-9334-accd5584734e'} Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:08:21.633739 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Returning 404 to user: Instance a7f99453-5f86-4963-9334-accd5584734e could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-01f116cf-b8ee-4d76-a9df-c0df55eb0a2c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e" status: 404 len: 111 microversion: 2.1 time: 0.035186 Oct 04 19:08:21.639433 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3794/7694] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:21 2022] GET /compute/v2.1/servers/a7f99453-5f86-4963-9334-accd5584734e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:08:25.047583 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ec50a956-6d28-4798-8bdd-2ce57512c1fb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '.version_select at 0x7fbdbd6943a0>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:25.071918 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ec50a956-6d28-4798-8bdd-2ce57512c1fb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604921869" status: 202 len: 0 microversion: 2.1 time: 0.028164 Oct 04 19:08:25.073444 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3901/7695] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 19:08:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-604921869 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:08:25.103159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-798bb9f8-491c-4396-88b8-2235177063f3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: .version_select at 0x7fbdbc7f00d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-600227017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcwNIIjGnOXk8L/Qi99YoOAdlgaNQC/CLFuSBgn94gSAKs8d6BOeFM0cHfzg/U6Aoo4yp8KkxYZOzs+EOpepyh7bv6vw5FZe/b1gldakTdNHChfEGv9d6v5Z/QCIRHraA=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:25.119548 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-798bb9f8-491c-4396-88b8-2235177063f3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:25.125820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-798bb9f8-491c-4396-88b8-2235177063f3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:25.149366 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-798bb9f8-491c-4396-88b8-2235177063f3 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.050196 Oct 04 19:08:25.156992 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3795/7696] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:08:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:31.050977 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:31.058231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1510931759", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "f0cce295-2b28-4362-8e3a-6b42964b4f8b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-600227017", "security_groups": [{"name": "tempest-secgroup-smoke-2107814409"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:31.198173 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] validate_networks() for [('f0cce295-2b28-4362-8e3a-6b42964b4f8b', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:08:31.708800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:08:31.709252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:08:31.709755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:08:31.710214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:08:31.710679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:08:31.721171 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:31.721869 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:31.722327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:31.723164 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:31.723649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:31.724107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:31.745783 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:08:31.751781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:08:31.766322 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:08:31.768733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:08:31.821372 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e1dbb8bc-0c33-444f-8507-4236aa3d3b8d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772649 Oct 04 19:08:31.823180 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3902/7697] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:08:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:08:31.832401 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:31.837421 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0f3a7f3f-0f30-4313-ac81-0128c25325ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:31.838691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0f3a7f3f-0f30-4313-ac81-0128c25325ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:31.977634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0f3a7f3f-0f30-4313-ac81-0128c25325ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:31.988470 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0f3a7f3f-0f30-4313-ac81-0128c25325ae tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.158024 Oct 04 19:08:31.990623 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3796/7698] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:31 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:33.014917 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:33.016308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:33.024016 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.024541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.025761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.026791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:33.027276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:33.027726 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:33.138802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:33.162315 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-bc8229b4-a444-44a6-93f4-64eefb3da7c6 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1326 microversion: 2.1 time: 0.153360 Oct 04 19:08:33.164126 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3903/7699] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:33 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1326 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:34.192968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:34.193700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:34.201686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.202560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.203241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.204182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.204857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.205668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.447685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:34.455617 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-796faf57-2ebe-40d3-a7f1-878926f5de7c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.266726 Oct 04 19:08:34.456209 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3797/7700] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:34 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:34.834299 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b648ab24-aaa6-4f40-8d22-405ce89bb3fe", "tag": "dad6ea5d-5542-4f03-97ac-1752ad966c1a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:34.846553 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:34.847055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:34.847703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:34.863440 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] Creating event network-changed:dad6ea5d-5542-4f03-97ac-1752ad966c1a for instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe on n-h1-831194-21 Oct 04 19:08:34.871079 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6eb3d52e-8489-4fd3-8b5f-8707ab8cda24 req-28c5ab33-27c0-4743-b60a-6bef973eef64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043045 Oct 04 19:08:34.872082 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3904/7701] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:35.480034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:35.480649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:35.487414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:35.487900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:35.488337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:35.489031 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:35.489490 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:35.489940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:35.627252 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:35.635501 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-412ded33-c3a6-4954-b185-9925e8f2ac74 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.159527 Oct 04 19:08:35.636226 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3798/7702] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:35 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:36.664739 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:36.665582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:36.677253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.677763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.678239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.679125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:36.679597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:36.680066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:36.874385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:36.883315 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-614a772c-264e-406a-afce-255581a7d0e4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.226577 Oct 04 19:08:36.884024 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3905/7703] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:36 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:37.908256 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:37.908805 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:37.916046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.916571 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.917020 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:37.917731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:37.918245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:37.918680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:38.058016 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:38.069325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-92084807-4d40-417e-b192-b76e3a0b7d72 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.165022 Oct 04 19:08:38.070318 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3799/7704] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:37 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:39.099015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:39.099745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:39.108129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.108685 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.109286 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.110128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.110642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.111098 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.250135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:39.257815 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c53e8cac-f294-454d-8f96-fd288a566cbc tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.163037 Oct 04 19:08:39.258400 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3906/7705] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:39 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:39.736337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b648ab24-aaa6-4f40-8d22-405ce89bb3fe", "name": "network-vif-plugged", "status": "completed", "tag": "dad6ea5d-5542-4f03-97ac-1752ad966c1a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:39.747006 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:39.748010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:39.748010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:39.759258 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] Creating event network-vif-plugged:dad6ea5d-5542-4f03-97ac-1752ad966c1a for instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe on n-h1-831194-21 Oct 04 19:08:39.766207 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-19e55ad7-169a-41c7-9203-bd1b29618709 req-092c9a62-841e-4694-a771-72f8c1ac7e25 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033910 Oct 04 19:08:39.766815 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3800/7706] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:08:40.280910 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:40.281548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:40.288494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.288996 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.289450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.290193 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:40.290752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:40.291294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:40.424275 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:40.433267 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6a3c9a9a-75a5-439f-b0ce-d43cf8f793aa tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1392 microversion: 2.1 time: 0.155981 Oct 04 19:08:40.433861 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3907/7707] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:40 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.459893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.460599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.462538 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:41.469111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.469597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.470062 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.470759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.471214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.471637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.606940 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.615219 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-123080ae-430e-4913-97b4-f66077f435ec tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1563 microversion: 2.1 time: 0.160565 Oct 04 19:08:41.615820 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3801/7708] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:41.639095 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:41.639785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:41.646725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.647235 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.647695 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.648413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:41.648892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:41.649340 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:41.737248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:41.758883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:41.790142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:41.798067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d6a0f59f-0841-43d9-8715-84a7d6edd61c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1563 microversion: 2.1 time: 0.163569 Oct 04 19:08:41.798638 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3908/7709] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:41 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:08:43.790267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:08:43.791009 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:08:43.792239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b648ab24-aaa6-4f40-8d22-405ce89bb3fe", "tag": "dad6ea5d-5542-4f03-97ac-1752ad966c1a"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:08:43.795990 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:08:43.799337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.800055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.800496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.801197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.802185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.802613 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.804258 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:08:43.804765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:08:43.805250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:08:43.820062 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] Creating event network-changed:dad6ea5d-5542-4f03-97ac-1752ad966c1a for instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe on n-h1-831194-21 Oct 04 19:08:43.826511 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-23de04b5-ac5f-40dd-b1df-1a559daa9a24 req-c71231e0-ca61-4986-9920-5d857b6a7156 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037783 Oct 04 19:08:43.827709 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3909/7710] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:08:44.037819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:08:44.047000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8c8157a-ba83-482d-b0de-e445decd3f29 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1563 microversion: 2.1 time: 0.260888 Oct 04 19:08:44.047801 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3802/7711] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:08:43 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1563 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:07.344571 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:07.345490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:07.350048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:07.352521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:07.361208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:07.361719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:07.362226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:07.362962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:07.363440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:07.363887 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:07.424306 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-149e283c-26a1-4a23-a0b6-15f0dbb34160 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action" status: 200 len: 24563 microversion: 2.1 time: 0.081454 Oct 04 19:09:07.424960 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3910/7712] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:07 2022] POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action => generated 24563 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:18.266311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:18.268543 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:18.269257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:18.275201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.275690 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.276129 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.299523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Going to try to stop instance {{(pid=128850) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 04 19:09:18.346771 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ddb18a26-5a1b-4ca9-877c-8b8c2ff74552 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.084555 Oct 04 19:09:18.347493 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3803/7713] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:18 2022] POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:18.356955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:18.357675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:18.361961 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=4 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:18.362609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:18.367784 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.368301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.368758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.369479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:18.369978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:18.370424 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:18.525777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:18.534552 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ada44918-3c09-4be5-9f3a-bfe1363fd50c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.181830 Oct 04 19:09:18.535137 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3911/7714] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:18 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:09:19.562844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:19.563550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:19.569795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.570313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.570757 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.571454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:19.571911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:19.572338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:19.708463 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:19.717259 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2047f270-59cc-4126-b26c-c5933bcb0443 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.160265 Oct 04 19:09:19.717855 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3804/7715] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:19 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:20.740622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:20.741242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:20.750084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.750591 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.751050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.751770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:20.752248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:20.752703 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:20.906012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:20.913946 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-065da647-1df9-40e3-bb02-4df59992accd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.177266 Oct 04 19:09:20.915093 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3912/7716] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:20 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:21.938680 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:21.939296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:21.946474 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.946954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.947395 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:21.948077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:21.948532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:21.948959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:22.097808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:22.105859 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1682d1ef-ac66-422c-8335-585b63624d07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.171645 Oct 04 19:09:22.106525 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3805/7717] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:21 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:23.128846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:23.129479 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:23.136645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.137092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.138100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.138835 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:23.139312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:23.139765 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:23.275979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:23.285032 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-5f27c071-fd66-4247-8898-b8d45c600a7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.160205 Oct 04 19:09:23.285621 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3913/7718] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:23 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:24.314476 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:24.315080 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:24.322007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.322799 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.323060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.323604 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:24.324061 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:24.324485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:24.462027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:24.469731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-84e7a619-c39d-4b03-9293-90900f9b786a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.159399 Oct 04 19:09:24.470328 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3806/7719] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:24 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:25.492865 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:25.493505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:25.500867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.501379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.501903 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.502630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:25.503128 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:25.503579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:25.640218 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:25.648213 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d3ebeee-d575-478d-bd24-557dcf23922a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.159465 Oct 04 19:09:25.648803 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3914/7720] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:25 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:26.673439 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:26.674088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:26.681293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.681787 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.682260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.682964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:26.683428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:26.683858 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:26.827812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:26.835650 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f917f9c6-08b4-403e-a20f-5b5b5a01a1bf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.167009 Oct 04 19:09:26.836239 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3807/7721] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:26 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:27.860517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:27.861157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:27.869106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.869620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.870142 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:27.870877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:27.871357 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:27.871813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:28.017513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:28.025402 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c81b9412-b2f7-4787-b3a3-2f594e8557dd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1691 microversion: 2.1 time: 0.169100 Oct 04 19:09:28.026003 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3915/7722] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:27 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:29.049178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:29.049893 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:29.056540 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.057036 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.057487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.058224 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:29.058685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:29.059217 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:29.296726 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:29.304392 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d9ff7363-0f53-43d6-8d58-da61ad78da7f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1668 microversion: 2.1 time: 0.259605 Oct 04 19:09:29.305185 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3808/7723] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:29 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1668 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:30.416178 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:30.418730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:30.426574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.427227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.427733 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.428612 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.429132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.429652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.488782 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f6a1afc8-1120-4b1d-8799-c5354c8aa7f2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action" status: 200 len: 38362 microversion: 2.1 time: 0.076801 Oct 04 19:09:30.489500 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3916/7724] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:30 2022] POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action => generated 38362 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:09:30.503535 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:30.510853 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.511351 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.511820 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.537871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Going to try to start instance {{(pid=128850) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 04 19:09:30.586709 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3f695755-f121-4820-9043-c17a99130600 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action" status: 202 len: 0 microversion: 2.1 time: 0.086423 Oct 04 19:09:30.586709 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3809/7725] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:30 2022] POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:09:30.596221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:30.596962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:30.606979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.608000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.608560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.609365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:30.609864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:30.611190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:30.782268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:30.793191 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-88497b4f-a940-44b9-93b0-26ccc2d227e8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1677 microversion: 2.1 time: 0.201680 Oct 04 19:09:30.793897 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3917/7726] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:30 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1677 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:31.822588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:31.823304 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:31.830601 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.831138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.831586 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.832297 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:31.832792 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:31.833257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:31.980359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:31.990535 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3ed36a41-5650-4ee7-be08-c0068fd087d1 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1677 microversion: 2.1 time: 0.173157 Oct 04 19:09:31.991370 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3810/7727] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:31 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:33.021188 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:09:33.022714 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:33.030478 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.031255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.031980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.032719 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:33.033202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:33.033690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:33.190445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:09:33.198475 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-71e69673-77d6-483b-b9f4-037336b92c25 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1681 microversion: 2.1 time: 0.184458 Oct 04 19:09:33.199044 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3918/7728] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:09:33 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:09:59.405598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:09:59.407795 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:09:59.411104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:59.411104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:09:59.412200 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:09:59.412407 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action (ip 10.222.0.42) !!! Oct 04 19:09:59.424450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:59.424941 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:59.425383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:59.426124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:09:59.426577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:09:59.427005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:09:59.493554 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30e6cb02-6a2d-4e47-89e8-90af9b13e728 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action" status: 200 len: 62917 microversion: 2.1 time: 0.092470 Oct 04 19:09:59.494369 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3811/7729] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:09:59 2022] POST /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe/action => generated 62917 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:10:06.638041 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:06.638587 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:06.639496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b648ab24-aaa6-4f40-8d22-405ce89bb3fe", "tag": "dad6ea5d-5542-4f03-97ac-1752ad966c1a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:06.641509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=16 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:06.642442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=46 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:06.651068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.651751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.652278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.652416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.652812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.653258 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.653394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.653918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.654699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.665031 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] Creating event network-changed:dad6ea5d-5542-4f03-97ac-1752ad966c1a for instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe on n-h1-831194-21 Oct 04 19:10:06.670183 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-9a5bac09-5873-423f-a28a-33de312597c9 req-1d0c3c0d-04ca-4ca8-9af8-8c07362eb2a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034728 Oct 04 19:10:06.671288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3812/7730] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:06.685807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:10:06.778476 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2d73b91e-46c9-4567-bcbd-36a664049c7a tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 204 len: 0 microversion: 2.1 time: 0.144451 Oct 04 19:10:06.780323 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3919/7731] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:10:06 2022] DELETE /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 04 19:10:06.791620 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:06.792767 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:06.800911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.801411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.801876 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.802593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:06.803078 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:06.803512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:06.959880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:06.968142 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99e48ef1-29cd-4923-b007-f43bf5d48799 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1687 microversion: 2.1 time: 0.182222 Oct 04 19:10:06.968742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3813/7732] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:06 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:07.993073 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:07.993798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:08.001493 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.002044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.002508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.003227 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:08.003704 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:08.004158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:08.139839 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:08.148004 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0eec22ee-3805-45ab-a9f2-1cd766fe8e6f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1687 microversion: 2.1 time: 0.159217 Oct 04 19:10:08.148575 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3920/7733] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:07 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:09.044145 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b648ab24-aaa6-4f40-8d22-405ce89bb3fe", "name": "network-vif-deleted", "tag": "dad6ea5d-5542-4f03-97ac-1752ad966c1a"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:09.056369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.057012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.057457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.072617 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] Creating event network-vif-deleted:dad6ea5d-5542-4f03-97ac-1752ad966c1a for instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe on n-h1-831194-21 Oct 04 19:10:09.077707 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-3527e483-3d52-4c41-aa32-149dba4b9234 req-055b6b83-6c8b-4a91-b6d8-a17d7e80c091 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039592 Oct 04 19:10:09.078355 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3814/7734] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:09.174647 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:09.175672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:09.182778 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.183682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.183813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.184431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.184906 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.185359 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.219025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:09.219549 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:09.220010 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:09.220471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lazy-loading 'fault' on Instance uuid b648ab24-aaa6-4f40-8d22-405ce89bb3fe {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:10:09.262870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:09.271358 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d10507ad-63ec-4d6f-9253-3023fdb16856 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 200 len: 1356 microversion: 2.1 time: 0.102354 Oct 04 19:10:09.271941 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3921/7735] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:09 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:10.295699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:10.297027 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: b648ab24-aaa6-4f40-8d22-405ce89bb3fe] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:10.303248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.303736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.304178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.304875 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:10.305335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:10.305768 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:10.319797 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] HTTP exception thrown: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Request method failure captured: Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe HTTP/1.1 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIOIaonZfVtiCZcxjbfUh-aLHpQNYmqf-3e1wnuAoTMieQIwR64Q1YRACc1yytYac4fxEDpLMtKYTx6FRF2uPQTfRgoxbZjGI6120R9G23oxUJYP6qjX4FREVW6CR7d2lN9OcJ3JKf0CNJW1XyrGaVWIgcq-ZAPguxYRhVMEz-jwqSY Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 93276379bf2b4dcda083b892bf0e6518 Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': 'b648ab24-aaa6-4f40-8d22-405ce89bb3fe'} Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:10:10.321444 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Returning 404 to user: Instance b648ab24-aaa6-4f40-8d22-405ce89bb3fe could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e1fea186-c022-4e29-b3ef-4d06015115cf tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe" status: 404 len: 111 microversion: 2.1 time: 0.032525 Oct 04 19:10:10.326880 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3815/7736] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:10 2022] GET /compute/v2.1/servers/b648ab24-aaa6-4f40-8d22-405ce89bb3fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:10:14.039276 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-27f76b6b-fd92-4f15-a5fb-ea695964cd87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '.version_select at 0x7fbdc1d79790>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:14.064274 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-27f76b6b-fd92-4f15-a5fb-ea695964cd87 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-600227017" status: 202 len: 0 microversion: 2.1 time: 0.028681 Oct 04 19:10:14.064782 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3922/7737] 10.222.0.42 () {58 vars in 1281 bytes} [Tue Oct 4 19:10:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-600227017 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:10:14.097109 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-54662186-472a-459e-b427-0687990a7472 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: .version_select at 0x7fbdbd16b280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1283964229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiYDrDK0b08mVS9fmX0qKa3h4mKZM7Ffs0Q1uV7SyBDpBISSdk3bWXVxuqgMy7s3gPArG6SAE6PUtBo+zV3S6GpQkj0Z64e1U0GB14kb2OPSFBWTH5PoD+ZXsAKtuSKLw=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:14.115473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54662186-472a-459e-b427-0687990a7472 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:14.120566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-54662186-472a-459e-b427-0687990a7472 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:14.145173 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-54662186-472a-459e-b427-0687990a7472 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051972 Oct 04 19:10:14.145776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3816/7738] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:10:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:20.061189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-68494427", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "networks": [{"uuid": "1319950a-1107-49af-9955-74151c55ba0a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1283964229", "security_groups": [{"name": "tempest-secgroup-smoke-1418336547"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:20.073709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:20.184047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] validate_networks() for [('1319950a-1107-49af-9955-74151c55ba0a', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:10:20.625978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:10:20.626683 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:10:20.627310 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:10:20.628015 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:10:20.628528 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:10:20.638264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.638861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.639432 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.640328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:20.641001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:20.641456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:20.669254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:10:20.676421 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Getting quotas for user 93276379bf2b4dcda083b892bf0e6518 and project 1ee0d18f6a7a4e3a90f152654e36cfb9. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:10:20.699981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:10:20.702657 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:10:20.769379 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4928ebbb-928b-40df-9a08-529846077884 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711367 Oct 04 19:10:20.771160 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3923/7739] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:10:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:10:20.782961 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f6e668f4-8a51-47d9-a454-891fc8ca7570 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:20.783593 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f6e668f4-8a51-47d9-a454-891fc8ca7570 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:20.786984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=16 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:20.847141 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f6e668f4-8a51-47d9-a454-891fc8ca7570 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:20.854241 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f6e668f4-8a51-47d9-a454-891fc8ca7570 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1265 microversion: 2.1 time: 0.076295 Oct 04 19:10:20.870713 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3817/7740] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:20 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:21.881149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:21.881782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:21.894202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.894737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.895531 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.896590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:21.897343 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:21.897846 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:21.988064 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:21.996531 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75c13085-a194-4f7b-a7d6-969c7cc9833c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1325 microversion: 2.1 time: 0.120560 Oct 04 19:10:21.997355 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3924/7741] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:21 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1325 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:10:23.021454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:23.022104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:23.033883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.034630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.035085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.035835 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.036470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.036909 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.214003 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:23.222662 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-7ca784d5-906a-43c8-bd9f-2314b1da50f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.205122 Oct 04 19:10:23.223543 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3818/7742] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:23 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:23.677248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7135a1-4fcf-4641-b4fd-7cdd11374a5d", "tag": "32b8050b-df97-4740-9595-d4a7950c056e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:23.689217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:23.689955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:23.690406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:23.702131 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] Creating event network-changed:32b8050b-df97-4740-9595-d4a7950c056e for instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d on n-h2-831194-21 Oct 04 19:10:23.708159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-0137cf01-3331-43fe-8af7-4bb04a408417 req-f4b09904-dbd4-4f56-ae45-b7fa4e66b03e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033751 Oct 04 19:10:23.708159 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3925/7743] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:24.247328 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:24.248002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:24.255487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.255971 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.256405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.257091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:24.257542 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:24.257998 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:24.391864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:24.400303 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-107de4ce-c863-42f5-8660-d9601a4f10f9 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.156894 Oct 04 19:10:24.400883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3819/7744] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:24 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:25.426314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:25.427037 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:25.433317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.433820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.434297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.435008 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:25.435483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:25.435914 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:25.582829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:25.590500 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ccaa9a4e-9ece-404e-88df-65324b795ff2 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.170095 Oct 04 19:10:25.591071 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3926/7745] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:25 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:26.613968 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:26.614611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:26.621509 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.622114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.622560 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.623266 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:26.623725 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:26.624710 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:26.767512 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:26.775358 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-99e750a3-98cc-4c8a-a976-2114ffdaffcd tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.165356 Oct 04 19:10:26.775930 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3820/7746] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:26 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:27.799246 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:27.799858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:27.807135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.807636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.808145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.808861 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:27.809337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:27.809780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:27.947046 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:27.955645 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a3a9abeb-d578-4f0f-b66e-79d2b7d4c8bb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.160599 Oct 04 19:10:27.956220 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3927/7747] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:27 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:28.756308 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7135a1-4fcf-4641-b4fd-7cdd11374a5d", "name": "network-vif-plugged", "status": "completed", "tag": "32b8050b-df97-4740-9595-d4a7950c056e"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:28.767852 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.768349 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.768797 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.781178 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] Creating event network-vif-plugged:32b8050b-df97-4740-9595-d4a7950c056e for instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d on n-h2-831194-21 Oct 04 19:10:28.786286 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-1acdb4d2-feb0-4d56-9023-01a720535cb9 req-e2dc1d36-ec1c-4735-beb9-b5448a6fd7c4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 Oct 04 19:10:28.786919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3821/7748] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:10:28.977871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:28.978539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:28.986484 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.987048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.987516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:28.988240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:28.988717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:28.989168 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:29.131087 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:29.138703 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54630d6a-1950-4123-9f7a-070713c64ccb tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1391 microversion: 2.1 time: 0.164785 Oct 04 19:10:29.139272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3928/7749] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:28 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:30.163996 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:30.164699 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:30.166657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:30.173085 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.173515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.174002 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.174709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.175167 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.175599 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.310676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.318605 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-52761ae0-a349-4a7e-a742-30240809b036 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1564 microversion: 2.1 time: 0.159694 Oct 04 19:10:30.319185 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3822/7750] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:30 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:30.342039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:30.343253 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:30.350401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.350982 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.351542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.352280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:30.352757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:30.353204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:30.496974 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:30.505398 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-884a3fa1-c73c-4e95-8961-a98b18c96102 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1564 microversion: 2.1 time: 0.167245 Oct 04 19:10:30.506002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3929/7751] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:30 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:32.538808 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:10:32.539579 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:32.541599 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7135a1-4fcf-4641-b4fd-7cdd11374a5d", "tag": "32b8050b-df97-4740-9595-d4a7950c056e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:32.542912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:32.549092 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:32.550361 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:32.551624 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.552777 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.553629 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.554665 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.555175 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.555654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.558758 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:32.559446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:32.559962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:32.572454 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] Creating event network-changed:32b8050b-df97-4740-9595-d4a7950c056e for instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d on n-h2-831194-21 Oct 04 19:10:32.578670 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6ff1c72d-9b0e-4f38-af28-467af36dfcd6 req-2a22b208-b5a4-483c-9ea7-12e473589202 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041852 Oct 04 19:10:32.579746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3930/7752] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:10:32.727845 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:10:32.737783 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-392ab344-cf08-4eb0-a063-395bdc843eff tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1564 microversion: 2.1 time: 0.203926 Oct 04 19:10:32.738413 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3823/7753] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:10:32 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1564 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:10:56.012045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:56.012928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:10:56.018241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:10:56.020481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:10:56.027984 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.028482 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.028937 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.029669 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:10:56.031120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:10:56.031560 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:10:56.107427 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-42424997-f156-4283-b5d0-8949d6b3fc08 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action" status: 200 len: 24570 microversion: 2.1 time: 0.096925 Oct 04 19:10:56.108591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3931/7754] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:10:56 2022] POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action => generated 24570 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:11:02.617742 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:02.618381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.620284 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:02.621008 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:02.627552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.628048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.628496 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.629201 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.629664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.630127 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.663035 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lazy-loading 'flavor' on Instance uuid af7135a1-4fcf-4641-b4fd-7cdd11374a5d {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:11:02.741809 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a128af1-20df-42b0-8049-212390b0f81b tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.128118 Oct 04 19:11:02.742477 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3824/7755] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:02 2022] POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:11:02.752264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:02.752979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:02.760872 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.761495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.762029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.762763 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:02.763309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:02.763751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:02.898950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:02.907123 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d109ce7-f121-4b07-ba15-8d6071fcba85 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1690 microversion: 2.1 time: 0.159935 Oct 04 19:11:02.907684 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3932/7756] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:02 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:03.933247 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:03.934055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:03.941390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.941910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.942357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:03.943067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:03.943530 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:03.943960 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:04.085748 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:04.094495 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3c50caa6-f439-48ee-9b7e-723c2da5019d tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1673 microversion: 2.1 time: 0.166556 Oct 04 19:11:04.095157 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3825/7757] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:03 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:05.193896 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:05.196093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.204725 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.205242 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.205700 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.206451 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.206928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.207375 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.269985 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-7fae24d3-5815-415a-9930-8ffd61f719f0 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action" status: 200 len: 35096 microversion: 2.1 time: 0.080022 Oct 04 19:11:05.270638 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3933/7758] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:05 2022] POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action => generated 35096 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:11:05.283982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:05.284513 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.291286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.291771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.292210 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.292901 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.293357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.293786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.359622 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6bb6096d-c7c6-446b-b503-2ef479eed0d4 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action" status: 202 len: 0 microversion: 2.1 time: 0.080171 Oct 04 19:11:05.360406 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3826/7759] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:05 2022] POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:11:05.369588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:05.369792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:05.378245 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.379074 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.379548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.380280 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:05.380759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:05.381231 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:05.624550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:05.632485 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c2f0b57d-2410-4b8a-8648-846e7dbed896 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1679 microversion: 2.1 time: 0.267703 Oct 04 19:11:05.633123 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3934/7760] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:05 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1679 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:06.660432 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:06.661130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:06.667410 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.667896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.668333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.669024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:06.669477 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:06.669924 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:06.805701 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:06.813462 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-621cbe14-1d84-48cf-99d6-c327b2fabc07 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1679 microversion: 2.1 time: 0.158926 Oct 04 19:11:06.814060 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3827/7761] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:06 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:11:07.840667 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:07.841327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:07.849874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.850460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.851007 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.851828 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:07.852347 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:07.852864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:07.996870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:08.004854 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1b6176d5-0c65-49ef-b373-449fefc1778c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1682 microversion: 2.1 time: 0.168475 Oct 04 19:11:08.005418 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3935/7762] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:07 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:08.102366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:08.104473 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:08.111588 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.112072 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.112514 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.113207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:08.113654 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:08.114124 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:08.182281 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9936e5c9-a0d4-4c55-a52e-ca2fed45c53f tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action" status: 200 len: 35096 microversion: 2.1 time: 0.083707 Oct 04 19:11:08.182937 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3828/7763] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:11:08 2022] POST /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d/action => generated 35096 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 04 19:11:09.203954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.204469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.211299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7135a1-4fcf-4641-b4fd-7cdd11374a5d", "tag": "32b8050b-df97-4740-9595-d4a7950c056e"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:09.224713 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.225243 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.225709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.226495 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.227446 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.227597 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.228752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.229248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.229706 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.242407 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] Creating event network-changed:32b8050b-df97-4740-9595-d4a7950c056e for instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d on n-h2-831194-21 Oct 04 19:11:09.247375 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-36e26021-1802-4199-843b-aee629dd57f6 req-e924e977-e8d9-47fa-bc26-251cfbc873dc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040025 Oct 04 19:11:09.248279 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3829/7764] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:09.256328 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:11:09.339283 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0bf702d-d109-4273-b933-d7d416d0ece8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 204 len: 0 microversion: 2.1 time: 0.139417 Oct 04 19:11:09.344027 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3936/7765] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:11:09 2022] DELETE /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:11:09.350648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:09.351366 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:09.359091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.359595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.360150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.360869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:09.361331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:09.361781 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:09.504956 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:09.512798 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6e9eb3c4-3dee-49e7-883b-4ea2fac0e753 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1688 microversion: 2.1 time: 0.166913 Oct 04 19:11:09.513809 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3830/7766] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:09 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:10.537950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:10.538672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:10.546997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.547509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.547975 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.548697 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:10.549174 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:10.549638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:10.685106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:10.694089 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-333aa367-3d14-471f-962a-d40d6c10ea40 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1688 microversion: 2.1 time: 0.160493 Oct 04 19:11:10.694670 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3937/7767] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:10 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:11.721144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:11.721693 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7135a1-4fcf-4641-b4fd-7cdd11374a5d", "name": "network-vif-deleted", "tag": "32b8050b-df97-4740-9595-d4a7950c056e"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:11.722097 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:11.730402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.731045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.731645 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.732457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.733637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.734402 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.739731 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:11.740237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:11.740716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:11.753227 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] Creating event network-vif-deleted:32b8050b-df97-4740-9595-d4a7950c056e for instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d on n-h2-831194-21 Oct 04 19:11:11.759026 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2d9a0e7c-f6e0-48fb-a1c4-59bf2bb342d3 req-bd40776b-6279-49ec-939d-c5594bb77f80 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041790 Oct 04 19:11:11.759805 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3938/7768] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:11:11.807163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93276379bf2b4dcda083b892bf0e6518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ee0d18f6a7a4e3a90f152654e36cfb9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:11.815396 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2421bba8-c8bd-49a7-a0f4-f9c5cb5015f8 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 200 len: 1502 microversion: 2.1 time: 0.100590 Oct 04 19:11:11.815990 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3831/7769] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:11 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 1502 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:12.841423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:12.842749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] [instance: af7135a1-4fcf-4641-b4fd-7cdd11374a5d] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:12.850077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.850582 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.851068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.851777 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:12.852250 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:12.852963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:12.867268 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] HTTP exception thrown: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Request method failure captured: Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d HTTP/1.1 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIOIaonZfVtiCZcxjbfUh-aLHpQNYmqf-3e1wnuAoTMieQIwR64Q1YRACc1yytYac4fxEDpLMtKYTx6FRF2uPQTfRgoxbZjGI6120R9G23oxUJYP6qjX4FREVW6CR7d2lN9OcJ3JKf0CNJW1XyrGaVWIgcq-ZAPguxYRhVMEz-jwqSY Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1ee0d18f6a7a4e3a90f152654e36cfb9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 1ee0d18f6a7a4e3a90f152654e36cfb9 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1904176986 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 93276379bf2b4dcda083b892bf0e6518 Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1904176986-project Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'af7135a1-4fcf-4641-b4fd-7cdd11374a5d'} Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:11:12.868951 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Returning 404 to user: Instance af7135a1-4fcf-4641-b4fd-7cdd11374a5d could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ef842161-6b3e-4dc5-b7fe-1230ed591446 tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d" status: 404 len: 111 microversion: 2.1 time: 0.033291 Oct 04 19:11:12.874680 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3939/7770] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:12 2022] GET /compute/v2.1/servers/af7135a1-4fcf-4641-b4fd-7cdd11374a5d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:11:16.292653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03ab27c0-103d-41dc-9537-5b664c3c138c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] Calling method '.version_select at 0x7fbdbc60e1f0>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:16.314926 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03ab27c0-103d-41dc-9537-5b664c3c138c tempest-TestNetworkAdvancedServerOps-1904176986 tempest-TestNetworkAdvancedServerOps-1904176986-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1283964229" status: 202 len: 0 microversion: 2.1 time: 0.026304 Oct 04 19:11:16.315570 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3832/7771] 10.222.0.42 () {58 vars in 1284 bytes} [Tue Oct 4 19:11:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1283964229 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:11:28.152153 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:28.152922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:28.427459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b60da424-8dee-4fb5-9107-cf1ef0426bf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'create', calling method: .version_select at 0x7fbdbc49c160>, body: {"keypair": {"name": "tempest-TestShelveInstance-468854940", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIipnSL4d0RMdGH5foPsNFZ6LUfMFt8aOanNZATvY7G2YXWyuU561lnkwiInlVQQMt/a2gZ/Z80EvLXhMsMPwS41EhFuEP64JgmWKigmajZVDjOfEghT9URdvYbg1ar4w=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:28.445407 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b60da424-8dee-4fb5-9107-cf1ef0426bf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:11:28.451172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-b60da424-8dee-4fb5-9107-cf1ef0426bf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for user 11c83deb8a3b49e58e41f497e1c5f48b and project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:11:28.484941 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b60da424-8dee-4fb5-9107-cf1ef0426bf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.338334 Oct 04 19:11:28.485570 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3940/7772] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:11:28 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:29.570890 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:29.572255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:29.578383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-6877375", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-468854940", "security_groups": [{"name": "tempest-secgroup-smoke-2086487235"}], "networks": [{"uuid": "5b9c8570-1a78-48ad-bffa-8734152ef508"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:29.705724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] validate_networks() for [('5b9c8570-1a78-48ad-bffa-8734152ef508', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:11:30.221621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:11:30.222081 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:11:30.222730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:11:30.224244 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:11:30.224667 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:11:30.233821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:30.234339 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:30.234798 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:30.235524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:30.235982 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:30.236407 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:30.254088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:11:30.259452 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for user 11c83deb8a3b49e58e41f497e1c5f48b and project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:11:30.272737 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:11:30.275090 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:11:30.328304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b86454e8-4144-41c7-8d10-88dc3a2df04f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.759123 Oct 04 19:11:30.329889 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3833/7773] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:11:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:11:30.343563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0ffc282b-22c2-42cb-bb66-46ae4cdb8eca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:30.344100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0ffc282b-22c2-42cb-bb66-46ae4cdb8eca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:30.420070 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0ffc282b-22c2-42cb-bb66-46ae4cdb8eca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:30.431433 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0ffc282b-22c2-42cb-bb66-46ae4cdb8eca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1243 microversion: 2.1 time: 0.093035 Oct 04 19:11:30.432312 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3941/7774] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:30 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:31.456597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:31.457223 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:31.464793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:31.465429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:31.465897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:31.466611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:31.467148 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:31.468055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:31.546293 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:31.556595 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-200468f5-16fc-43f3-a7eb-c198bd79f82d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1295 microversion: 2.1 time: 0.105431 Oct 04 19:11:31.557310 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3834/7775] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:31 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:32.583121 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:32.583732 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:32.592148 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.592648 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.593100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.593818 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:32.594314 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:32.594749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:32.676149 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:32.686691 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4d066c57-0aaf-44db-82fd-cbedfd1f27d5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1301 microversion: 2.1 time: 0.106872 Oct 04 19:11:32.687296 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3942/7776] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:32 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:33.632261 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:33.645212 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:33.645697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:33.646751 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:33.661379 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] Creating event network-changed:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h1-831194-21 Oct 04 19:11:33.667721 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2a8dccd6-64fa-4e11-a421-e0ecca4c5a22 req-ba19781d-a3d0-42bb-9a0a-b05f8b33908f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039313 Oct 04 19:11:33.668497 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3835/7777] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:33.714342 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:33.715420 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:33.731417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:33.731997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:33.732497 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:33.734494 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:33.734979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:33.736061 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:33.950354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:33.959991 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8a473812-d3c0-4182-9602-2e1fd8613927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.251269 Oct 04 19:11:33.960571 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3943/7778] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:33 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:34.987133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:34.988026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:34.994405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:34.994906 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:34.995353 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:34.996058 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:34.996522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:34.996957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:35.144735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:35.153197 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-163a0af2-0c8c-4fee-acc1-35985a6e0941 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.172243 Oct 04 19:11:35.153806 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3836/7779] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:34 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:36.176760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:36.177336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:36.184401 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:36.184909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:36.185367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:36.186664 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:36.187181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:36.187636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:36.324634 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:36.333345 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c6aef360-2d4f-42bf-93a6-af12856830bd tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.160644 Oct 04 19:11:36.333935 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3944/7780] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:36 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:37.356183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:37.356793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:37.363779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:37.364260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:37.364692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:37.365375 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:37.365844 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:37.366274 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:37.512390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:37.521018 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-de9e12d6-f4f4-4602-be20-affc9d33fe7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.168787 Oct 04 19:11:37.521591 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3837/7781] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:37 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:38.544813 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:38.546126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:38.553054 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:38.553554 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:38.554060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:38.554775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:38.555244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:38.555679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:38.583965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "name": "network-vif-plugged", "status": "completed", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:38.597345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:38.597856 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:38.598415 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:38.610965 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] Creating event network-vif-plugged:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h1-831194-21 Oct 04 19:11:38.616409 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-aaf4ed50-8afd-4997-9caa-4c42b9651000 req-ce47744a-7f9d-4bad-a79e-d76c6761d7cb service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036153 Oct 04 19:11:38.617303 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3838/7782] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:11:38.739255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:38.747351 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-e0f8e888-a98e-4818-a659-1be3cc7401db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.206500 Oct 04 19:11:38.747932 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3945/7783] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:38 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:39.772583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:39.773324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:39.780558 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:39.781045 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:39.781487 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:39.782462 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:39.782919 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:39.783373 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:39.926499 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:39.934463 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47cee510-27dc-45a7-8d23-e3dc5c4b69ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1369 microversion: 2.1 time: 0.167427 Oct 04 19:11:39.935053 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3839/7784] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:39 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:40.957796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:40.958471 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:40.961155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:40.967698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:40.968233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:40.968698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:40.969459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:40.969973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:40.970455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:41.104022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:41.112840 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f9db817a-1b6c-494c-bd33-d2e68e6df836 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1553 microversion: 2.1 time: 0.158957 Oct 04 19:11:41.113413 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3946/7785] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:40 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:41.135780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:11:41.136392 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:11:41.138355 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:41.139068 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=6 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:11:41.145617 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:41.146133 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:41.146566 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:41.147255 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:41.147713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:41.148138 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:41.288157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:11:41.297614 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5c9983fd-e80b-4d3f-be31-a91c6c4b563d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1553 microversion: 2.1 time: 0.165636 Oct 04 19:11:41.298222 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3840/7786] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:11:41 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:11:43.359959 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:11:43.369540 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:11:43.370071 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:11:43.370524 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:11:43.382614 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] Creating event network-changed:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h1-831194-21 Oct 04 19:11:43.387764 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-6ec4a149-3391-4016-ba29-be9448cf521b req-f1f8eebd-ff9b-4506-889a-bb0b9c21cad5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092353 Oct 04 19:11:43.388395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3947/7787] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:13:39.688406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:39.689362 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=36 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:39.695923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:39.696482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:39.704582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.705076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.705525 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.706269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:39.706734 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:39.707169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:39.731447 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lazy-loading 'flavor' on Instance uuid 3c500177-fbdb-446a-8573-1d19f67b10ee {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:13:40.070745 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89f876b8-a4c8-43e6-a6c0-40d7af23d40d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee/action" status: 202 len: 0 microversion: 2.1 time: 0.384063 Oct 04 19:13:40.071348 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3841/7788] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:13:39 2022] POST /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:13:40.079051 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:13:40.081319 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] AMQP server on 10.222.0.42:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 04 19:13:40.082742 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:13:40.082918 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:13:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee (ip 10.222.0.42) !!! Oct 04 19:13:40.086387 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:40.087187 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=32 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:13:40.094788 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:40.095705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:40.110130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:40.110590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:40.111052 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:40.111785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:40.112264 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:40.112721 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:40.307081 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:40.315284 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-af9d6144-141c-445b-8fd0-3b5b662e28f2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.238698 Oct 04 19:13:40.315862 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3948/7789] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:40 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:41.342059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:41.342693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:41.351662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:41.352159 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:41.352610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:41.353314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:41.353775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:41.354238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:41.496311 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:41.504071 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5132b75-3831-492f-94b4-248ac0ccbe81 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.167723 Oct 04 19:13:41.504640 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3842/7790] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:41 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:42.527934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:42.528573 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:42.541102 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:42.541610 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:42.542106 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:42.542921 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:42.543398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:42.543841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:42.549451 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42094. Oct 04 19:13:42.551978 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42096. Oct 04 19:13:42.683440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:42.691299 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-baa5cb5f-4df5-41a3-abe3-9fd146cba5ad tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.167349 Oct 04 19:13:42.691872 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3949/7791] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:42 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:43.714984 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:43.715603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:43.722529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:43.723017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:43.723455 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:43.724149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:43.724609 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:43.725037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:43.864334 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:43.872172 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42093ffa-8f1c-4940-963a-ab35553a83e5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.161115 Oct 04 19:13:43.872742 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3843/7792] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:43 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:44.897694 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:44.898517 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:44.905503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:44.906047 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:44.906508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:44.907228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:44.908006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:44.908155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:45.047300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:45.055325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f467bae3-0942-4872-82eb-c274c5dabd2e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.161590 Oct 04 19:13:45.055907 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3950/7793] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:44 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:46.079121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:46.079716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:46.086625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.087110 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.087546 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.088237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:46.088693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:46.089115 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:46.224497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:46.232941 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-aa057e9e-141a-4cee-b412-d7fb37c38124 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.157784 Oct 04 19:13:46.233512 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3844/7794] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:46 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:47.257329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:47.258012 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:47.265000 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.265506 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.265993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.266708 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:47.267181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:47.267627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:47.400223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:47.408172 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9f884393-46d4-431a-9808-93eeb181a750 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.155435 Oct 04 19:13:47.408819 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3951/7795] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:47 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:48.432381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:48.433034 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:48.439800 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:48.440292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:48.440722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:48.441414 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:48.441895 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:48.442329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:48.578720 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:48.586991 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a113e281-8051-4a82-8aaa-3bc321f50e3e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.158787 Oct 04 19:13:48.587567 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3845/7796] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:48 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:49.610848 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:49.611462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:49.618941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:49.619467 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:49.619919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:49.620617 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:49.621082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:49.621520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:49.753455 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:49.761911 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b2343a9f-1d78-4f46-9c0c-a2822722350b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.154894 Oct 04 19:13:49.766719 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3952/7797] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:49 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:50.785664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:50.786450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:50.793615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.794207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.794656 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.795369 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:50.795871 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:50.796913 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:50.936183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:50.944105 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-42cc1c03-9f01-4663-a53b-3bfafbcb11eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1699 microversion: 2.1 time: 0.162642 Oct 04 19:13:50.945414 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3846/7798] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:50 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:51.968785 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:51.969406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:51.977443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:51.977986 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:51.978443 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:51.979157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:51.979636 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:51.980107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:52.120017 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:52.128154 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a3d303ac-177a-4e4c-bd0b-4ce4d7e2554b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1699 microversion: 2.1 time: 0.163294 Oct 04 19:13:52.128722 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3953/7799] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:51 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1699 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:53.153772 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:53.154417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:53.163119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:53.164383 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:53.164888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:53.166108 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:53.166750 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:53.167184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:53.406614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "name": "network-vif-plugged", "status": "completed", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:13:53.415050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:53.424237 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:53.425132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:53.425858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:53.433910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d51ceb5e-327e-43f4-9610-ef64530f8ff7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.283890 Oct 04 19:13:53.449863 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3847/7800] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:53 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:53.450159 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] Creating event network-vif-plugged:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h1-831194-21 Oct 04 19:13:53.453360 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-46b52f6e-13cb-490a-af51-bc91170e1449 req-3dd16771-4241-46ae-a674-d20d743a3b09 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156907 Oct 04 19:13:53.454479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3954/7801] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:13:54.481236 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:54.482837 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:54.490380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.491834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.492589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:54.493625 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:54.494198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:54.494712 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:54.689495 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:54.698873 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b6779ff-e78b-4643-95a8-4d008ffdda8f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.221782 Oct 04 19:13:54.700174 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3848/7802] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:54 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:55.725658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:55.726717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:55.733396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:55.733949 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:55.734405 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:55.735158 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:55.735637 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:55.736088 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:55.891699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:55.902545 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8d1ab2d9-fb46-4a80-8414-1c4e42f75cf9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.182206 Oct 04 19:13:55.903124 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3955/7803] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:55 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:56.929306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:56.930208 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:56.938475 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:56.939302 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:56.939947 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:56.940864 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:56.941502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:56.941954 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:57.120411 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:57.128915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5f3506d1-6bb2-41b5-a4a7-0efd2af6ba63 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.203635 Oct 04 19:13:57.129782 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3849/7804] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:56 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:58.156776 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:58.158066 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:58.166734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.167239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.167698 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.168410 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:58.169118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:58.169565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:58.327971 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:58.336733 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a0f6017e-ada3-46cc-be43-f0e77d04d678 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.186898 Oct 04 19:13:58.337250 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3956/7805] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:58 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:13:59.363741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:13:59.365165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:13:59.372286 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.372933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.373449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.374425 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:13:59.375111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:13:59.375634 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:13:59.527623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:13:59.538000 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-37b6cfd8-cf33-40bf-a5af-38532c44422d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.177860 Oct 04 19:13:59.539439 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3850/7806] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:13:59 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:00.571927 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:00.573355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:00.580400 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.580907 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.581371 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:00.582135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:00.582613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:00.583793 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:00.743120 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:00.751255 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ccadb3b2-7a1f-4939-9af7-cb80850c9370 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.186728 Oct 04 19:14:00.751832 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3957/7807] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:00 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:01.781169 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:01.781775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:01.789724 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.790345 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.790780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.791489 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:01.791952 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:01.792385 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:01.949190 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:01.957428 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-6d076637-2b76-4d26-8dc8-e74a874d0765 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1694 microversion: 2.1 time: 0.180429 Oct 04 19:14:01.958090 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3851/7808] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:01 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:02.987422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:02.988080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:02.995329 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:02.995847 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:02.996305 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:02.997028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:02.997504 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:02.997978 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:03.201079 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:03.208919 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-87289227-a8b4-453c-9b13-57152112a351 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1676 microversion: 2.1 time: 0.225708 Oct 04 19:14:03.210023 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3958/7809] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:02 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1676 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:04.233450 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:04.234101 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:04.241809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.242409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.242854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.243561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:04.244023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:04.244454 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:04.380714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:04.389547 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ab93426d-68ca-4dd1-9d79-2f9248aafec2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1676 microversion: 2.1 time: 0.159941 Oct 04 19:14:04.390175 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3852/7810] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:04 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:05.299550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "name": "network-vif-unplugged", "status": "completed", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:05.314908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.315469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.316107 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.330205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_external_events [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] Unable to find a host for instance 3c500177-fbdb-446a-8573-1d19f67b10ee. Dropping event network-vif-unplugged {{(pid=128849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:14:05.331148 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-40cb33ae-c62d-493b-a2e3-72e6b0a4c466 req-6d73fe12-eb17-4fa1-9ead-fe4f76f55696 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035717 Oct 04 19:14:05.331742 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3959/7811] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:14:05.412910 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:05.413531 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:05.420517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.421007 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.421449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.422197 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.422657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.423088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.561486 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:05.569345 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4ac9b5e7-e144-4def-876e-a41efd26e6ec tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1619 microversion: 2.1 time: 0.160585 Oct 04 19:14:05.570398 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3853/7812] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:05 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1619 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:05.592705 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:05.593325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:05.599391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.599892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.600866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.601577 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.602093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.602534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.688890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128849) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:14:05.757678 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-640f1afc-3e4b-4f53-86d9-559f18fb7322 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee/action" status: 202 len: 0 microversion: 2.1 time: 0.168775 Oct 04 19:14:05.758250 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3960/7813] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:14:05 2022] POST /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:14:05.766429 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:05.767055 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:05.773154 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.773802 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.774464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.775172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:05.775630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:05.776053 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:05.923245 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:05.933298 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-33d3d51b-3dca-4f38-860e-1f35cbf9e8f1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1627 microversion: 2.1 time: 0.170700 Oct 04 19:14:05.933957 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3854/7814] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:05 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1627 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:14:06.958483 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:06.959119 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:06.965325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.965860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.966307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:06.967018 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:06.967518 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:06.967979 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:07.115278 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:07.124442 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-feccc7b6-abe5-4427-ac92-709c6c07eb0f tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.170776 Oct 04 19:14:07.125016 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3961/7815] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:06 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:07.995451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:08.013029 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:08.013883 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:08.027821 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:08.043497 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] Creating event network-changed:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h2-831194-21 Oct 04 19:14:08.050915 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-ca09e2ba-5758-4a71-b797-b5c5ff3d2a62 req-b192d8de-2318-49a1-88d9-12c7fe9bfa9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061073 Oct 04 19:14:08.051778 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3855/7816] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:08.151775 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:08.153312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:08.160820 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:08.161422 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:08.161989 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:08.162798 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:08.163522 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:08.164277 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:08.298752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:08.307294 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-26baf109-f117-4a1a-a6f9-ec8bf38984e0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.159526 Oct 04 19:14:08.307978 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3962/7817] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:08 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:09.333669 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:09.335610 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:09.355168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.356022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.356812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.357911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:09.358615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:09.359290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:09.366086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:09.523589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:09.532201 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-89752ca3-8d9d-4ba0-b0ee-ea08e93e2c53 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.203908 Oct 04 19:14:09.545320 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3856/7818] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:09 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:10.561932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:10.562691 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:10.565619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:10.572132 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.572654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.573110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.573842 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:10.574321 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:10.574782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:10.578588 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:10.717764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:10.729223 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-78029609-a93f-413e-ba9e-45bf89aaa110 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.171606 Oct 04 19:14:10.730044 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3963/7819] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:10 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:11.753143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:11.754194 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:11.757231 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=33 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:14:11.764319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.764832 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.765279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.766091 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:11.766568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:11.766995 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:11.915042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:11.923457 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-921d4733-1474-4bb8-9672-6760c069c083 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.174174 Oct 04 19:14:11.924225 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3857/7820] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:11 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:12.948589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:12.949229 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:12.956084 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.956602 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.957138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:12.958211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:12.958795 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:12.959354 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:13.139892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:13.153106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0056b530-9adc-40ec-8941-18a983c35bab tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.208954 Oct 04 19:14:13.153705 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3964/7821] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:12 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:14.177992 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:14.178648 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:14.186205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.186700 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.187143 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.188166 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:14.188626 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:14.189059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:14.342111 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:14.350943 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3a8200f3-4ad0-44eb-a27a-098b00efc65e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.176981 Oct 04 19:14:14.351783 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3858/7822] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:14 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:15.376946 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:15.377625 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:15.385043 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.385545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.386033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.386743 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:15.387211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:15.387654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:15.554077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:15.563983 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-981785fb-9d34-485a-bd06-6fad8d8481c7 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.190864 Oct 04 19:14:15.565864 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3965/7823] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:15 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:16.589174 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:16.589782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:16.596938 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:16.597430 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:16.597897 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:16.598603 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:16.599073 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:16.599506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:16.734363 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:16.742296 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4b40951-7f0c-48a1-a4f3-073038b20da4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.158058 Oct 04 19:14:16.743060 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3859/7824] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:16 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:17.766294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:17.766942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:17.774360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.775614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.776239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.776943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:17.777408 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:17.777863 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:17.913805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:17.922302 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee5785ed-c9b6-4489-91e3-480d7fd0b469 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.159849 Oct 04 19:14:17.922880 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3966/7825] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:17 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:18.946114 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:18.946769 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:18.954067 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.954564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.955010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:18.955717 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:18.956185 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:18.956619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:19.094191 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:19.102386 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-03106015-cc6e-4655-bf68-db279ddb1d17 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.159700 Oct 04 19:14:19.102901 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3860/7826] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:18 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:20.127337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:20.127337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:20.133649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:20.134379 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:20.134841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:20.135764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:20.137394 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:20.140363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:20.274915 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:20.283711 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-99730fcc-994f-4930-bf39-49beb6207ca1 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.161781 Oct 04 19:14:20.284299 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3967/7827] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:20 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:21.308120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:21.308814 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:21.316268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:21.316763 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:21.317207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.317937 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:21.318399 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:21.318830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.483859 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:21.491522 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8b276194-b9ce-4a49-8968-283123b51953 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.187482 Oct 04 19:14:21.492091 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3861/7828] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:21 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:21.904723 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "name": "network-vif-plugged", "status": "completed", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:14:21.916503 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:21.916972 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:21.917435 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:21.929204 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] Creating event network-vif-plugged:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h2-831194-21 Oct 04 19:14:21.935125 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-51173a30-701e-452e-aeb2-18070c59481c req-2d59eb6f-0968-4e32-bf73-ff1d25bc894c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034198 Oct 04 19:14:21.935934 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3968/7829] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:14:22.515325 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:22.516042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:22.524827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.526554 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.527168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.527911 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:22.528386 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:22.528824 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:22.661250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:22.669741 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-57e74dd9-d314-4022-b1db-3391afacde3d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.158234 Oct 04 19:14:22.670288 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3862/7830] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:22 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:23.694879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:23.695605 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:23.703241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.703759 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.704217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.704957 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:23.705430 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:23.705899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:23.849538 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:23.861181 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-48d5a92b-dcf7-4e56-9823-195fb03fc2e6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1685 microversion: 2.1 time: 0.171861 Oct 04 19:14:23.861987 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3969/7831] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:23 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:14:24.886561 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:14:24.887389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:14:24.896344 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.896842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.897291 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:24.898050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:14:24.898507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:14:24.898936 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:14:25.057466 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:14:25.065512 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1800cc96-5744-4880-9b44-d8414d72ac6a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1672 microversion: 2.1 time: 0.183148 Oct 04 19:14:25.066118 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3863/7832] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:14:24 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:37.371161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=13 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:37.371928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=37 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:37.373248 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:15:37.373412 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:15:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee (ip 10.222.0.42) !!! Oct 04 19:15:37.383589 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:37.385333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:37.385999 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:37.392739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=13 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:37.393932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=46 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:37.394964 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.395684 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.396001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.396936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.397418 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.397900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.411663 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.412595 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.413198 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.430209 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] Creating event network-changed:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h2-831194-21 Oct 04 19:15:37.432477 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:15:37.436791 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-8ea4d4b1-7ec2-4b94-a63e-8ececd909392 req-583947ac-96eb-4cfb-877c-0293d739b273 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059246 Oct 04 19:15:37.437939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3864/7833] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:37.531417 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-49ce913d-67ab-4dec-ac79-196f67d9ec7a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 204 len: 0 microversion: 2.1 time: 0.162513 Oct 04 19:15:37.533977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3970/7834] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:15:37 2022] DELETE /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:15:37.543331 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:37.544037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:37.550283 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.550771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.551206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.551904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:37.552357 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:37.552780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:37.693069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:37.701740 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1ddec921-bc9e-43ff-b840-0a506d0071db tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.164738 Oct 04 19:15:37.702353 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3865/7835] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:37 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:38.726282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:38.727129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:38.734626 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:38.735129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:38.735586 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:38.736297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:38.736772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:38.737217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:38.876641 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:38.884532 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-054730f8-070f-47d5-b009-4c9f26eab337 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1678 microversion: 2.1 time: 0.162533 Oct 04 19:15:38.885163 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3971/7836] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:38 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:39.483048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c500177-fbdb-446a-8573-1d19f67b10ee", "name": "network-vif-deleted", "tag": "a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:39.494270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.494749 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.495268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.507304 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] Creating event network-vif-deleted:a8d8ec99-8bf0-481e-b40e-6b4b9bf4dce6 for instance 3c500177-fbdb-446a-8573-1d19f67b10ee on n-h2-831194-21 Oct 04 19:15:39.512471 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-a17300f9-9d37-4bad-a247-931f7852f3a3 req-2ea1f91a-4901-4579-a918-a5a6b31b765d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034674 Oct 04 19:15:39.513072 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3866/7837] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:15:39.908650 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:39.916658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:39.923884 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.924392 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.924843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.925557 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.926058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.926502 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.960942 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:39.961475 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:39.961976 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:39.962449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.objects.instance [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lazy-loading 'fault' on Instance uuid 3c500177-fbdb-446a-8573-1d19f67b10ee {{(pid=128849) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:15:40.004859 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:40.015849 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d48f8567-4bd0-47f3-a320-94521adfb3f9 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 200 len: 1333 microversion: 2.1 time: 0.111079 Oct 04 19:15:40.016442 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3972/7838] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:39 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 1333 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:15:41.040708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:41.042235 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: 3c500177-fbdb-446a-8573-1d19f67b10ee] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:41.048382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:41.048888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:41.049324 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:41.050038 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:41.050494 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:41.050922 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:41.064576 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.wsgi [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] HTTP exception thrown: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Request method failure captured: Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: request: GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee HTTP/1.1 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Accept: application/json Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Accept-Encoding: identity Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Connection: close Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Content-Length: 0 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Content-Type: application/json Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Host: 10.222.0.42 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: Openstack-System-Scope: None Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: User-Agent: python-urllib3/1.26.12 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Auth-Token: gAAAAABjPIVaHsFcvYSQiZ1zA_LW5ZrosnGh2oMXL7UEl9PPGrUXuBnYe5XC98QHjfpbZ2CZGwlqLUs_a8OFP8dDH1KlHfme_ItmozuJAy2etL0bDVFlfM96d-6JXyHaFJBAVYMm3Z_zvUVfrZob9vPVBGQFNhhnSFxhZDsMb-rDjm737t5PVkE Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Id: None Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Domain-Name: None Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Identity-Status: Confirmed Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Is-Admin-Project: True Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Id: default Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Domain-Name: Default Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Id: 5e2ceaf6977b4a669a4617697d3b615e Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Project-Name: tempest-TestShelveInstance-768110405 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Role: member,reader Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Roles: member,reader Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant: tempest-TestShelveInstance-768110405 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Id: 5e2ceaf6977b4a669a4617697d3b615e Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-Tenant-Name: tempest-TestShelveInstance-768110405 Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-User: tempest-TestShelveInstance-768110405-project Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Id: default Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-User-Domain-Name: Default Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-User-Id: 11c83deb8a3b49e58e41f497e1c5f48b Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: X-User-Name: tempest-TestShelveInstance-768110405-project Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: method: > Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: exception: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: action_args: {'id': '3c500177-fbdb-446a-8573-1d19f67b10ee'} Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:15:41.066290 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: ERROR nova.api.openstack.wsgi Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Returning 404 to user: Instance 3c500177-fbdb-446a-8573-1d19f67b10ee could not be found. {{(pid=128850) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b8ce8034-b4f5-48cc-8841-39e73fcf4c99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee" status: 404 len: 111 microversion: 2.1 time: 0.032328 Oct 04 19:15:41.072026 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3867/7839] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:41 2022] GET /compute/v2.1/servers/3c500177-fbdb-446a-8573-1d19f67b10ee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:15:41.231883 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-23b449ae-99f0-41cb-a001-5065cdac471c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '.version_select at 0x7fbdbc492310>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:41.258067 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-23b449ae-99f0-41cb-a001-5065cdac471c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-468854940" status: 202 len: 0 microversion: 2.1 time: 0.029845 Oct 04 19:15:41.258825 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3973/7840] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 19:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-468854940 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:15:41.283884 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-068992dc-22be-4d46-91f3-16fd5046bd7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'create', calling method: .version_select at 0x7fbdbc6e18b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-729338609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH488/VA2J3vXON8Y80WcRWARV7pkhMWRnrz1nPsKt1dVhiLt3BnbDcpF/pj92E/b5vdOFRJlc1vb4mL5NCiJr9uPifKTjH7zwiBzTbgjTDdNrEi6CTrsy6/dmFXe+vcIQ=="}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:41.301921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-068992dc-22be-4d46-91f3-16fd5046bd7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:41.309556 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-068992dc-22be-4d46-91f3-16fd5046bd7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for user 11c83deb8a3b49e58e41f497e1c5f48b and project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'key_pairs'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:41.342689 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-068992dc-22be-4d46-91f3-16fd5046bd7d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.062679 Oct 04 19:15:41.343300 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3868/7841] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:15:41 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:15:58.632830 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:58.633757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:58.638031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1216341459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-729338609", "security_groups": [{"name": "tempest-secgroup-smoke-1608177902"}], "networks": [{"uuid": "5b9c8570-1a78-48ad-bffa-8734152ef508"}], "block_device_mapping_v2": [{"uuid": "f834a6da-0071-47ea-8578-32da5b9c896c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:15:58.760094 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] validate_networks() for [('5b9c8570-1a78-48ad-bffa-8734152ef508', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:15:59.470596 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:15:59.471060 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:15:59.471590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:15:59.472048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:15:59.472515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:15:59.481841 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.482360 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.482822 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.483575 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:15:59.484045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:15:59.484492 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:15:59.503203 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:15:59.508491 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Getting quotas for user 11c83deb8a3b49e58e41f497e1c5f48b and project 5e2ceaf6977b4a669a4617697d3b615e. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:15:59.570702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:15:59.574038 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f834a6da-0071-47ea-8578-32da5b9c896c',volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:15:59.718016 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-295cbd93-1351-46a6-8b18-e88d26e1a3b5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.086943 Oct 04 19:15:59.723609 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3974/7842] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:15:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:15:59.728018 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=12 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:59.728865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=4 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:59.730260 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:15:59.734343 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-68979657-b3f8-4d4d-bdad-97397a21bbfa tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:15:59.735041 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-68979657-b3f8-4d4d-bdad-97397a21bbfa tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:15:59.803866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-68979657-b3f8-4d4d-bdad-97397a21bbfa tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:15:59.810911 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-68979657-b3f8-4d4d-bdad-97397a21bbfa tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1088 microversion: 2.1 time: 0.084774 Oct 04 19:15:59.811721 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3869/7843] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:15:59 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:00.835751 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:00.836534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:00.846154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.846816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.847282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:00.848181 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:00.848672 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:00.849207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:00.926805 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:00.935548 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-61a35b28-5c53-4b5d-bd5f-82031d0498e2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1204 microversion: 2.1 time: 0.104449 Oct 04 19:16:00.936591 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3975/7844] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:00 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1204 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:01.960232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:01.961005 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:01.970149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.970149 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.970675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:01.972095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:01.972095 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:01.972321 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.130146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:02.138475 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-21ec6d00-4a94-4235-9127-bf4c0e03d980 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1272 microversion: 2.1 time: 0.182844 Oct 04 19:16:02.139063 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3870/7845] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:01 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1272 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:02.366955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:02.380282 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:02.381221 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:02.382150 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:02.397683 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] Creating event network-changed:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h1-831194-21 Oct 04 19:16:02.403604 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f38ee40a-5ed3-451f-a212-34b9a98cb9ca req-cbe9cf89-53d6-4907-a74f-f75fdba63367 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122998 Oct 04 19:16:02.404211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3976/7846] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:03.161398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:03.162046 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:03.169934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.170692 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.171125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.171827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:03.172270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:03.172879 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:03.319685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:03.331758 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1035479a-90fa-40de-a21e-f244e478215e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1272 microversion: 2.1 time: 0.173831 Oct 04 19:16:03.332681 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3871/7847] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:03 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:16:04.363049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:04.363049 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:04.371006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:04.371521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:04.371981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:04.372737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:04.373205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:04.373654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:04.545413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:04.553994 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a4357226-0dd5-4bc5-9838-97b400427085 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1272 microversion: 2.1 time: 0.197684 Oct 04 19:16:04.554918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3977/7848] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:04 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1272 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:05.578060 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:05.578684 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:05.585596 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:05.586120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:05.586564 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:05.587825 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:05.588491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:05.588928 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:05.729051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:05.737474 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b023b045-6b88-4963-85ea-e080f89f4510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1272 microversion: 2.1 time: 0.163235 Oct 04 19:16:05.738106 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3872/7849] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:05 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:06.761248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:06.761900 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:06.768802 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:06.769297 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:06.769745 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:06.770476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:06.770943 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:06.771376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:06.906609 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:06.914879 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eaf2127a-6e0c-48d2-aa1b-9cdd03f0ad7e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.157722 Oct 04 19:16:06.915977 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3978/7850] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:06 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:07.939032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:07.939577 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:07.947506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:07.948047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:07.948522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:07.949225 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:07.949687 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:07.950146 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:08.093623 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:08.101394 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ff49654c-dce1-4ef3-b9ca-5eaa1a92a913 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.166409 Oct 04 19:16:08.102000 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3873/7851] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:07 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:09.124662 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:09.125294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:09.132241 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:09.132740 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:09.133192 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:09.133922 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:09.134998 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:09.135445 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:09.272033 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:09.281069 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-8ca50fc2-9154-4349-a194-1e781d22ba7b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.160264 Oct 04 19:16:09.281725 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3979/7852] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:09 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:10.303216 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:10.303855 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:10.307156 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:10.312660 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:10.313142 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:10.313578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:10.314296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:10.314747 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:10.315168 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:10.456488 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:10.464894 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0b9eb6f0-e973-472d-ad1e-13e81009e7af tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.165569 Oct 04 19:16:10.465469 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3874/7853] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:10 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:11.489459 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:11.490133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:11.492113 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:11.492829 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:16:11.501040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:11.501570 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:11.502051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:11.502780 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:11.503260 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:11.503709 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:11.637527 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:11.645922 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-dd8da493-2c1d-4808-8fa9-93923c9cabd5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.160424 Oct 04 19:16:11.646544 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3980/7854] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:11 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:12.669888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:12.670464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:12.677269 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:12.677758 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:12.678229 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:12.678921 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:12.679380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:12.679809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:12.812017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:12.819647 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e54c0486-d156-4b8d-8609-6aa52f3209ca tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.154254 Oct 04 19:16:12.820219 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3875/7855] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:12 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:13.844804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:13.845717 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:13.853548 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:13.854376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:13.855701 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:13.856644 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:13.857201 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:13.857682 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:13.997251 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:14.005091 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-33fa1874-f608-4be7-8dfb-072f0585f927 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.166349 Oct 04 19:16:14.005662 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3981/7856] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:13 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:15.028017 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:15.028646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:15.035442 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:15.035925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:15.036361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:15.037076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:15.037533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:15.038240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:15.173250 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:15.181037 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a2e2568c-b8ac-4b9f-b8d7-8596402bcdb3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.156962 Oct 04 19:16:15.181873 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3876/7857] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:15 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:15.806652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "name": "network-vif-plugged", "status": "completed", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:15.818313 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:15.818808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:15.819266 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:15.832376 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] Creating event network-vif-plugged:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h1-831194-21 Oct 04 19:16:15.837350 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-f951817b-c112-414c-9bf2-3b69875ef8bc req-149d8b56-e045-49c6-a7f0-c296e1703781 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Oct 04 19:16:15.838133 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3982/7858] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:16:16.204866 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:16.205523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:16.212504 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:16.212997 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:16.213446 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:16.214731 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:16.215203 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:16.215638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:16.352694 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:16.360377 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-061366c1-c6bc-480f-b964-2d4cc6b8e9cc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1260 microversion: 2.1 time: 0.159505 Oct 04 19:16:16.360949 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3877/7859] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:16 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:17.383535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:17.384172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:17.394255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:17.394807 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:17.395265 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:17.395997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:17.396481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:17.396947 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:17.535481 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:17.543605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-6796c6dc-4795-4e3c-b91e-ac10901cd458 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1444 microversion: 2.1 time: 0.164449 Oct 04 19:16:17.544941 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3983/7860] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:17 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1444 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:17.568248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:16:17.568949 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:16:17.578485 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:17.578987 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:17.579467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:17.580183 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:17.580662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:17.581084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:17.713333 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:16:17.722035 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-706dc337-b652-4195-b4b7-5df6ea05b6f3 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1444 microversion: 2.1 time: 0.157872 Oct 04 19:16:17.722608 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3878/7861] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:16:17 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:16:19.334754 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:16:19.345198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:16:19.345711 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:16:19.346189 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:16:19.358139 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] Creating event network-changed:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h1-831194-21 Oct 04 19:16:19.363312 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-2a0adfe0-c0b8-41a4-abdc-efaaa207f565 req-284ded00-4de5-4de4-8ae8-78b0261eed19 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032165 Oct 04 19:16:19.363918 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3984/7862] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:15.496311 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:15.497215 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:18:15.501644 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=22 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:15.502400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=54 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:15.503296 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:18:15.503475 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:18:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action (ip 10.222.0.42) !!! Oct 04 19:18:15.504591 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 04 19:18:15.504758 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:18:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action (ip 10.222.0.42) !!! Oct 04 19:18:15.505623 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:18:15.505771 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:18:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action (ip 10.222.0.42) !!! Oct 04 19:18:15.564917 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:15.565464 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:15.572186 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.572677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.573119 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.573819 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.574309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.574740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.602729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lazy-loading 'flavor' on Instance uuid e0abe37a-6e4e-447c-8bbc-2f244dfb881a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:18:15.682503 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-30409d67-0906-44e7-ad3c-d857233b4924 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action" status: 202 len: 0 microversion: 2.1 time: 0.187654 Oct 04 19:18:15.683282 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3879/7863] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:18:15 2022] POST /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:15.690397 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:18:15.691213 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:18:15.691853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:15.692895 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=50 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:15.698932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:15.699614 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:15.709351 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.709876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.710327 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.711044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:15.711630 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:15.712423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:15.852791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:15.861377 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fb858ab7-8586-4a67-bfe7-0fa6bb53830c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.173135 Oct 04 19:18:15.861996 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3985/7864] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:15 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:16.887963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:16.889491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:16.901457 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42622. Oct 04 19:18:16.904664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.905151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.905619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.906379 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:16.907544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:16.908182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:16.912338 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42624. Oct 04 19:18:17.052042 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:17.059988 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3cbb446c-1f2b-4a31-8e47-6106eca3e760 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.179101 Oct 04 19:18:17.060559 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3880/7865] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:16 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:18.085205 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:18.085860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:18.097214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:18.097730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:18.098219 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.099001 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:18.099485 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:18.100059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:18.106268 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42632. Oct 04 19:18:18.107064 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 42630. Oct 04 19:18:18.238629 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:18.246490 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-307699cc-1e0a-4fa8-bc72-96b5904bbb9e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.165206 Oct 04 19:18:18.247074 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3986/7866] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:18 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:19.270253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:19.270878 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:19.277713 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.278238 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.278689 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.279382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:19.279842 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:19.280275 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:19.412809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:19.420749 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e66ddff8-72a9-45e1-8bd8-1c31b6536914 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.154653 Oct 04 19:18:19.421314 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3881/7867] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:19 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:20.444651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:20.445325 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:20.452363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.452871 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.453336 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.454616 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:20.455093 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:20.455541 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:20.590374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:20.599770 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c768ef97-4390-4e90-a1d7-e1272cd680eb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.159040 Oct 04 19:18:20.600361 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3987/7868] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:20 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:21.623642 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:21.624257 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:21.631296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.631782 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.632218 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.632908 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:21.633359 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:21.633779 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:21.764409 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:21.773580 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-c52471e7-9a8c-40ad-ac8d-4de34461306d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.153255 Oct 04 19:18:21.774005 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3882/7869] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:21 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:22.799939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:22.800530 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:22.807515 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.808058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.808545 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.809269 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:22.809752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:22.810233 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:22.948458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:22.956514 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c9ac817b-acb0-4c3c-bbc1-9c41c074db8a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.161112 Oct 04 19:18:22.957081 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3988/7870] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:22 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:23.980171 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:23.980809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:23.988232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.988716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.989152 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:23.989857 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:23.990315 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:23.990738 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:24.128449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:24.136356 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1d91de9f-025c-4d72-8256-7ea1a677eb31 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.160074 Oct 04 19:18:24.136934 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3883/7871] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:23 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:25.160234 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:25.160870 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:25.168866 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.169374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.169849 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.170558 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:25.171026 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:25.171469 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:25.303068 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:25.311176 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-92ceab55-fc03-4c74-90ef-e066909f5894 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.154840 Oct 04 19:18:25.311746 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3989/7872] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:25 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:18:26.335519 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:26.336140 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:26.343310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.343815 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.344296 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.345107 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:26.345573 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:26.346037 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:26.479964 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:26.489999 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-26d3246c-c817-4e64-aba2-11dde9b3ce79 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.158352 Oct 04 19:18:26.490577 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3884/7873] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:26 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:27.521367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:27.522196 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:27.529294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.530133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.530580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.531303 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:27.532370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:27.532843 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:27.670124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:27.678095 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-b3ebabab-d405-4aa0-a9b7-137988844b25 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.161684 Oct 04 19:18:27.678675 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3990/7874] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:27 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:28.702022 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:28.702682 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:28.710329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:28.710823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:28.711270 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:28.711978 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:28.712443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:28.713104 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:28.865181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:28.873104 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-d3168479-acc5-49b0-abd7-d63b60240a07 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.175009 Oct 04 19:18:28.873690 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3885/7875] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:28 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:29.896312 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:29.896860 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:29.903924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.904508 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.904963 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:29.905677 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:29.906177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:29.906622 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.043112 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:30.051465 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-691cd430-9db5-4dd0-b3d8-29c818653b43 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1570 microversion: 2.1 time: 0.159142 Oct 04 19:18:30.052050 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3991/7876] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:29 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:30.074765 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:30.075404 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:30.082851 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.083730 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.083881 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.084562 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.085026 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.085458 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.201106 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128850) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 04 19:18:30.268967 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b067eb7-c064-425f-bcc9-a5d5aabaec2b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "POST /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action" status: 202 len: 0 microversion: 2.1 time: 0.198170 Oct 04 19:18:30.269529 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3886/7877] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:18:30 2022] POST /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 04 19:18:30.277615 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:30.278300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:30.284781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.285248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.285715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.286466 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:30.286944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:30.287395 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:30.481933 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:30.490761 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ee178fe4-96f7-4529-b8b8-ddc319643fa2 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1518 microversion: 2.1 time: 0.216937 Oct 04 19:18:30.491438 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3992/7878] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:30 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1518 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:31.515069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:31.515862 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:31.524279 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:31.525153 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:31.526047 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:31.527298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:31.528165 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:31.528760 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:31.668532 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:31.677613 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-12260977-41db-41bc-b90e-18017ff351c6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1520 microversion: 2.1 time: 0.167606 Oct 04 19:18:31.679323 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3887/7879] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:31 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:32.458628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "name": "network-vif-unplugged", "status": "completed", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:32.470757 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.471268 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.471736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.490941 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.compute.server_external_events [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] Unable to find a host for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a. Dropping event network-vif-unplugged {{(pid=128849) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 04 19:18:32.491348 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-58e158dd-d49e-40e5-b9bb-e034f7ad37cc req-50254fe9-b4a0-4d63-ae66-a701a0be3ec6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037841 Oct 04 19:18:32.491955 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3993/7880] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 04 19:18:32.703059 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:32.704251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:32.711102 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.711589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.712024 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.712722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:32.713173 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:32.713597 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:32.848589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:32.856553 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-3db22f97-09f5-4e22-8015-47f4b11ce25c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1520 microversion: 2.1 time: 0.157490 Oct 04 19:18:32.857141 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3888/7881] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:32 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:33.880655 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:33.881304 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:33.889055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.889576 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.890072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:33.891365 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:33.892161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:33.892702 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:34.033006 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:34.041527 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-60a2db99-f4e3-4d8f-9d94-94f6ab5ad966 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1520 microversion: 2.1 time: 0.164713 Oct 04 19:18:34.042553 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3994/7882] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:33 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:35.067087 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:35.067711 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:35.074733 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:35.075242 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:35.075677 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:35.076380 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:35.076846 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:35.077277 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:35.216135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:35.224121 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-450c9670-cda6-441b-975a-74fee96691d4 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1520 microversion: 2.1 time: 0.161549 Oct 04 19:18:35.224690 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3889/7883] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:35 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:36.247651 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:36.248273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:36.255574 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:36.256072 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:36.256519 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:36.257226 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:36.257692 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:36.258159 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:36.460058 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:36.468011 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-d0a554fe-00d3-45a4-8495-3999f6a2a4ef tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.224252 Oct 04 19:18:36.468599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3995/7884] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:36 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:37.491662 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:37.492461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:37.501228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:37.501759 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:37.502707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:37.502963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:37.503428 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:37.503861 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:37.563985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:37.576355 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:37.577127 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:37.577590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:37.590035 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] Creating event network-changed:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h2-831194-21 Oct 04 19:18:37.596612 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-78915415-8abb-4040-a397-255309657af5 req-87f2ea31-0c81-4e72-a8f9-43831bf63231 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036422 Oct 04 19:18:37.597479 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3996/7885] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:37.663674 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:37.671697 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-0a548bb2-12a2-4396-a4d0-e2aef1c58edc tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.183919 Oct 04 19:18:37.672821 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3890/7886] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:37 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:38.697125 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:38.698004 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:38.705535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:38.706077 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:38.706537 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:38.707284 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:38.707738 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:38.708315 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:38.937294 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:38.946573 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-fa39be93-2854-438c-b026-1dac40152f44 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.254822 Oct 04 19:18:38.947165 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3997/7887] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:38 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:39.971310 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:39.972015 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:39.979240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:39.979736 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:39.980181 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:39.980900 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:39.981361 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:39.981793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:40.144773 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:40.152807 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bdddc3a3-26eb-45c2-b3b8-64d0f45bdaf5 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.185663 Oct 04 19:18:40.153381 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3891/7888] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:39 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:41.176309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:41.176939 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:41.183816 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:41.184333 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:41.184786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:41.185489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:41.185983 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:41.186423 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:41.403944 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:41.411730 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-0d7e90ac-177f-40e8-aaee-db2a4fec5c39 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.239419 Oct 04 19:18:41.412297 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3998/7889] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:41 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:42.436482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:42.437264 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:42.445050 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:42.445545 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:42.446023 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:42.446739 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:42.447200 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:42.447771 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:42.470539 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:42.635420 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:42.644244 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a5cf07e4-e9e5-4aa7-885e-1a8c66e6d424 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.212284 Oct 04 19:18:42.644812 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3892/7890] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:42 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:43.671051 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:43.672489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:43.682619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:43.683386 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:43.684045 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:43.685069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:43.685736 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:43.686409 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:44.151398 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:44.160163 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3b60bda8-42da-4ce1-b88e-32d66e8cc01a tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.495797 Oct 04 19:18:44.160736 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 3999/7891] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:43 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:45.183653 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:45.184276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:45.192371 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:45.192863 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:45.193309 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:45.194043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:45.194506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:45.194965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:45.331945 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:45.339877 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1cfbc6e6-0c72-452b-b419-d5ffcca54640 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.160125 Oct 04 19:18:45.340388 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3893/7892] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:45 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:46.364279 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:46.364885 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:46.368031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=31 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:46.373642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.374183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.374642 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.375808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:46.376302 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:46.376792 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:46.380202 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=83 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:46.513791 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:46.522518 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25c9ee6b-feb2-43f1-8171-bc5b877f9a8d tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.163275 Oct 04 19:18:46.523073 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4000/7893] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:46 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:47.547544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:47.548298 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:47.550643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:18:47.556507 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:47.557012 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:47.557451 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:47.558192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:47.558658 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:47.559089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:47.693219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:47.701127 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-215ad3ff-e90b-4810-b7fa-dbb890fbd2cb tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.158221 Oct 04 19:18:47.701695 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3894/7894] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:47 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:48.725190 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:48.725864 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:48.731980 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.732487 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.732936 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.733638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:48.734298 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:48.735255 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:48.881679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:48.889503 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8c6f6e0-7078-447e-abaf-3343c1318510 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.168497 Oct 04 19:18:48.890097 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4001/7895] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:48 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:49.077705 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "name": "network-vif-plugged", "status": "completed", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:18:49.091422 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.092070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.092611 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.106600 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] Creating event network-vif-plugged:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h2-831194-21 Oct 04 19:18:49.112418 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-216d1b0c-5e98-44e7-b944-cd6d2092c72b req-db9060bf-e7ad-4ab4-a66b-879be2114eaf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038661 Oct 04 19:18:49.113043 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3895/7896] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:18:49.916499 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:49.917133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:49.924536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.925055 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.925526 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:49.926292 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:49.926770 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:49.927216 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:50.067734 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:50.076530 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a2aeb4b1-00a5-4e00-87de-c0df10a2366e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1576 microversion: 2.1 time: 0.164075 Oct 04 19:18:50.077248 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4002/7897] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:49 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:18:51.102352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:18:51.103314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:18:51.109888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.110396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.110838 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.111550 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:18:51.112010 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:18:51.112441 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:18:51.245121 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:18:51.253111 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-5249837c-b1da-409c-9bf9-d7b474e60a99 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1563 microversion: 2.1 time: 0.156018 Oct 04 19:18:51.253869 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3896/7898] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:18:51 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:07.686137 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=5 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:07.686954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=17 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:07.688117 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:20:07.688268 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a (ip 10.222.0.42) !!! Oct 04 19:20:07.692870 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=5 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:07.693685 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=22 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:07.701629 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:20:07.701808 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:20:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a (ip 10.222.0.42) !!! Oct 04 19:20:07.710161 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:07.710879 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.724742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.725628 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.726796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.727155 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.727997 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.728452 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.761649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:07.762539 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:20:07.772602 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.773096 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.773536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.786023 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] Creating event network-changed:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h2-831194-21 Oct 04 19:20:07.791890 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e4edebeb-1201-4b6f-a27f-4f2fc40961ad req-06736521-6b2e-4ebd-a9b0-3e637a4ca722 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100348 Oct 04 19:20:07.792776 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3897/7899] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:07.849557 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-f239ae27-586e-41b2-8731-ee41a2dcf10b tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "DELETE /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 204 len: 0 microversion: 2.1 time: 0.165524 Oct 04 19:20:07.850712 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4003/7900] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:20:07 2022] DELETE /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:20:07.862436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:07.863524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:07.869810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.870346 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.870849 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:07.871568 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:07.872051 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:07.872515 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:08.016823 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:08.025720 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-86771759-a7a4-4450-bf8f-02485597549c tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.170004 Oct 04 19:20:08.026337 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3898/7901] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:07 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:20:09.051542 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:09.052561 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:09.059867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.060376 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.060832 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.061550 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:09.062050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:09.062498 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:09.211136 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:09.219381 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b6f8fc1-0cf0-4555-ac80-34f3f9f7e80e tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1569 microversion: 2.1 time: 0.172601 Oct 04 19:20:09.219698 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4004/7902] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:09 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:10.243567 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:10.244215 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:10.251222 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.251709 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.252144 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.252843 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.253292 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.253714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.492756 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0abe37a-6e4e-447c-8bbc-2f244dfb881a", "name": "network-vif-deleted", "tag": "803c9804-f26c-42f5-8650-161deef2e5fe"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:10.506633 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:10.507878 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:10.508675 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:10.526877 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] Creating event network-vif-deleted:803c9804-f26c-42f5-8650-161deef2e5fe for instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a on n-h2-831194-21 Oct 04 19:20:10.532305 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-c7bc19a6-430c-461b-b353-8d96e7bb2843 req-c467afc2-d14d-45e9-8107-a2db7ae7ff64 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044566 Oct 04 19:20:10.532993 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4005/7903] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:20:10.585865 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:10.594051 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-19b2b4a5-b144-4781-9a30-1ba7e6b5a572 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1382 microversion: 2.1 time: 0.355017 Oct 04 19:20:10.594626 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3899/7904] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:10 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1382 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:11.619143 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:11.619867 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:11.627048 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.627581 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.628031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.628892 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:11.629348 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:11.629786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:11.694211 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:11.702347 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a90c8ab2-9439-4234-a973-c2aad63c56ee tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1219 microversion: 2.1 time: 0.088289 Oct 04 19:20:11.702913 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4006/7905] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:11 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:12.725497 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:12.726240 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:12.733381 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.733896 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.734342 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.735043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:12.735501 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:12.736184 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:12.798935 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:12.807274 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-bc83c892-515b-44de-86fd-91c68b773909 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1219 microversion: 2.1 time: 0.085634 Oct 04 19:20:12.807838 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3900/7906] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:12 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:13.831886 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:13.832520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:13.840924 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.841440 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.841919 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.842643 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:13.843118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:13.843572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:13.906658 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:13.915141 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-4b1bd41e-288b-4b3d-9797-107bee0e5ec6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1219 microversion: 2.1 time: 0.087185 Oct 04 19:20:13.915724 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4007/7907] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:13 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:14.938161 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:14.938788 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:14.946722 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:14.947253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:14.949131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:14.949131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:14.949131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:14.949449 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:14.984337 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:14.984827 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:14.985271 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:14.985728 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lazy-loading 'fault' on Instance uuid e0abe37a-6e4e-447c-8bbc-2f244dfb881a {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:20:15.032267 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c83deb8a3b49e58e41f497e1c5f48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e2ceaf6977b4a669a4617697d3b615e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:15.040681 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-a9253736-f58c-475a-8005-f87e7778d9b0 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 200 len: 1224 microversion: 2.1 time: 0.106561 Oct 04 19:20:15.041501 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3901/7908] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:14 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:16.065129 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:16.065737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] [instance: e0abe37a-6e4e-447c-8bbc-2f244dfb881a] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:16.073579 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.074105 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.074567 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.075283 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:16.075761 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:16.076208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:16.090213 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] HTTP exception thrown: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Request method failure captured: Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a HTTP/1.1 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPIVaHsFcvYSQiZ1zA_LW5ZrosnGh2oMXL7UEl9PPGrUXuBnYe5XC98QHjfpbZ2CZGwlqLUs_a8OFP8dDH1KlHfme_ItmozuJAy2etL0bDVFlfM96d-6JXyHaFJBAVYMm3Z_zvUVfrZob9vPVBGQFNhhnSFxhZDsMb-rDjm737t5PVkE Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: 5e2ceaf6977b4a669a4617697d3b615e Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestShelveInstance-768110405 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5e2ceaf6977b4a669a4617697d3b615e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestShelveInstance-768110405 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: 5e2ceaf6977b4a669a4617697d3b615e Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestShelveInstance-768110405 Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestShelveInstance-768110405-project Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 11c83deb8a3b49e58e41f497e1c5f48b Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestShelveInstance-768110405-project Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': 'e0abe37a-6e4e-447c-8bbc-2f244dfb881a'} Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:20:16.091893 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Returning 404 to user: Instance e0abe37a-6e4e-447c-8bbc-2f244dfb881a could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a5970085-3382-47b1-a67c-d6b01ac31c16 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a" status: 404 len: 111 microversion: 2.1 time: 0.032169 Oct 04 19:20:16.097509 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4008/7909] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:16 2022] GET /compute/v2.1/servers/e0abe37a-6e4e-447c-8bbc-2f244dfb881a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:20:16.270276 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-40d8caa9-4bc5-4c6e-a29a-401631658de6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] Calling method '.version_select at 0x7fbdbc5c2f70>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:16.298609 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-40d8caa9-4bc5-4c6e-a29a-401631658de6 tempest-TestShelveInstance-768110405 tempest-TestShelveInstance-768110405-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-729338609" status: 202 len: 0 microversion: 2.1 time: 0.032029 Oct 04 19:20:16.303576 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3902/7910] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 19:20:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-729338609 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 04 19:20:34.149772 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:34.150572 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:34.332858 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ae8da5e1-57e5-4188-a531-e496b36b24e5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Action: 'create', calling method: .version_select at 0x7fbdbc4660d0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-91539430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEMRPPzPytsGp6iUTTT/S72i1HQ0sxTpnzs8TrVHT8XyauWCFfEBXC9YcJkbtnw50k+K2GgAUdYAgrWotv5A6SMdntd0qoc4w7Kciln6VhSssKOF/6jLesnZTaWnoQ40Q=="}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:34.349332 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae8da5e1-57e5-4188-a531-e496b36b24e5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for project a248e540e97f4aaeb305ce06d6120761. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:34.355993 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-ae8da5e1-57e5-4188-a531-e496b36b24e5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for user 2c111405d5cc4ad297272eac50375cda and project a248e540e97f4aaeb305ce06d6120761. Resources: {'key_pairs'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:34.386083 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ae8da5e1-57e5-4188-a531-e496b36b24e5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.241989 Oct 04 19:20:34.386693 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4009/7911] 10.222.0.42 () {60 vars in 1159 bytes} [Tue Oct 4 19:20:34 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:35.400637 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=28 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:35.401502 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:35.406948 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1307812162", "imageRef": "e1023401-e1c5-4082-870f-0d68a62149b1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-91539430", "security_groups": [{"name": "tempest-secgroup-smoke-1396588330"}], "networks": [{"uuid": "b24ae5e5-5cb4-4edf-bb3f-b7c3162b78a9"}]}} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:35.529319 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.network.neutron [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] validate_networks() for [('b24ae5e5-5cb4-4edf-bb3f-b7c3162b78a9', None, None, None, None, None)] {{(pid=128850) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:20:35.935640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Flavor limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:20:35.936069 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Image limits 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:20:35.936552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Flavor pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:20:35.936965 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Image pref 0:0:0 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:20:35.937382 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.virt.hardware [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128850) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:20:35.947125 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.947612 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.948052 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.948780 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:35.949241 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:35.949666 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:35.967793 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for project a248e540e97f4aaeb305ce06d6120761. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:20:35.973075 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.quota [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for user 2c111405d5cc4ad297272eac50375cda and project a248e540e97f4aaeb305ce06d6120761. Resources: {'instances', 'ram', 'cores'} {{(pid=128850) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:20:35.986248 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Going to run 1 instances... {{(pid=128850) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:20:35.988598 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1023401-e1c5-4082-870f-0d68a62149b1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128850) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:20:36.038243 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4e99e935-551f-46ea-bd58-793e06670d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.639332 Oct 04 19:20:36.045766 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3903/7912] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:20:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 04 19:20:36.056737 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c7aedba2-fab6-4362-9798-f70688cb3eb1 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:36.057126 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c7aedba2-fab6-4362-9798-f70688cb3eb1 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:36.127154 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c7aedba2-fab6-4362-9798-f70688cb3eb1 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:36.135965 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c7aedba2-fab6-4362-9798-f70688cb3eb1 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1247 microversion: 2.1 time: 0.088711 Oct 04 19:20:36.136560 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4010/7913] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:36 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1247 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:37.160686 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-be40761b-c3f4-4cff-834e-b5e55c452ebd tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:37.162120 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-be40761b-c3f4-4cff-834e-b5e55c452ebd tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:37.236804 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-be40761b-c3f4-4cff-834e-b5e55c452ebd tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:37.248482 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-be40761b-c3f4-4cff-834e-b5e55c452ebd tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1247 microversion: 2.1 time: 0.092468 Oct 04 19:20:37.249819 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3904/7914] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:37 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:38.271244 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-9ce1548c-2c79-4167-a86a-4e2349b2c83f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:38.271882 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-9ce1548c-2c79-4167-a86a-4e2349b2c83f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:38.327039 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-9ce1548c-2c79-4167-a86a-4e2349b2c83f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:38.334106 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-9ce1548c-2c79-4167-a86a-4e2349b2c83f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1247 microversion: 2.1 time: 0.066635 Oct 04 19:20:38.334599 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4011/7915] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:38 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1247 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:39.357251 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9b97d711-c091-4816-84fc-f646d30226e0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:39.357963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9b97d711-c091-4816-84fc-f646d30226e0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:39.416084 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9b97d711-c091-4816-84fc-f646d30226e0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:39.424098 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9b97d711-c091-4816-84fc-f646d30226e0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1247 microversion: 2.1 time: 0.070758 Oct 04 19:20:39.425364 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3905/7916] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:39 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1247 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:40.448985 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:40.449950 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:40.457592 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:40.458122 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:40.458652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:40.459389 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:40.459890 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:40.460341 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:40.542613 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:40.551505 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-329903aa-9d8b-4962-ab72-ea48a9ffd0ec tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1251 microversion: 2.1 time: 0.107641 Oct 04 19:20:40.552081 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4012/7917] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:40 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1251 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:41.578664 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:41.579912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:41.589619 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.590675 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.591481 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.592470 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:41.592993 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:41.593443 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:41.661389 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:41.671162 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-28b40aa4-cc01-489d-b3ff-28399f8484df tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1305 microversion: 2.1 time: 0.097185 Oct 04 19:20:41.671760 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3906/7918] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:41 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1305 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:42.697442 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:42.698254 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:42.705954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:42.706546 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:42.707223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:42.707962 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:42.708620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:42.709080 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:42.949022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:42.957002 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-25a8295e-6448-485d-bdb5-38db15d1e12a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.264587 Oct 04 19:20:42.972485 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4013/7919] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:42 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:43.091544 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:43.108578 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:43.109930 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:43.110615 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:43.126879 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] Creating event network-changed:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:20:43.132141 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2fc3709e-cc17-44a7-95ef-0e53d6f95287 req-00b3149b-8baf-4f15-8be5-5cdda468edf0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047090 Oct 04 19:20:43.132910 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3907/7920] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:43.980163 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:43.980796 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:43.987862 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:43.988363 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:43.988853 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:43.989578 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:43.990097 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:43.990535 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:44.129909 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:44.138325 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-13a836a0-26a6-40b1-a84e-d24dd49b71c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.162081 Oct 04 19:20:44.138917 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4014/7921] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:43 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:45.163810 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:45.164517 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:45.171043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:45.171534 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:45.171974 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:45.172668 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:45.173128 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:45.173559 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:45.312803 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:45.321275 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-163439f1-2e7b-40b2-81ea-d259cc020683 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.162902 Oct 04 19:20:45.321870 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3908/7922] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:45 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:46.344624 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:46.345165 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:46.352649 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:46.353144 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:46.353611 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:46.354335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:46.354803 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:46.355240 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:46.487220 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:46.495837 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c8aadfe5-be07-411e-ac48-2ab74dd41273 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.155229 Oct 04 19:20:46.496399 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4015/7923] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:46 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:47.520243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:47.520977 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:47.523268 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:47.528925 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:47.529427 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:47.529892 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:47.530630 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:47.531094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:47.531527 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:47.671151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:47.679610 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-2aeef86c-a8a2-4771-a2ec-9996a465f23f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.163296 Oct 04 19:20:47.680242 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3909/7924] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:47 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:48.702521 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:48.703157 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:48.705335 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=8 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:48.711293 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:48.711800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:48.712262 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:48.712981 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:48.713460 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:48.713934 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:48.846834 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:48.855894 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-89a03b81-5818-46e4-b99f-a7aea0cdf983 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.157430 Oct 04 19:20:48.856465 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4016/7925] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:48 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:49.288886 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "name": "network-vif-plugged", "status": "completed", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:49.298959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:49.299436 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:49.299869 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:49.311562 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] Creating event network-vif-plugged:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:20:49.316731 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-efb39ace-9109-4464-b514-f502404c7b06 req-5eca30dc-df2f-4a24-8549-f8d472cdc4aa service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096489 Oct 04 19:20:49.317456 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3910/7926] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:20:49.878932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:49.879565 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:49.887274 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:49.887781 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:49.888239 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:49.888955 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:49.889456 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:49.889932 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:50.025742 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:50.033456 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-a8db57df-e4f7-43f4-800f-434efc46de32 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1373 microversion: 2.1 time: 0.158426 Oct 04 19:20:50.034054 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4017/7927] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:49 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:51.056923 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:51.057646 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:51.059638 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=10 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:20:51.066094 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:51.066589 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:51.067032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:51.067740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:51.068206 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:51.068640 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:51.206482 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:51.215400 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e13e4a5d-db49-4281-9ac6-34995704d3c8 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1559 microversion: 2.1 time: 0.163077 Oct 04 19:20:51.215976 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3911/7928] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:51 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:51.238383 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:20:51.239075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:20:51.246145 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:51.246666 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:51.247133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:51.247874 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:51.248353 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:51.248806 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:51.393686 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:20:51.402567 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-75b18118-015a-4815-86e5-571997a2544f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1559 microversion: 2.1 time: 0.168291 Oct 04 19:20:51.403142 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4018/7929] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:20:51 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:20:53.433192 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:20:53.442523 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:20:53.443001 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:20:53.443467 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:20:53.456188 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] Creating event network-changed:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:20:53.462015 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-34320b3d-e8f1-4b69-8ea8-b559f666de4a req-ceab5a47-57ff-4c66-ab5a-3ff9773d31b2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033438 Oct 04 19:20:53.462939 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3912/7930] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:22:50.774721 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:22:50.775612 n-d-831194-21 devstack@n-api.service[128849]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 04 19:22:50.776490 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:50.777252 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=42 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:50.783476 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1442784599"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:50.785786 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:22:50.793716 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:50.794263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:50.794727 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:50.795453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:50.795928 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:50.796380 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:51.002887 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-012fbb68-360f-46f0-9ea2-ca3b5b79c8fe tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "POST /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678/action" status: 202 len: 0 microversion: 2.1 time: 0.229729 Oct 04 19:22:51.003542 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4019/7931] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:22:50 2022] POST /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:22:57.988677 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:22:57.989502 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:22:57.990151 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:57.991338 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=32 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:22:58.003809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "name": "network-vif-plugged", "status": "completed", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:22:58.015299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:22:58.015784 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:22:58.017708 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:22:58.035393 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] Creating event network-vif-plugged:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:22:58.041779 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-c1059202-0495-4523-8f4e-06c72cd5e91a req-6b991e86-dac1-4d94-8e17-e529ac1af69e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054673 Oct 04 19:22:58.043583 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3913/7932] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:04.593391 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:04.594419 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:04.599412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-998449320", "imageRef": "3026be3a-53e1-4f20-9dc3-050662fb928f", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-91539430", "security_groups": [{"name": "tempest-secgroup-smoke-1396588330"}], "networks": [{"uuid": "b24ae5e5-5cb4-4edf-bb3f-b7c3162b78a9"}]}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:04.625490 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [e608c01a-bcdd-46fe-ad79-fec7b85afb88] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43142. Oct 04 19:23:04.626801 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c4eb636-8f87-4548-8395-9d75be69c92e] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43144. Oct 04 19:23:04.723224 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.network.neutron [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] validate_networks() for [('b24ae5e5-5cb4-4edf-bb3f-b7c3162b78a9', None, None, None, None, None)] {{(pid=128849) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 04 19:23:05.186660 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Flavor limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 04 19:23:05.187118 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Image limits 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 04 19:23:05.187619 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Flavor pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 04 19:23:05.188082 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Image pref 0:0:0 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 04 19:23:05.188520 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.virt.hardware [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128849) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 04 19:23:05.197954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.198462 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.199429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.200198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:05.200676 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:05.201124 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:05.223514 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for project a248e540e97f4aaeb305ce06d6120761. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 04 19:23:05.229101 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.quota [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Getting quotas for user 2c111405d5cc4ad297272eac50375cda and project a248e540e97f4aaeb305ce06d6120761. Resources: {'instances', 'ram', 'cores'} {{(pid=128849) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 04 19:23:05.241873 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Going to run 1 instances... {{(pid=128849) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 04 19:23:05.244388 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3026be3a-53e1-4f20-9dc3-050662fb928f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128849) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 04 19:23:05.296551 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-052bbcc8-a087-4740-8d3e-3b47159b98a7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.705023 Oct 04 19:23:05.297211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4020/7933] 10.222.0.42 () {60 vars in 1147 bytes} [Tue Oct 4 19:23:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 04 19:23:05.309228 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b964ad5c-5d9c-4ef6-ab78-2fbb2e1838ac tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:05.309970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b964ad5c-5d9c-4ef6-ab78-2fbb2e1838ac tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:05.330274 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [50ec43c3-1799-4851-8575-bedb98751880] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43160. Oct 04 19:23:05.331947 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] [a63b6fb2-d1b5-4c9a-89c1-318b88195e8a] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 43158. Oct 04 19:23:05.382214 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b964ad5c-5d9c-4ef6-ab78-2fbb2e1838ac tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:05.391229 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b964ad5c-5d9c-4ef6-ab78-2fbb2e1838ac tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1246 microversion: 2.1 time: 0.086540 Oct 04 19:23:05.391883 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3914/7934] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:05 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:06.414659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:06.415223 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:06.422563 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:06.423075 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:06.423536 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:06.424256 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:06.424729 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:06.425175 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:06.502301 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:06.513170 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-3c78871e-9628-456b-9b38-5965fab25c33 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1298 microversion: 2.1 time: 0.102350 Oct 04 19:23:06.523002 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4021/7935] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:06 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:07.537365 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:07.539661 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:07.548089 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.548676 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.549226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.550182 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:07.550729 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:07.551253 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:07.741390 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:07.751700 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e675bf29-c461-4c73-b874-8c24bb43b856 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.218011 Oct 04 19:23:07.752727 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3915/7936] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:07 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:07.987431 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "name": "network-vif-unplugged", "status": "completed", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:08.011808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.014207 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.014787 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.031367 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] Creating event network-vif-unplugged:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:23:08.050238 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-92c1c199-5475-49ac-b993-cbe24790a03b req-7e8f677d-b0b3-4fbc-a5df-9903721ad2ff service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065977 Oct 04 19:23:08.051019 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4022/7937] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:08.776536 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:08.778830 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:08.786157 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.786647 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.787086 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.787783 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:08.788232 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:08.788807 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:08.931049 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:08.939210 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-4a7d4aa9-65a1-4f91-a1a7-8685eef8be7d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.166563 Oct 04 19:23:08.939896 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3916/7938] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:08 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:09.966453 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:09.967300 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:09.973800 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:09.974337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:09.975659 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:09.981130 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:09.981990 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:09.982534 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:10.146069 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:10.154853 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-11a67316-3cbe-4a9e-9c21-247164c2585f tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.195088 Oct 04 19:23:10.155439 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4023/7939] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:09 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:11.179082 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:11.179704 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:11.190533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:11.191226 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:11.191740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:11.192524 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:11.192981 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:11.193406 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:11.340888 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:11.349271 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-b4e25a78-1a6f-4475-ae4d-6ba3052494fb tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.174155 Oct 04 19:23:11.349877 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3917/7940] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:11 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:12.372899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:12.373509 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:12.381040 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:12.381543 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:12.382025 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:12.382746 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:12.383217 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:12.383673 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:12.532699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:12.543521 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c0d59c36-e58e-4bc0-bbbc-9cb84cab940b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.174295 Oct 04 19:23:12.544272 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4024/7941] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:12 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:13.567583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:13.569317 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:13.577691 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:13.578312 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:13.578836 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:13.579657 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:13.580285 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:13.580809 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:13.739150 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:13.747360 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-1c854c7f-e36c-4a15-ace4-447739036166 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.184733 Oct 04 19:23:13.747926 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3918/7942] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:13 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:14.770214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:14.770854 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:14.777638 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:14.778172 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:14.778621 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:14.779358 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:14.779823 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:14.780261 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:14.910627 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:14.919001 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-ffc5d75c-8870-416d-962d-83ca51d3677b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.152096 Oct 04 19:23:14.920211 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4025/7943] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:14 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:15.944741 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:15.945693 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:15.948697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell0:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:15.954697 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:15.955178 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:15.955621 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:15.956322 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:15.957021 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:15.961808 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:15.963130 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:15.969623 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:15.972059 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell0:SELECT=6 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:23:15.982390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:15.983183 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:15.984473 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:16.013430 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] Creating event network-changed:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:23:16.018860 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-3d6cdef4-ad5b-4287-a8c4-10974846f174 req-9cf41f6b-b54d-4aa4-a2c7-afad905a116b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062427 Oct 04 19:23:16.019642 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4026/7944] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:23:16.222643 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:16.232325 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-e8aea53e-3158-4f07-8eeb-db25c2fe6aa5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.291756 Oct 04 19:23:16.232919 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3919/7945] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:15 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:23:17.257003 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:17.257730 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:17.264699 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:17.265208 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:17.265668 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:17.266441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:17.266948 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:17.267406 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:17.416505 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:17.424957 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-76aad175-29e1-4e70-ae97-24876f16189c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.173247 Oct 04 19:23:17.425564 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4027/7946] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:17 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:23:18.448416 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:18.449043 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:18.456839 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:18.457405 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:18.458076 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:18.459019 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:18.459606 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:18.460048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:18.597160 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:18.604910 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-9c8f1b22-ccac-42f6-b20e-b6c5b448838b tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.160562 Oct 04 19:23:18.605535 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3920/7947] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:18 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:19.628267 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:19.628880 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:19.635876 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.636385 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.637516 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.638273 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:19.638753 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:19.639179 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:19.770804 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:19.779155 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eba6d224-eddf-43e1-8caa-bdf5539d7df6 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.154793 Oct 04 19:23:19.779727 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4028/7948] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:19 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:20.804032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:20.804716 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:20.811633 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:20.812135 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:20.812582 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:20.813314 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:20.813932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:20.814374 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:20.954934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:20.962970 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-acfc6425-4e5d-419e-8423-44408ffe4ed4 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.162964 Oct 04 19:23:20.963560 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3921/7949] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:20 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:21.986782 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:21.987337 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:21.994177 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:21.994679 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:21.995133 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:21.995838 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:21.996308 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:21.996840 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.133138 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:22.141418 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-eccc9f95-df17-4a3f-a2ee-783c0da8658d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.158491 Oct 04 19:23:22.142042 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4029/7950] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:21 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:22.330313 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "name": "network-vif-plugged", "status": "completed", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:22.342461 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:22.342958 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:22.343400 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:22.354935 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] Creating event network-vif-plugged:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:23:22.361328 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-6fbaf08c-e35e-49e0-b822-e02a9948e5da req-81801605-4351-4210-b9fd-a42c40318702 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034737 Oct 04 19:23:22.361963 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3922/7951] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:23:23.165749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:23.166413 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:23.173639 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:23.174182 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:23.174640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:23.175396 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:23.175918 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:23.176367 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:23.312640 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:23.320577 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-04da9466-db3b-4116-90bb-cb93cda2a25e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1372 microversion: 2.1 time: 0.158847 Oct 04 19:23:23.321145 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4030/7952] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:23 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:24.346335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:24.346963 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:24.353243 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:24.353732 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:24.354209 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:24.354912 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:24.356136 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:24.357280 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:24.489854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:24.498270 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-ea72e861-c248-4116-b8ba-f9b73a512650 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1557 microversion: 2.1 time: 0.157135 Oct 04 19:23:24.498887 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3923/7953] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:24 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:24.520718 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:23:24.521384 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:23:24.529489 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:24.530044 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:24.530513 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:24.531236 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:24.531715 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:24.532169 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:24.670973 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:23:24.678823 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-54276898-36b9-4d70-96e8-7189bea94cb7 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1557 microversion: 2.1 time: 0.162032 Oct 04 19:23:24.679395 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4031/7954] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:23:24 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:23:26.357070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:23:26.366841 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:23:26.367352 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:23:26.367786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:23:26.379921 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] Creating event network-changed:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:23:26.384958 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-d1cc7e71-b6e3-4e3d-b2dd-7831e35f3641 req-56d4e535-a0bc-4fbf-a0be-dfaa77bd8bb4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087541 Oct 04 19:23:26.386198 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3924/7955] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:24:53.735620 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:53.736417 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=60 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:53.739201 n-d-831194-21 devstack@n-api.service[128849]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:24:53.739362 n-d-831194-21 devstack@n-api.service[128849]: Tue Oct 4 19:24:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75/action (ip 10.222.0.42) !!! Oct 04 19:24:53.744856 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-392722120"}} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:53.747197 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:24:53.757374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:53.757916 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:53.758378 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:53.759100 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:53.759580 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:53.760029 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:54.184592 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-90d5a23e-553a-436c-a17d-a0afb525c65e tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "POST /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75/action" status: 202 len: 0 microversion: 2.1 time: 0.450848 Oct 04 19:24:54.185252 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4032/7956] 10.222.0.42 () {60 vars in 1278 bytes} [Tue Oct 4 19:24:53 2022] POST /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 04 19:24:58.753934 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "name": "network-vif-plugged", "status": "completed", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:24:58.764195 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=26 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:58.765417 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=54 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:24:58.767357 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:24:58.767799 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 04 19:24:58.770163 n-d-831194-21 devstack@n-api.service[128850]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 04 19:24:58.771085 n-d-831194-21 devstack@n-api.service[128850]: Tue Oct 4 19:24:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Oct 04 19:24:58.775872 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:24:58.776552 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:24:58.776991 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:24:58.794796 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] Creating event network-vif-plugged:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:24:58.800355 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-2e0d452d-0dcd-48bc-8bf4-86f43b580695 req-e7a23723-c5b1-40d0-8c5d-4134538d7ed6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051408 Oct 04 19:24:58.800961 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3925/7957] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:24:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:09.167287 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_api:SELECT=2 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:09.173272 n-d-831194-21 devstack@n-api.service[128849]: DEBUG dbcounter [-] [128849] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128849) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:09.174707 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:09.179022 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:09.179654 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:09.187450 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.187965 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.188458 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.189449 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.190009 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.190590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.223110 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Going to try to terminate instance {{(pid=128849) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:25:09.246039 n-d-831194-21 devstack@n-api.service[128850]: ERROR oslo.messaging._drivers.impl_rabbit [-] Connection failed: [Errno 104] Connection reset by peer (retrying in 1.0 seconds): ConnectionResetError: [Errno 104] Connection reset by peer Oct 04 19:25:09.247752 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_cell1:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:09.248605 n-d-831194-21 devstack@n-api.service[128850]: DEBUG dbcounter [-] [128850] Writing DB stats nova_api:SELECT=2 {{(pid=128850) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 19:25:09.256927 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.257755 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.258299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.275732 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] Creating event network-changed:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:25:09.281103 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-175c43c1-838c-4f31-bba9-825fdd1b2bb1 req-a963a5ca-a6d7-4014-b348-eac2ed5212a5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110801 Oct 04 19:25:09.282296 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3926/7958] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:09.312184 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-1a530f75-66d1-4a7f-89c3-d7e6fe10dea0 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 204 len: 0 microversion: 2.1 time: 0.146073 Oct 04 19:25:09.313183 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4033/7959] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:25:09 2022] DELETE /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:25:09.323207 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:09.323970 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:09.330335 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.331718 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.332306 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.333219 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:09.334048 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:09.334492 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:09.528786 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:09.536670 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-8fb2960f-8a09-401a-94d8-bae25648ad3a tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1682 microversion: 2.1 time: 0.218691 Oct 04 19:25:09.537345 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3927/7960] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:09 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1682 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:10.563186 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:10.563908 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:10.571690 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:10.572198 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:10.572652 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:10.573370 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:10.573857 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:10.574309 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:10.710491 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "name": "network-vif-unplugged", "status": "completed", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:10.715412 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:10.726276 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-2717c91c-197c-4c5f-9369-b1868aa7bc44 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1682 microversion: 2.1 time: 0.166875 Oct 04 19:25:10.726493 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4034/7961] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:10 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1682 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:10.736329 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:10.737077 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:10.737506 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:10.751652 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.compute.server_external_events [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] Creating event network-vif-unplugged:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:25:10.758535 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [req-e30c2636-3ba7-4c73-85d9-e606545ba58d req-a7341ec7-ddcd-4ffd-8be2-aa480ed3163b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052222 Oct 04 19:25:10.759814 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3928/7962] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:11.663374 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27d25d58-8674-405b-93af-617eaf539e75", "name": "network-vif-deleted", "tag": "2366fea3-36a5-4068-ba6a-29855bc013db"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:11.674954 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:11.675441 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:11.675920 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:11.693341 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] Creating event network-vif-deleted:2366fea3-36a5-4068-ba6a-29855bc013db for instance 27d25d58-8674-405b-93af-617eaf539e75 on n-h2-831194-21 Oct 04 19:25:11.698527 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-207fc50b-b7e4-41ff-884b-29612509963c req-2205547c-e481-4e45-9c49-087b0fe0bfa1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040245 Oct 04 19:25:11.699137 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4035/7963] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:11.751448 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:11.752163 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:11.758607 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:11.759088 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:11.759522 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:11.760213 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:11.760775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:11.761172 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:11.793233 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:11.793714 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:11.794189 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:11.794891 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lazy-loading 'fault' on Instance uuid 27d25d58-8674-405b-93af-617eaf539e75 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:25:11.841396 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:11.850260 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-f59cf0c8-9cc7-42e6-b3db-cadf44ec61c5 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 200 len: 1336 microversion: 2.1 time: 0.103782 Oct 04 19:25:11.850850 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3929/7964] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:11 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:12.875031 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:12.875764 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 27d25d58-8674-405b-93af-617eaf539e75] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:12.882135 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:12.882645 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:12.883108 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:12.883831 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:12.884307 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:12.884755 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:12.898605 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] HTTP exception thrown: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Request method failure captured: Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 HTTP/1.1 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPId8zW7Ffd8uB7IJpVLz_UIeee8yMP9zanm2sMmjWMneWJ7cLdYdb8RWemjlPeu331M930g_Nlkn3oTLJcv_OCp_dxatuaLWqLE6Gr6BhxS-OagBaIrk5CxNzNd00hzmP-wQIvCfHlT7ZkrXfMiRKlHYx0hmNTPZeM3bJrZ_jBUW8YA Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a248e540e97f4aaeb305ce06d6120761 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a248e540e97f4aaeb305ce06d6120761 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestSnapshotPattern-599038622-project Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2c111405d5cc4ad297272eac50375cda Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestSnapshotPattern-599038622-project Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '27d25d58-8674-405b-93af-617eaf539e75'} Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:12.900877 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Returning 404 to user: Instance 27d25d58-8674-405b-93af-617eaf539e75 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-c812d904-faed-4aa4-a27d-b01fd0013e8d tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75" status: 404 len: 111 microversion: 2.1 time: 0.033262 Oct 04 19:25:12.907228 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4036/7965] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:12 2022] GET /compute/v2.1/servers/27d25d58-8674-405b-93af-617eaf539e75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:25:14.268299 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:14.268904 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:14.271712 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:14.276469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:14.276959 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:14.277398 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:14.278131 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:14.278583 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:14.279533 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:14.283752 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:14.284416 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:14.285147 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:14.296984 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] Creating event network-changed:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:25:14.303148 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-4ebc4760-78b3-47ba-a042-2d98b2c346a8 req-c76da476-4799-4d11-961d-a0c54b0ff953 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036059 Oct 04 19:25:14.304245 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4037/7966] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 04 19:25:14.310469 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Going to try to terminate instance {{(pid=128850) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 04 19:25:14.400524 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-76ae4374-e6be-4329-a761-bdda4caeb16c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "DELETE /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 204 len: 0 microversion: 2.1 time: 0.135980 Oct 04 19:25:14.401892 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3930/7967] 10.222.0.42 () {58 vars in 1239 bytes} [Tue Oct 4 19:25:14 2022] DELETE /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 04 19:25:14.412429 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:14.413317 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:14.420065 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:14.420569 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:14.421028 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:14.421760 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:14.422263 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:14.422722 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:14.586338 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.policy [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128849) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:14.594297 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-321900a3-92c9-4473-b2d2-eb9515562b37 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1684 microversion: 2.1 time: 0.187566 Oct 04 19:25:14.594876 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4038/7968] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:14 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1684 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 04 19:25:15.620032 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:15.620740 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:15.627584 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.628070 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.628510 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.629205 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:15.629933 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:15.630529 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:15.775649 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:15.785106 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-32a00019-bf70-4092-b6d4-2e8921cb4faf tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1684 microversion: 2.1 time: 0.169431 Oct 04 19:25:15.787456 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3931/7969] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:15 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1684 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:16.488160 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e42e9-b9c5-4993-b44e-2218372ed678", "name": "network-vif-deleted", "tag": "7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad"}]} {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 04 19:25:16.498248 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:16.498749 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:16.499214 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:16.511338 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.compute.server_external_events [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] Creating event network-vif-deleted:7bfd5eb5-fdbc-4ea6-b309-b1d03a4076ad for instance 970e42e9-b9c5-4993-b44e-2218372ed678 on n-h1-831194-21 Oct 04 19:25:16.516037 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [req-fc2e476c-a0fb-4a3a-a33f-a23c2e8d3f12 req-8bc3ba10-9dc0-4a0b-b00a-0cf65230c8fe service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097106 Oct 04 19:25:16.516668 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4039/7970] 10.222.0.42 () {64 vars in 1317 bytes} [Tue Oct 4 19:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 04 19:25:16.809969 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:16.810670 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.compute.api [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128850) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:16.818957 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:16.819457 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:16.820775 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:16.821735 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:16.822237 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:16.822834 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:16.857812 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:16.858480 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:16.858932 n-d-831194-21 devstack@n-api.service[128850]: DEBUG oslo_concurrency.lockutils [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128850) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:16.859391 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.objects.instance [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lazy-loading 'fault' on Instance uuid 970e42e9-b9c5-4993-b44e-2218372ed678 {{(pid=128850) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 04 19:25:16.903854 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.policy [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c111405d5cc4ad297272eac50375cda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a248e540e97f4aaeb305ce06d6120761', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128850) authorize /opt/stack/nova/nova/policy.py:199}} Oct 04 19:25:16.912066 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-77e2257d-6f7c-47fc-9a7b-547b76abfa6c tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 200 len: 1337 microversion: 2.1 time: 0.106471 Oct 04 19:25:16.912661 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3932/7971] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:16 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 1337 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 04 19:25:17.939134 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '>' {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:17.939899 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.compute.api [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] [instance: 970e42e9-b9c5-4993-b44e-2218372ed678] Fetching instance by UUID {{(pid=128849) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 04 19:25:17.946881 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.947390 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.947855 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.948590 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Acquiring lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 04 19:25:17.949050 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 04 19:25:17.949501 n-d-831194-21 devstack@n-api.service[128849]: DEBUG oslo_concurrency.lockutils [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Lock "3dc46e29-bbad-4fd8-a61c-a696ecf0c9a1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128849) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 04 19:25:17.963598 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.wsgi [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] HTTP exception thrown: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Request method failure captured: Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: request: GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 HTTP/1.1 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Accept: application/json Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Accept-Encoding: identity Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Connection: close Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Content-Length: 0 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Content-Type: application/json Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Host: 10.222.0.42 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: Openstack-System-Scope: None Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: User-Agent: python-urllib3/1.26.12 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Auth-Token: gAAAAABjPId8zW7Ffd8uB7IJpVLz_UIeee8yMP9zanm2sMmjWMneWJ7cLdYdb8RWemjlPeu331M930g_Nlkn3oTLJcv_OCp_dxatuaLWqLE6Gr6BhxS-OagBaIrk5CxNzNd00hzmP-wQIvCfHlT7ZkrXfMiRKlHYx0hmNTPZeM3bJrZ_jBUW8YA Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Id: None Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Domain-Name: None Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Identity-Status: Confirmed Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Is-Admin-Project: True Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Id: default Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Domain-Name: Default Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Id: a248e540e97f4aaeb305ce06d6120761 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Project-Name: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Role: member,reader Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Roles: member,reader Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_a248e540e97f4aaeb305ce06d6120761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}] Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Id: a248e540e97f4aaeb305ce06d6120761 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-Tenant-Name: tempest-TestSnapshotPattern-599038622 Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-User: tempest-TestSnapshotPattern-599038622-project Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Id: default Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-User-Domain-Name: Default Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-User-Id: 2c111405d5cc4ad297272eac50375cda Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: X-User-Name: tempest-TestSnapshotPattern-599038622-project Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: method: > Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: exception: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: action_args: {'id': '970e42e9-b9c5-4993-b44e-2218372ed678'} Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: {{(pid=128849) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 04 19:25:17.965511 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: ERROR nova.api.openstack.wsgi Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: DEBUG nova.api.openstack.wsgi [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Returning 404 to user: Instance 970e42e9-b9c5-4993-b44e-2218372ed678 could not be found. {{(pid=128849) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: INFO nova.api.openstack.requestlog [None req-19d98b87-5b72-42e4-8cf4-a616b0827882 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678" status: 404 len: 111 microversion: 2.1 time: 0.033349 Oct 04 19:25:17.971204 n-d-831194-21 devstack@n-api.service[128849]: [pid: 128849|app: 0|req: 4040/7972] 10.222.0.42 () {58 vars in 1236 bytes} [Tue Oct 4 19:25:17 2022] GET /compute/v2.1/servers/970e42e9-b9c5-4993-b44e-2218372ed678 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 04 19:25:18.135394 n-d-831194-21 devstack@n-api.service[128850]: DEBUG nova.api.openstack.wsgi [None req-47cd9186-6e17-4306-9c83-383a5c0b8d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] Calling method '.version_select at 0x7fbdbc66f550>' {{(pid=128850) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 04 19:25:18.165468 n-d-831194-21 devstack@n-api.service[128850]: INFO nova.api.openstack.requestlog [None req-47cd9186-6e17-4306-9c83-383a5c0b8d66 tempest-TestSnapshotPattern-599038622 tempest-TestSnapshotPattern-599038622-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-91539430" status: 202 len: 0 microversion: 2.1 time: 0.034040 Oct 04 19:25:18.166218 n-d-831194-21 devstack@n-api.service[128850]: [pid: 128850|app: 0|req: 3933/7973] 10.222.0.42 () {58 vars in 1251 bytes} [Tue Oct 4 19:25:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-91539430 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)